[2025-10-02T17:00:01.725566] [INFO ] [MAIN ] Using last completed trading day: 2025-10-02 [2025-10-02T17:00:01.953399] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-02T17:00:01.953674] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-02T17:00:02.261902] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-02T17:00:02.262768] [WARN ] [STATE ] State set to: RUNNING [2025-10-02T17:00:02.262862] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-02T17:00:02.262944] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-02T17:00:02.263111] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-02T17:00:02.263170] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-02T17:00:03.772898] [DEBUG] [SYMBOL ] Found 2422 valid NYSE symbols. [2025-10-02T17:00:03.773051] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-02T17:00:03.773254] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-02T17:00:03.773899] [INFO ] [LOCAL ] Symbols cache updated with 2370 symbols. [2025-10-02T17:00:03.773958] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-02T17:00:03.773991] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-02T17:00:03.774047] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-02T17:00:03.774079] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-02T17:00:03.774109] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-02T17:00:03.774559] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-10-02T17:00:03.774614] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-02T17:00:03.774803] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-02T17:00:03.774855] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2370 valid symbols. [2025-10-02T17:00:03.774889] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-02T17:00:03.774922] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-02T17:00:03.794443] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-02T17:00:03.814037] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-02T17:00:03.814126] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-02T17:00:03.814163] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-02T17:00:03.814193] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-02T17:00:03.814251] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-02T17:00:03.814602] [DEBUG] [LOCAL ] Found 2370 symbols in cached list. [2025-10-02T17:00:03.814637] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-02T17:00:03.814715] [INFO ] [MAIN ] Starting incremental update for 2370 symbols. [2025-10-02T17:00:03.814749] [INFO ] [MAIN ] Running in parallel mode [2025-10-02T17:00:03.814919] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2370 symbols [2025-10-02T17:00:04.523025] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:04.683916] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:04.688137] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:04.692895] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:04.695020] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-02T17:00:04.695205] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-10-02T17:00:04.695290] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-10-02T17:00:04.695370] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-02T17:00:04.695535] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-02T17:00:04.695706] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-02T17:00:04.695901] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-02T17:00:04.696028] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-02T17:00:04.696118] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-02T17:00:04.696230] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-02T17:00:04.696345] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-02T17:00:04.696439] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-02T17:00:05.189021] [DEBUG] [LOCAL ] AA: Loaded 53615 existing records from primary storage. [2025-10-02T17:00:05.247176] [INFO ] [MAIN ] AA: Loaded 53615 existing records. [2025-10-02T17:00:05.420491] [DEBUG] [LOCAL ] A: Loaded 50727 existing records from primary storage. [2025-10-02T17:00:05.486208] [INFO ] [MAIN ] A: Loaded 50727 existing records. [2025-10-02T17:00:05.841217] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:05.872865] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-10-02T17:00:06.055535] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:06.134444] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-02T17:00:06.188358] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-02T17:00:06.186822] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:06.193511] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-02T17:00:06.193380] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:06.194024] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-10-02T17:00:06.194132] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-02T17:00:06.188823] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-02T17:00:06.200311] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-02T17:00:06.207564] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-02T17:00:06.218806] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-02T17:00:06.266759] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:00:06.351809] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-10-02T17:00:06.418188] [FATAL] [REMOTE ] AAMI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:00:06.470832] [FATAL] [MAIN ] AAMI: Failed to fetch primary data. [2025-10-02T17:00:06.486625] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:00:06.535604] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-02T17:00:06.626955] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-10-02T17:00:06.709151] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-02T17:00:06.732305] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-10-02T17:00:06.796635] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-02T17:00:06.812813] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-10-02T17:00:06.819093] [INFO ] [MAIN ] Update Progress: 1/2370 symbols completed. AAMI took 3.0s. Estimated remaining: 1h 58m 37s. Rate: 20.0 symbols/min [2025-10-02T17:00:07.130859] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:07.163491] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-10-02T17:00:07.300967] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-02T17:00:07.282164] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:07.324561] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-10-02T17:00:07.327288] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:07.326178] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-02T17:00:07.397528] [DEBUG] [LOCAL ] AAP: Loaded 51944 existing records from primary storage. [2025-10-02T17:00:07.397916] [INFO ] [MAIN ] AAP: Loaded 51944 existing records. [2025-10-02T17:00:07.594091] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:07.594311] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-02T17:00:07.594363] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-02T17:00:07.594749] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-10-02T17:00:07.594814] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-02T17:00:07.705318] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-02T17:00:07.709931] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-02T17:00:08.003840] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:08.004205] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-10-02T17:00:08.271783] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-02T17:00:08.273312] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-02T17:00:08.619478] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-02T17:00:08.620671] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-02T17:00:08.763606] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T17:00:08.773672] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-02T17:00:08.877171] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-02T17:00:08.878228] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-02T17:00:09.120421] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-02T17:00:09.121434] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-02T17:00:09.335821] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-02T17:00:09.347447] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-02T17:00:09.455405] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-02T17:00:09.456360] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-02T17:00:09.730360] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-02T17:00:09.731839] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-02T17:00:09.765340] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T17:00:09.776020] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-02T17:00:10.168608] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-02T17:00:10.170110] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-02T17:00:10.599451] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-02T17:00:10.600305] [INFO ] [REMOTE ] AAM: Full fetch complete (956 records). [2025-10-02T17:00:10.600381] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-02T17:00:10.832415] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-02T17:00:10.857071] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-02T17:00:10.858250] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-02T17:00:10.858378] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:00:10.859319] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:00:10.859402] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-02T17:00:10.859470] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-02T17:00:10.859525] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-02T17:00:10.859589] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-02T17:00:10.859681] [INFO ] [MAIN ] Update Progress: 2/2370 symbols completed. AAM took 7.0s. Estimated remaining: 2h 19m 1s. Rate: 17.0 symbols/min [2025-10-02T17:00:11.048950] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:11.090250] [DEBUG] [LOCAL ] AAT: Loaded 30404 existing records from primary storage. [2025-10-02T17:00:11.090524] [INFO ] [MAIN ] AAT: Loaded 30404 existing records. [2025-10-02T17:00:11.291954] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:11.292268] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-02T17:00:11.292393] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-02T17:00:11.292889] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-02T17:00:11.292953] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-02T17:00:11.744498] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:11.745515] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-10-02T17:00:11.814547] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-02T17:00:11.815582] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-02T17:00:11.839292] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-02T17:00:11.838871] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-02T17:00:12.490955] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T17:00:12.501075] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-02T17:00:13.153213] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T17:00:13.159133] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-02T17:00:13.632151] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T17:00:13.642806] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-02T17:00:13.815015] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-02T17:00:13.827558] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-02T17:00:14.079399] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T17:00:14.085406] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-02T17:00:14.340250] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T17:00:14.352191] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-02T17:00:15.315670] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T17:00:15.321718] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-02T17:00:16.020112] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-02T17:00:16.031889] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-02T17:00:16.107439] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-02T17:00:16.119000] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-02T17:00:16.692984] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-02T17:00:16.706825] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-02T17:00:17.700237] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-02T17:00:17.707607] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-02T17:00:17.744356] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:00:17.756983] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-02T17:00:19.168478] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (3.14 seconds). [2025-10-02T17:00:19.180148] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-02T17:00:19.334472] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:00:19.347030] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-02T17:00:20.181818] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (3.47 seconds). [2025-10-02T17:00:20.194323] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-02T17:00:21.229886] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T17:00:21.244012] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-02T17:00:21.740548] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T17:00:21.752237] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-02T17:00:21.783011] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-10-02T17:00:21.795602] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-02T17:00:22.909595] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T17:00:22.924006] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-02T17:00:22.992372] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (5.28 seconds). [2025-10-02T17:00:23.000559] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-02T17:00:23.313345] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T17:00:23.324854] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-02T17:00:23.644618] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T17:00:23.657807] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-02T17:00:24.342522] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T17:00:24.350351] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-02T17:00:24.821061] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T17:00:24.833378] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-02T17:00:25.236836] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T17:00:25.252056] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-02T17:00:25.653715] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T17:00:25.660912] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-02T17:00:26.914280] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T17:00:26.957965] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-02T17:00:26.960575] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-02T17:00:26.973340] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-02T17:00:27.016496] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T17:00:27.024838] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-02T17:00:27.821104] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (4.16 seconds). [2025-10-02T17:00:27.833000] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-02T17:00:28.146673] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T17:00:28.154903] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-02T17:00:28.502630] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-02T17:00:28.507672] [INFO ] [REMOTE ] AA: Full fetch complete (77538 records). [2025-10-02T17:00:28.507887] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-02T17:00:28.656409] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T17:00:28.694533] [INFO ] [REMOTE ] A: Full fetch complete (73134 records). [2025-10-02T17:00:28.699907] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-02T17:00:29.407869] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-10-02T17:00:29.413283] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-10-02T17:00:29.419832] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-10-02T17:00:29.437630] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-10-02T17:00:29.533809] [DEBUG] [LOCAL ] AA: Trimmed 77538 records to 54005 (keeping 200 days of data) [2025-10-02T17:00:29.567387] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-02T17:00:29.568678] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-02T17:00:29.570667] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-02T17:00:29.571427] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T17:00:29.577952] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-02T17:00:29.584454] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-02T17:00:29.695957] [DEBUG] [LOCAL ] A: Trimmed 73134 records to 51103 (keeping 200 days of data) [2025-10-02T17:00:29.863543] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T17:00:29.882363] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-02T17:00:30.355210] [DEBUG] [LOCAL ] A: Primary data saved (51103 records). [2025-10-02T17:00:30.357058] [INFO ] [MAIN ] A: Full history saved. [2025-10-02T17:00:30.357860] [INFO ] [MAIN ] Update Progress: 3/2370 symbols completed. A took 26.5s. Estimated remaining: 5h 49m 2s. Rate: 6.8 symbols/min [2025-10-02T17:00:30.565324] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:30.570808] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-02T17:00:30.571607] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-02T17:00:30.573433] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-02T17:00:30.573906] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-02T17:00:30.574838] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-02T17:00:30.575228] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-02T17:00:30.701703] [DEBUG] [LOCAL ] AA: Primary data saved (54005 records). [2025-10-02T17:00:30.701956] [INFO ] [MAIN ] AA: Full history saved. [2025-10-02T17:00:30.702843] [INFO ] [MAIN ] Update Progress: 4/2370 symbols completed. AA took 26.9s. Estimated remaining: 4h 25m 4s. Rate: 8.9 symbols/min [2025-10-02T17:00:30.919601] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:00:30.971216] [INFO ] [REMOTE ] AAT: Full fetch complete (42730 records). [2025-10-02T17:00:31.023778] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-02T17:00:31.186844] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:31.468755] [DEBUG] [LOCAL ] AB: Loaded 27393 existing records from primary storage. [2025-10-02T17:00:31.462004] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:31.482563] [INFO ] [MAIN ] AB: Loaded 27393 existing records. [2025-10-02T17:00:31.514178] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-10-02T17:00:31.936715] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-02T17:00:31.910530] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:00:31.946611] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-10-02T17:00:31.980791] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:31.946470] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-02T17:00:31.981314] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:00:31.982061] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-02T17:00:31.982344] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-02T17:00:31.982760] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-02T17:00:31.982958] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:00:31.982705] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-02T17:00:31.983445] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-02T17:00:31.983568] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-02T17:00:32.009780] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-02T17:00:32.013175] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-02T17:00:32.025850] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-02T17:00:32.031477] [DEBUG] [LOCAL ] AAT: Trimmed 42730 records to 30621 (keeping 200 days of data) [2025-10-02T17:00:32.054318] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-02T17:00:32.066791] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-02T17:00:32.067226] [INFO ] [MAIN ] Update Progress: 5/2370 symbols completed. AAUC took 1.7s. Estimated remaining: 3h 42m 43s. Rate: 10.6 symbols/min [2025-10-02T17:00:32.066592] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-02T17:00:32.279268] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-02T17:00:32.649840] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:32.676887] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-10-02T17:00:32.677426] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-10-02T17:00:32.699133] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-02T17:00:32.722032] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-02T17:00:32.744452] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-10-02T17:00:32.774699] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-02T17:00:32.771713] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:32.801982] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-10-02T17:00:33.265506] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:33.266350] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-10-02T17:00:33.279149] [DEBUG] [LOCAL ] AAT: Primary data saved (30621 records). [2025-10-02T17:00:33.279262] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-02T17:00:33.279353] [INFO ] [MAIN ] Update Progress: 6/2370 symbols completed. AAT took 22.4s. Estimated remaining: 3h 13m 29s. Rate: 12.2 symbols/min [2025-10-02T17:00:33.472747] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:33.472946] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-10-02T17:00:33.472990] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-10-02T17:00:33.473113] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-02T17:00:33.473158] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-02T17:00:33.473205] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-02T17:00:33.473242] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-02T17:00:33.881793] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:33.874889] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T17:00:33.883627] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-10-02T17:00:33.885618] [INFO ] [REMOTE ] AAP: Full fetch complete (75012 records). [2025-10-02T17:00:33.885811] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-02T17:00:34.333526] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-02T17:00:34.333752] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-02T17:00:34.334701] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-02T17:00:34.334972] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-02T17:00:34.336767] [DEBUG] [LOCAL ] AAP: Trimmed 75012 records to 52300 (keeping 200 days of data) [2025-10-02T17:00:34.477931] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T17:00:34.487673] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-02T17:00:34.715255] [DEBUG] [LOCAL ] AAP: Primary data saved (52300 records). [2025-10-02T17:00:34.715409] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-02T17:00:34.716866] [INFO ] [MAIN ] Update Progress: 7/2370 symbols completed. AAP took 27.9s. Estimated remaining: 2h 53m 52s. Rate: 13.6 symbols/min [2025-10-02T17:00:34.901985] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:34.954399] [DEBUG] [LOCAL ] ABEV: Loaded 53278 existing records from primary storage. [2025-10-02T17:00:34.954778] [INFO ] [MAIN ] ABEV: Loaded 53278 existing records. [2025-10-02T17:00:35.160687] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:35.161490] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-02T17:00:35.161753] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-02T17:00:35.162601] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-02T17:00:35.162896] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-02T17:00:35.275584] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T17:00:35.304531] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-02T17:00:35.555701] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-02T17:00:35.591410] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-02T17:00:35.675946] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:35.676433] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-10-02T17:00:35.920771] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T17:00:35.928754] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-02T17:00:36.582627] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T17:00:36.590398] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-02T17:00:37.425513] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T17:00:37.436603] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-02T17:00:37.487926] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T17:00:37.494779] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-02T17:00:37.577549] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T17:00:37.586799] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-02T17:00:37.641088] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T17:00:37.652477] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-02T17:00:38.768575] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-02T17:00:38.779048] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-02T17:00:38.953709] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T17:00:38.963480] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-02T17:00:39.227314] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T17:00:39.238045] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-02T17:00:39.553621] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T17:00:39.565270] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-02T17:00:40.150310] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T17:00:40.158996] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-02T17:00:40.510303] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T17:00:40.524582] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-02T17:00:41.262536] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T17:00:41.273939] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-02T17:00:41.293966] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:00:41.301119] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-02T17:00:41.423811] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-02T17:00:41.435802] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-02T17:00:41.659039] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:00:41.666574] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-02T17:00:42.399750] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T17:00:42.406042] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-02T17:00:42.720445] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T17:00:42.725888] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-02T17:00:43.246451] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-02T17:00:43.258175] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-02T17:00:43.292248] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T17:00:43.303832] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-02T17:00:43.580624] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-02T17:00:43.586459] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-02T17:00:44.653317] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T17:00:44.658665] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-02T17:00:44.984627] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-10-02T17:00:44.992941] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-02T17:00:45.304628] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T17:00:45.316853] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-02T17:00:45.586409] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-02T17:00:45.598314] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-02T17:00:45.806421] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T17:00:45.814873] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-02T17:00:46.052708] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T17:00:46.059389] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-02T17:00:46.772581] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T17:00:46.774135] [INFO ] [REMOTE ] AB: Full fetch complete (45606 records). [2025-10-02T17:00:46.774248] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-02T17:00:46.978910] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T17:00:47.034473] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-02T17:00:47.298895] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-10-02T17:00:47.299028] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-10-02T17:00:47.299802] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-10-02T17:00:47.300029] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-10-02T17:00:47.301737] [DEBUG] [LOCAL ] AB: Trimmed 45606 records to 27632 (keeping 200 days of data) [2025-10-02T17:00:47.465852] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T17:00:47.514424] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T17:00:47.510210] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-02T17:00:47.545758] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-02T17:00:47.575055] [DEBUG] [LOCAL ] AB: Primary data saved (27632 records). [2025-10-02T17:00:47.575159] [INFO ] [MAIN ] AB: Full history saved. [2025-10-02T17:00:47.575240] [INFO ] [MAIN ] Update Progress: 8/2370 symbols completed. AB took 16.9s. Estimated remaining: 3h 35m 20s. Rate: 11.0 symbols/min [2025-10-02T17:00:47.772222] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:47.793784] [DEBUG] [LOCAL ] ABG: Loaded 18569 existing records from primary storage. [2025-10-02T17:00:47.794064] [INFO ] [MAIN ] ABG: Loaded 18569 existing records. [2025-10-02T17:00:47.990833] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:47.991140] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-02T17:00:47.991201] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-02T17:00:47.991551] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-02T17:00:47.991623] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-02T17:00:48.380556] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:48.380979] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-10-02T17:00:48.522805] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T17:00:48.524379] [INFO ] [REMOTE ] ABCB: Full fetch complete (44563 records). [2025-10-02T17:00:48.524470] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-02T17:00:48.949379] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-10-02T17:00:48.949591] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-10-02T17:00:48.950156] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-10-02T17:00:48.959907] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-10-02T17:00:48.979303] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-02T17:00:48.979434] [DEBUG] [LOCAL ] ABCB: Trimmed 44563 records to 30713 (keeping 200 days of data) [2025-10-02T17:00:48.991495] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-02T17:00:49.193934] [DEBUG] [LOCAL ] ABCB: Primary data saved (30713 records). [2025-10-02T17:00:49.194069] [INFO ] [MAIN ] ABCB: Full history saved. [2025-10-02T17:00:49.194202] [INFO ] [MAIN ] Update Progress: 9/2370 symbols completed. ABCB took 15.9s. Estimated remaining: 3h 18m 25s. Rate: 11.9 symbols/min [2025-10-02T17:00:49.384179] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:49.384560] [DEBUG] [LOCAL ] ABM: No existing data file found in primary storage. [2025-10-02T17:00:49.384704] [WARN ] [MAIN ] ABM: No existing data found, performing full refresh instead. [2025-10-02T17:00:49.384871] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-02T17:00:49.385028] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-02T17:00:49.385341] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-02T17:00:49.385483] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-02T17:00:49.447095] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T17:00:49.491051] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-02T17:00:49.823290] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:49.823698] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-10-02T17:00:49.826373] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-02T17:00:49.839278] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-02T17:00:50.377089] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-02T17:00:50.381553] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-02T17:00:51.014991] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-02T17:00:51.026978] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-02T17:00:51.239587] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:00:51.245841] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-02T17:00:51.397333] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T17:00:51.401282] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-02T17:00:51.596585] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T17:00:51.608388] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-02T17:00:52.403717] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T17:00:52.410180] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-02T17:00:52.480939] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T17:00:52.486096] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-02T17:00:52.885280] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T17:00:52.898170] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-02T17:00:53.268752] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T17:00:53.275178] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-02T17:00:53.370700] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T17:00:53.393123] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-02T17:00:53.903246] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T17:00:53.913630] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-02T17:00:54.394491] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T17:00:54.401976] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-02T17:00:54.739116] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T17:00:54.753465] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-02T17:00:54.884365] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T17:00:54.888137] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-02T17:00:54.940126] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T17:00:54.942170] [INFO ] [REMOTE ] ABBV: Full fetch complete (77720 records). [2025-10-02T17:00:54.942280] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-02T17:00:55.382528] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-02T17:00:55.382622] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-02T17:00:55.383357] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-02T17:00:55.383415] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-02T17:00:55.385083] [DEBUG] [LOCAL ] ABBV: Trimmed 77720 records to 54074 (keeping 200 days of data) [2025-10-02T17:00:55.668737] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T17:00:55.674959] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-02T17:00:55.785053] [DEBUG] [LOCAL ] ABBV: Primary data saved (54074 records). [2025-10-02T17:00:55.785204] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-02T17:00:55.785281] [INFO ] [MAIN ] Update Progress: 10/2370 symbols completed. ABBV took 23.7s. Estimated remaining: 3h 24m 25s. Rate: 11.5 symbols/min [2025-10-02T17:00:55.985561] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T17:00:56.006357] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:56.015077] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-02T17:00:56.078392] [DEBUG] [LOCAL ] ABR: Loaded 51995 existing records from primary storage. [2025-10-02T17:00:56.078862] [INFO ] [MAIN ] ABR: Loaded 51995 existing records. [2025-10-02T17:00:56.237219] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T17:00:56.286859] [INFO ] [REMOTE ] ABEV: Full fetch complete (77210 records). [2025-10-02T17:00:56.310667] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-02T17:00:56.310499] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:56.310875] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-02T17:00:56.311085] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-02T17:00:56.311637] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-10-02T17:00:56.311787] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-02T17:00:57.017152] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T17:00:57.054492] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-02T17:00:57.175066] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:57.199633] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-10-02T17:00:57.228964] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-02T17:00:57.236200] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-02T17:00:57.247027] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-02T17:00:57.247421] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-02T17:00:57.250626] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T17:00:57.261737] [DEBUG] [LOCAL ] ABEV: Trimmed 77210 records to 53668 (keeping 200 days of data) [2025-10-02T17:00:57.262297] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-02T17:00:57.590139] [DEBUG] [LOCAL ] ABEV: Primary data saved (53668 records). [2025-10-02T17:00:57.590325] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-02T17:00:57.594172] [INFO ] [MAIN ] Update Progress: 11/2370 symbols completed. ABEV took 22.9s. Estimated remaining: 3h 12m 13s. Rate: 12.3 symbols/min [2025-10-02T17:00:57.796020] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:00:57.868278] [DEBUG] [LOCAL ] ABT: Loaded 53620 existing records from primary storage. [2025-10-02T17:00:57.868622] [INFO ] [MAIN ] ABT: Loaded 53620 existing records. [2025-10-02T17:00:58.074723] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:00:58.074972] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-02T17:00:58.075178] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-02T17:00:58.080759] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-10-02T17:00:58.088405] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-02T17:00:58.087917] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-02T17:00:58.142106] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-02T17:00:58.506276] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:00:58.506788] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-10-02T17:00:58.656528] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T17:00:58.664873] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-02T17:00:58.764488] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T17:00:58.775345] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-02T17:00:59.193964] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T17:00:59.197921] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-02T17:01:00.063728] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:01:00.072738] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-02T17:01:00.083043] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T17:01:00.084849] [INFO ] [REMOTE ] ABG: Full fetch complete (26594 records). [2025-10-02T17:01:00.085018] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-02T17:01:00.542454] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-10-02T17:01:00.543603] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-10-02T17:01:00.545163] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T17:01:00.556298] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-10-02T17:01:00.557410] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-10-02T17:01:00.558061] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-02T17:01:00.561108] [DEBUG] [LOCAL ] ABG: Trimmed 26594 records to 18742 (keeping 200 days of data) [2025-10-02T17:01:00.675310] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T17:01:00.689431] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-02T17:01:00.721145] [DEBUG] [LOCAL ] ABG: Primary data saved (18742 records). [2025-10-02T17:01:00.721329] [INFO ] [MAIN ] ABG: Full history saved. [2025-10-02T17:01:00.721492] [INFO ] [MAIN ] Update Progress: 12/2370 symbols completed. ABG took 13.1s. Estimated remaining: 3h 6m 22s. Rate: 12.7 symbols/min [2025-10-02T17:01:00.906710] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:00.906956] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-10-02T17:01:00.907004] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-10-02T17:01:00.907126] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-02T17:01:00.907174] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-02T17:01:00.907221] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-02T17:01:00.907264] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-02T17:01:01.299584] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:01.299940] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-10-02T17:01:01.771190] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T17:01:01.778803] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-02T17:01:02.176208] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T17:01:02.181296] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-02T17:01:02.306569] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T17:01:02.316895] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-02T17:01:02.391389] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T17:01:02.402808] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-02T17:01:03.047809] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T17:01:03.052902] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-02T17:01:03.284779] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T17:01:03.293363] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-02T17:01:04.209220] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T17:01:04.215036] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-02T17:01:04.344614] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T17:01:04.347099] [INFO ] [REMOTE ] ABM: Full fetch complete (44639 records). [2025-10-02T17:01:04.347257] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-02T17:01:04.348187] [FATAL] [VALIDATOR ] ABM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:01:04.348301] [FATAL] [MAIN ] ABM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:01:04.348411] [WARN ] [MAIN ] ABM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:01:04.348508] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-02T17:01:04.348616] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-02T17:01:04.348715] [INFO ] [LOCAL ] ABM: Starting deletion of derivative data. [2025-10-02T17:01:04.348820] [DEBUG] [LOCAL ] ABM: No derivative data file found to delete. [2025-10-02T17:01:04.348948] [INFO ] [MAIN ] Update Progress: 13/2370 symbols completed. ABM took 15.2s. Estimated remaining: 3h 2m 55s. Rate: 12.9 symbols/min [2025-10-02T17:01:04.590477] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:04.606258] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-02T17:01:04.648596] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-02T17:01:04.654846] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-02T17:01:04.666903] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-02T17:01:04.705700] [DEBUG] [LOCAL ] ACCO: Loaded 37359 existing records from primary storage. [2025-10-02T17:01:04.706114] [INFO ] [MAIN ] ACCO: Loaded 37359 existing records. [2025-10-02T17:01:04.916364] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:04.916631] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-02T17:01:04.916718] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-02T17:01:04.917562] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-02T17:01:04.917629] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-02T17:01:05.330916] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:05.331387] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-10-02T17:01:05.629116] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T17:01:05.636087] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-02T17:01:06.335533] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T17:01:06.348145] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-02T17:01:06.422067] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T17:01:06.434315] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-02T17:01:06.844420] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T17:01:06.852547] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-02T17:01:06.913305] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T17:01:06.919776] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-02T17:01:07.793567] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-02T17:01:07.799504] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-02T17:01:07.962298] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:01:07.970972] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-02T17:01:08.355523] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-02T17:01:08.367235] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-02T17:01:08.469031] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T17:01:08.482095] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-02T17:01:08.754616] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-02T17:01:08.760064] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-02T17:01:09.386591] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T17:01:09.395028] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-02T17:01:09.943121] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T17:01:09.956432] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-02T17:01:10.003277] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:01:10.004426] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T17:01:10.022874] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-02T17:01:10.024856] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-02T17:01:10.805749] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T17:01:10.815288] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-02T17:01:11.243004] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T17:01:11.249023] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-02T17:01:11.434995] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T17:01:11.449514] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-02T17:01:11.481241] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T17:01:11.493307] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-02T17:01:12.302725] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T17:01:12.307777] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-02T17:01:12.377786] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T17:01:12.386959] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-02T17:01:13.044911] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T17:01:13.046212] [INFO ] [REMOTE ] ACA: Full fetch complete (34305 records). [2025-10-02T17:01:13.046350] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-02T17:01:13.354858] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T17:01:13.418372] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-02T17:01:13.504091] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-10-02T17:01:13.504819] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-10-02T17:01:13.505516] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-10-02T17:01:13.505682] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-10-02T17:01:13.507322] [DEBUG] [LOCAL ] ACA: Trimmed 34305 records to 23486 (keeping 200 days of data) [2025-10-02T17:01:13.641108] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-02T17:01:13.658025] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-02T17:01:13.712401] [DEBUG] [LOCAL ] ACA: Primary data saved (23486 records). [2025-10-02T17:01:13.712550] [INFO ] [MAIN ] ACA: Full history saved. [2025-10-02T17:01:13.712745] [INFO ] [MAIN ] Update Progress: 14/2370 symbols completed. ACA took 13.0s. Estimated remaining: 3h 16m 3s. Rate: 12.0 symbols/min [2025-10-02T17:01:13.910219] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:13.910413] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-10-02T17:01:13.910561] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-10-02T17:01:13.910718] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-02T17:01:13.910914] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-02T17:01:13.911064] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-02T17:01:13.911286] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-02T17:01:14.054151] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T17:01:14.116825] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-02T17:01:14.335042] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:14.673077] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-10-02T17:01:15.164284] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T17:01:15.404951] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T17:01:15.473022] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-02T17:01:15.760164] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:01:15.859449] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T17:01:16.273013] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-02T17:01:17.072968] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-02T17:01:17.595747] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-02T17:01:17.692360] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-02T17:01:17.873032] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-02T17:01:18.508779] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T17:01:18.512766] [INFO ] [REMOTE ] ABR: Full fetch complete (75234 records). [2025-10-02T17:01:18.512988] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-02T17:01:18.689125] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-02T17:01:18.986103] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-02T17:01:18.986207] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-02T17:01:18.987173] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-02T17:01:18.987311] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-02T17:01:18.989334] [DEBUG] [LOCAL ] ABR: Trimmed 75234 records to 52372 (keeping 200 days of data) [2025-10-02T17:01:19.331113] [DEBUG] [LOCAL ] ABR: Primary data saved (52372 records). [2025-10-02T17:01:19.331426] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-02T17:01:19.333636] [INFO ] [MAIN ] Update Progress: 15/2370 symbols completed. ABR took 23.5s. Estimated remaining: 3h 17m 36s. Rate: 11.9 symbols/min [2025-10-02T17:01:19.447989] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T17:01:19.464251] [INFO ] [REMOTE ] ABT: Full fetch complete (77595 records). [2025-10-02T17:01:19.474781] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-02T17:01:19.474629] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-02T17:01:19.571477] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:19.949343] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T17:01:19.974899] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-02T17:01:20.001447] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-02T17:01:20.296892] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-02T17:01:20.301996] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-02T17:01:20.302109] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-02T17:01:20.304741] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-02T17:01:20.320438] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-02T17:01:20.327815] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:20.328610] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-02T17:01:20.328712] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-02T17:01:20.329191] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-02T17:01:20.329354] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-02T17:01:20.411359] [DEBUG] [LOCAL ] ABT: Trimmed 77595 records to 54010 (keeping 200 days of data) [2025-10-02T17:01:20.827060] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T17:01:20.909308] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:21.081859] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-10-02T17:01:21.135029] [DEBUG] [LOCAL ] ABT: Primary data saved (54010 records). [2025-10-02T17:01:21.135163] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-02T17:01:21.136084] [INFO ] [MAIN ] Update Progress: 16/2370 symbols completed. ABT took 23.5s. Estimated remaining: 3h 9m 36s. Rate: 12.4 symbols/min [2025-10-02T17:01:21.328849] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:21.402918] [DEBUG] [LOCAL ] ACI: Loaded 53259 existing records from primary storage. [2025-10-02T17:01:21.403350] [INFO ] [MAIN ] ACI: Loaded 53259 existing records. [2025-10-02T17:01:21.655982] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:21.673411] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-02T17:01:21.673531] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-02T17:01:21.675074] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T17:01:21.681398] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-02T17:01:21.681600] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-02T17:01:21.880983] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-02T17:01:22.072272] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:22.673041] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-02T17:01:23.324448] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:01:23.472991] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-10-02T17:01:23.621254] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-10-02T17:01:23.661597] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T17:01:24.273049] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-02T17:01:25.072982] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T17:01:25.073126] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-02T17:01:25.873059] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-02T17:01:26.536357] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:01:26.673972] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-02T17:01:26.676815] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-10-02T17:01:27.478457] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-02T17:01:27.505281] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:01:27.790158] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T17:01:28.273043] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-02T17:01:29.073017] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-02T17:01:29.636396] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T17:01:29.638224] [INFO ] [REMOTE ] ACCO: Full fetch complete (54002 records). [2025-10-02T17:01:29.638354] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-02T17:01:29.878126] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-02T17:01:30.157035] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-10-02T17:01:30.157373] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-02T17:01:30.158676] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T17:01:30.168260] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-02T17:01:30.177170] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-02T17:01:30.177736] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-02T17:01:30.179406] [DEBUG] [LOCAL ] ACCO: Trimmed 54002 records to 37574 (keeping 200 days of data) [2025-10-02T17:01:30.412565] [DEBUG] [LOCAL ] ACCO: Primary data saved (37574 records). [2025-10-02T17:01:30.412746] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-02T17:01:30.412844] [INFO ] [MAIN ] Update Progress: 17/2370 symbols completed. ACCO took 26.1s. Estimated remaining: 3h 19m 46s. Rate: 11.8 symbols/min [2025-10-02T17:01:30.617929] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:30.672306] [DEBUG] [LOCAL ] ACM: Loaded 43000 existing records from primary storage. [2025-10-02T17:01:30.672702] [INFO ] [MAIN ] ACM: Loaded 43000 existing records. [2025-10-02T17:01:30.678392] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-02T17:01:30.893140] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:30.893401] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-02T17:01:30.893451] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-02T17:01:30.894470] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-10-02T17:01:30.894534] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-02T17:01:31.303819] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:31.473206] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-02T17:01:31.617789] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T17:01:32.272969] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-02T17:01:32.712738] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T17:01:33.073050] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-10-02T17:01:33.319743] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-10-02T17:01:33.530165] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T17:01:33.873044] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-02T17:01:34.482720] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T17:01:34.673041] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-02T17:01:35.473059] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-02T17:01:36.216992] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-02T17:01:36.273046] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-02T17:01:36.582772] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-02T17:01:36.723328] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T17:01:37.073027] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-02T17:01:37.873019] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-02T17:01:38.140491] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T17:01:38.202587] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T17:01:38.673025] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-02T17:01:39.473035] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-02T17:01:40.272978] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-02T17:01:40.372192] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T17:01:40.622519] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-10-02T17:01:41.073002] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-02T17:01:41.081620] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T17:01:41.082789] [INFO ] [REMOTE ] ACEL: Full fetch complete (38519 records). [2025-10-02T17:01:41.082878] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-02T17:01:41.083414] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:01:41.083504] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:01:41.083574] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:01:41.083718] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-02T17:01:41.083815] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-10-02T17:01:41.083878] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-10-02T17:01:41.083933] [DEBUG] [LOCAL ] ACEL: No derivative data file found to delete. [2025-10-02T17:01:41.083999] [INFO ] [MAIN ] Update Progress: 18/2370 symbols completed. ACEL took 27.4s. Estimated remaining: 3h 31m 50s. Rate: 11.1 symbols/min [2025-10-02T17:01:41.322710] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:41.328507] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T17:01:41.408350] [DEBUG] [LOCAL ] ACN: Loaded 53426 existing records from primary storage. [2025-10-02T17:01:41.408737] [INFO ] [MAIN ] ACN: Loaded 53426 existing records. [2025-10-02T17:01:41.622411] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:41.622661] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-02T17:01:41.622737] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-02T17:01:41.623493] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-02T17:01:41.623557] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-02T17:01:41.885008] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-02T17:01:42.029479] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:42.673011] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-10-02T17:01:43.472997] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-02T17:01:43.561332] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T17:01:43.735162] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-10-02T17:01:44.278249] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-02T17:01:44.293515] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T17:01:45.002960] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T17:01:45.073003] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-02T17:01:45.873011] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-02T17:01:46.673019] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-02T17:01:47.012686] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-10-02T17:01:47.061795] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T17:01:47.473025] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-02T17:01:47.609254] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T17:01:48.015148] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T17:01:48.273051] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-02T17:01:49.049024] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:01:49.073057] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-02T17:01:49.873069] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-02T17:01:50.672981] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-02T17:01:50.968895] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-02T17:01:51.033690] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-02T17:01:51.074154] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-02T17:01:51.473041] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-02T17:01:52.272990] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-02T17:01:52.475773] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T17:01:52.814255] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:01:52.816350] [INFO ] [REMOTE ] ACI: Full fetch complete (77048 records). [2025-10-02T17:01:52.816487] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-02T17:01:53.078078] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-02T17:01:53.261763] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-10-02T17:01:53.261862] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-10-02T17:01:53.262706] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-10-02T17:01:53.262792] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-10-02T17:01:53.264447] [DEBUG] [LOCAL ] ACI: Trimmed 77048 records to 53643 (keeping 200 days of data) [2025-10-02T17:01:53.610789] [DEBUG] [LOCAL ] ACI: Primary data saved (53643 records). [2025-10-02T17:01:53.610938] [INFO ] [MAIN ] ACI: Full history saved. [2025-10-02T17:01:53.611763] [INFO ] [MAIN ] Update Progress: 19/2370 symbols completed. ACI took 32.5s. Estimated remaining: 3h 46m 26s. Rate: 10.4 symbols/min [2025-10-02T17:01:53.806095] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:53.840982] [DEBUG] [LOCAL ] ACP: Loaded 30980 existing records from primary storage. [2025-10-02T17:01:53.841274] [INFO ] [MAIN ] ACP: Loaded 30980 existing records. [2025-10-02T17:01:53.878178] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-02T17:01:54.049908] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:54.050157] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-02T17:01:54.050208] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-02T17:01:54.051046] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-10-02T17:01:54.051108] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-02T17:01:54.460254] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:54.521753] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-02T17:01:54.673011] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-02T17:01:55.305408] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-02T17:01:55.472990] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-02T17:01:55.525440] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T17:01:56.273002] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-02T17:01:56.717287] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-02T17:01:56.719552] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-02T17:01:56.719705] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-02T17:01:57.078754] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-10-02T17:01:57.210950] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-02T17:01:57.211172] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-02T17:01:57.212486] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-02T17:01:57.212772] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-02T17:01:57.215855] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54208 (keeping 200 days of data) [2025-10-02T17:01:57.251466] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T17:01:57.660802] [DEBUG] [LOCAL ] ACHR: Primary data saved (54208 records). [2025-10-02T17:01:57.660985] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-02T17:01:57.661093] [INFO ] [MAIN ] Update Progress: 20/2370 symbols completed. ACHR took 38.3s. Estimated remaining: 3h 42m 57s. Rate: 10.5 symbols/min [2025-10-02T17:01:57.873899] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-02T17:01:57.915609] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:01:57.892368] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T17:01:57.936526] [DEBUG] [LOCAL ] ACR: Loaded 5949 existing records from primary storage. [2025-10-02T17:01:57.936796] [INFO ] [MAIN ] ACR: Loaded 5949 existing records. [2025-10-02T17:01:58.178734] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:01:58.178996] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-02T17:01:58.179057] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-02T17:01:58.179410] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-10-02T17:01:58.179475] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-02T17:01:58.597509] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:01:58.655724] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T17:01:58.672988] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-02T17:01:59.408931] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T17:01:59.473006] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-10-02T17:02:00.056560] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T17:02:00.190691] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-02T17:02:00.273000] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-02T17:02:01.073358] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-02T17:02:01.074195] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T17:02:01.872979] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-02T17:02:02.330432] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T17:02:02.454361] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-02T17:02:02.673050] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-02T17:02:03.473115] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-02T17:02:03.503074] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T17:02:04.273086] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-02T17:02:04.855172] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T17:02:04.874118] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T17:02:05.073052] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-02T17:02:05.873018] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-02T17:02:06.675214] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-02T17:02:06.681120] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T17:02:07.473054] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-02T17:02:07.847889] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-02T17:02:08.034190] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T17:02:08.273041] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-02T17:02:08.988712] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T17:02:09.073047] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-02T17:02:09.129736] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T17:02:09.873022] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-02T17:02:10.524173] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:02:10.673047] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-02T17:02:11.374228] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T17:02:11.376237] [INFO ] [REMOTE ] ACM: Full fetch complete (62797 records). [2025-10-02T17:02:11.376350] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-02T17:02:11.478204] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-02T17:02:11.827733] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-10-02T17:02:11.827833] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-10-02T17:02:11.828528] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-10-02T17:02:11.828599] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-10-02T17:02:11.829984] [DEBUG] [LOCAL ] ACM: Trimmed 62797 records to 43361 (keeping 200 days of data) [2025-10-02T17:02:12.118439] [DEBUG] [LOCAL ] ACM: Primary data saved (43361 records). [2025-10-02T17:02:12.118578] [INFO ] [MAIN ] ACM: Full history saved. [2025-10-02T17:02:12.120791] [INFO ] [MAIN ] Update Progress: 21/2370 symbols completed. ACM took 41.7s. Estimated remaining: 3h 59m 12s. Rate: 9.8 symbols/min [2025-10-02T17:02:12.282016] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-02T17:02:12.319763] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:12.359267] [DEBUG] [LOCAL ] ACRE: Loaded 33578 existing records from primary storage. [2025-10-02T17:02:12.359720] [INFO ] [MAIN ] ACRE: Loaded 33578 existing records. [2025-10-02T17:02:12.481624] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T17:02:12.578704] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:02:12.579036] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-02T17:02:12.579147] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-02T17:02:12.579828] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-02T17:02:12.579892] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-02T17:02:12.987903] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:13.020721] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-02T17:02:13.073003] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-02T17:02:13.179025] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T17:02:13.873028] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-02T17:02:14.603779] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T17:02:14.672975] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-02T17:02:14.990982] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T17:02:15.244580] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T17:02:15.473047] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-02T17:02:16.273005] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-02T17:02:16.698049] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-02T17:02:17.073022] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-02T17:02:17.365694] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T17:02:17.873055] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-02T17:02:18.323400] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T17:02:18.673061] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-02T17:02:19.177723] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T17:02:19.178725] [INFO ] [REMOTE ] ACR: Full fetch complete (8616 records). [2025-10-02T17:02:19.178805] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-02T17:02:19.474692] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-10-02T17:02:19.511838] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-02T17:02:19.581706] [INFO ] [REMOTE ] ACN: Full fetch complete (77126 records). [2025-10-02T17:02:19.609837] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-02T17:02:19.610120] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-02T17:02:19.610243] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-02T17:02:19.610633] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-02T17:02:19.645298] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-02T17:02:19.698574] [DEBUG] [LOCAL ] ACR: Trimmed 8616 records to 5990 (keeping 200 days of data) [2025-10-02T17:02:20.005095] [DEBUG] [LOCAL ] ACR: Primary data saved (5990 records). [2025-10-02T17:02:20.020835] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-02T17:02:20.026091] [INFO ] [MAIN ] Update Progress: 22/2370 symbols completed. ACR took 22.4s. Estimated remaining: 4h 2m 17s. Rate: 9.7 symbols/min [2025-10-02T17:02:20.225087] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-10-02T17:02:20.230634] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-10-02T17:02:20.236789] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-10-02T17:02:20.247159] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-10-02T17:02:20.277531] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-02T17:02:20.306579] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:20.307114] [DEBUG] [LOCAL ] ACV: No existing data file found in primary storage. [2025-10-02T17:02:20.307235] [WARN ] [MAIN ] ACV: No existing data found, performing full refresh instead. [2025-10-02T17:02:20.308423] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-02T17:02:20.308604] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-02T17:02:20.308698] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-10-02T17:02:20.308748] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-02T17:02:20.314054] [DEBUG] [LOCAL ] ACN: Trimmed 77126 records to 53816 (keeping 200 days of data) [2025-10-02T17:02:20.889984] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:21.031704] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T17:02:21.103592] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-10-02T17:02:21.160803] [DEBUG] [LOCAL ] ACN: Primary data saved (53816 records). [2025-10-02T17:02:21.160956] [INFO ] [MAIN ] ACN: Full history saved. [2025-10-02T17:02:21.161042] [INFO ] [MAIN ] Update Progress: 23/2370 symbols completed. ACN took 40.1s. Estimated remaining: 3h 53m 35s. Rate: 10.0 symbols/min [2025-10-02T17:02:21.356978] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:21.404330] [DEBUG] [LOCAL ] ACVA: Loaded 49250 existing records from primary storage. [2025-10-02T17:02:21.404701] [INFO ] [MAIN ] ACVA: Loaded 49250 existing records. [2025-10-02T17:02:21.611581] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:02:21.612081] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-02T17:02:21.612161] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-02T17:02:21.612816] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-02T17:02:21.612884] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-02T17:02:21.890582] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-02T17:02:22.013422] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-02T17:02:22.015564] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T17:02:22.116145] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:22.673021] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-10-02T17:02:23.291289] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:02:23.473036] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-02T17:02:24.015566] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T17:02:24.273017] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-02T17:02:25.045098] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T17:02:25.073086] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-02T17:02:25.162906] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T17:02:25.873053] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-02T17:02:26.600512] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:02:26.612714] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-02T17:02:26.673014] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-02T17:02:27.473055] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-02T17:02:27.980229] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T17:02:28.273055] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-02T17:02:28.859293] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T17:02:29.073019] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-02T17:02:29.140184] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:02:29.793361] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T17:02:29.873053] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-02T17:02:30.673018] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-02T17:02:30.933493] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T17:02:30.935476] [INFO ] [REMOTE ] ACP: Full fetch complete (47352 records). [2025-10-02T17:02:30.935564] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-02T17:02:31.330683] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-02T17:02:31.404548] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-02T17:02:31.404635] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-02T17:02:31.405159] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-02T17:02:31.405209] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-02T17:02:31.406216] [DEBUG] [LOCAL ] ACP: Trimmed 47352 records to 31272 (keeping 200 days of data) [2025-10-02T17:02:31.473202] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-02T17:02:31.609091] [DEBUG] [LOCAL ] ACP: Primary data saved (31272 records). [2025-10-02T17:02:31.609241] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-02T17:02:31.609328] [INFO ] [MAIN ] Update Progress: 24/2370 symbols completed. ACP took 38.0s. Estimated remaining: 4h 0m 47s. Rate: 9.7 symbols/min [2025-10-02T17:02:31.802947] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:31.803156] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-02T17:02:31.803208] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-02T17:02:31.803343] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-02T17:02:31.803435] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-02T17:02:31.803490] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-02T17:02:31.803528] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-02T17:02:32.227034] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:32.273026] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-02T17:02:32.924112] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:02:33.073035] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-10-02T17:02:33.258892] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:02:33.259197] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-10-02T17:02:33.259273] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:02:33.259317] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-02T17:02:33.259401] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:02:33.259481] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-02T17:02:33.259552] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-02T17:02:33.259598] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-02T17:02:33.259714] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-02T17:02:33.259785] [INFO ] [MAIN ] Update Progress: 25/2370 symbols completed. AD took 1.7s. Estimated remaining: 3h 53m 38s. Rate: 10.0 symbols/min [2025-10-02T17:02:33.449246] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:33.499950] [DEBUG] [LOCAL ] ADC: Loaded 46164 existing records from primary storage. [2025-10-02T17:02:33.500285] [INFO ] [MAIN ] ADC: Loaded 46164 existing records. [2025-10-02T17:02:33.716594] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:02:33.716954] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-02T17:02:33.717038] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-02T17:02:33.717788] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-02T17:02:33.717857] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-02T17:02:33.878464] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-02T17:02:33.951729] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T17:02:34.149717] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:34.673007] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-02T17:02:34.885848] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T17:02:35.378801] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-02T17:02:35.473010] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-10-02T17:02:36.273037] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-02T17:02:36.726125] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T17:02:37.019254] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T17:02:37.072992] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-02T17:02:37.873021] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-02T17:02:38.672998] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-02T17:02:38.708360] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T17:02:39.127601] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T17:02:39.473010] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-02T17:02:39.941621] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T17:02:40.099941] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T17:02:40.273047] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-02T17:02:40.788241] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T17:02:41.073010] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-02T17:02:41.872986] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-02T17:02:41.889208] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-02T17:02:42.672998] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-02T17:02:43.473002] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-02T17:02:43.537760] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T17:02:44.267672] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T17:02:44.276361] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-02T17:02:44.925376] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T17:02:45.073026] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-02T17:02:45.643788] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T17:02:45.873037] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-02T17:02:46.621892] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T17:02:46.673014] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-02T17:02:46.684706] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T17:02:46.685986] [INFO ] [REMOTE ] ACV: Full fetch complete (10066 records). [2025-10-02T17:02:46.686079] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-02T17:02:47.084079] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-02T17:02:47.084161] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-02T17:02:47.084373] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-02T17:02:47.084414] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-02T17:02:47.084930] [DEBUG] [LOCAL ] ACV: Trimmed 10066 records to 7383 (keeping 200 days of data) [2025-10-02T17:02:47.133279] [DEBUG] [LOCAL ] ACV: Primary data saved (7383 records). [2025-10-02T17:02:47.133468] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-02T17:02:47.133558] [INFO ] [MAIN ] Update Progress: 26/2370 symbols completed. ACV took 27.1s. Estimated remaining: 4h 5m 24s. Rate: 9.6 symbols/min [2025-10-02T17:02:47.325572] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:47.365015] [DEBUG] [LOCAL ] ADCT: Loaded 34581 existing records from primary storage. [2025-10-02T17:02:47.365333] [INFO ] [MAIN ] ADCT: Loaded 34581 existing records. [2025-10-02T17:02:47.479015] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-02T17:02:47.586475] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:02:47.586753] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-02T17:02:47.586834] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-02T17:02:47.587758] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-02T17:02:47.587819] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-02T17:02:47.985806] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:48.239523] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T17:02:48.273004] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-02T17:02:48.842066] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T17:02:49.073003] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-02T17:02:49.873026] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-02T17:02:50.166671] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T17:02:50.278545] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T17:02:50.282467] [INFO ] [REMOTE ] ACRE: Full fetch complete (50758 records). [2025-10-02T17:02:50.282586] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-02T17:02:50.689535] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-10-02T17:02:50.752974] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-02T17:02:50.753124] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-02T17:02:50.753775] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-02T17:02:50.753851] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-02T17:02:50.755191] [DEBUG] [LOCAL ] ACRE: Trimmed 50758 records to 33897 (keeping 200 days of data) [2025-10-02T17:02:50.962391] [DEBUG] [LOCAL ] ACRE: Primary data saved (33897 records). [2025-10-02T17:02:50.962541] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-02T17:02:50.962629] [INFO ] [MAIN ] Update Progress: 27/2370 symbols completed. ACRE took 38.8s. Estimated remaining: 4h 1m 45s. Rate: 9.7 symbols/min [2025-10-02T17:02:51.171516] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:02:51.229403] [DEBUG] [LOCAL ] ADM: Loaded 53394 existing records from primary storage. [2025-10-02T17:02:51.229879] [INFO ] [MAIN ] ADM: Loaded 53394 existing records. [2025-10-02T17:02:51.446240] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:02:51.446554] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-02T17:02:51.446633] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-02T17:02:51.447507] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-02T17:02:51.447571] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-02T17:02:51.472994] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-02T17:02:51.880844] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:02:51.910632] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T17:02:52.111925] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:02:52.272998] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-02T17:02:53.024808] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T17:02:53.073147] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-10-02T17:02:53.604044] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T17:02:53.873048] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-02T17:02:54.672998] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-02T17:02:54.891490] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T17:02:54.976617] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T17:02:55.473007] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-02T17:02:56.192163] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T17:02:56.273034] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-02T17:02:56.319726] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T17:02:57.073051] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-02T17:02:57.873078] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-02T17:02:57.937956] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T17:02:58.474847] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:02:58.673053] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-02T17:02:59.438704] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-02T17:02:59.473020] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-02T17:02:59.923614] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T17:03:00.273078] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-02T17:03:01.012475] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-02T17:03:01.014792] [INFO ] [REMOTE ] ACVA: Full fetch complete (70382 records). [2025-10-02T17:03:01.014923] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-02T17:03:01.078706] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-02T17:03:01.450836] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-02T17:03:01.450942] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-02T17:03:01.451752] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-02T17:03:01.451821] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-02T17:03:01.453535] [DEBUG] [LOCAL ] ACVA: Trimmed 70382 records to 49607 (keeping 200 days of data) [2025-10-02T17:03:01.775466] [DEBUG] [LOCAL ] ACVA: Primary data saved (49607 records). [2025-10-02T17:03:01.775710] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-02T17:03:01.777140] [INFO ] [MAIN ] Update Progress: 28/2370 symbols completed. ACVA took 40.6s. Estimated remaining: 4h 8m 5s. Rate: 9.4 symbols/min [2025-10-02T17:03:01.878350] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-02T17:03:01.983314] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:02.037423] [DEBUG] [LOCAL ] ADNT: Loaded 47202 existing records from primary storage. [2025-10-02T17:03:02.037877] [INFO ] [MAIN ] ADNT: Loaded 47202 existing records. [2025-10-02T17:03:02.264508] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:02.283067] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-02T17:03:02.283245] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-02T17:03:02.285306] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-10-02T17:03:02.285230] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-02T17:03:02.285573] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-02T17:03:02.681513] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-02T17:03:02.731257] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:02.767237] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T17:03:03.336301] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:03:03.473058] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-02T17:03:04.273074] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-10-02T17:03:04.787768] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-02T17:03:04.846134] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:03:05.073027] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-02T17:03:05.808028] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T17:03:05.872997] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-02T17:03:06.566239] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T17:03:06.673013] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-02T17:03:06.779536] [DEBUG] [REMOTE ] ADC: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-10-02T17:03:06.779908] [WARN ] [REMOTE ] ADC: No data returned for month 2025-10 [2025-10-02T17:03:06.779999] [FATAL] [REMOTE ] ADC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:03:06.780082] [FATAL] [MAIN ] ADC: Failed to fetch primary data. [2025-10-02T17:03:06.780198] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:03:06.780281] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-02T17:03:06.780370] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-10-02T17:03:06.780459] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-10-02T17:03:06.780909] [DEBUG] [LOCAL ] ADC: Deleted derivative data file. [2025-10-02T17:03:06.782765] [INFO ] [MAIN ] Update Progress: 29/2370 symbols completed. ADC took 33.5s. Estimated remaining: 4h 6m 10s. Rate: 9.5 symbols/min [2025-10-02T17:03:06.987274] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:07.046431] [DEBUG] [LOCAL ] ADT: Loaded 53455 existing records from primary storage. [2025-10-02T17:03:07.046859] [INFO ] [MAIN ] ADT: Loaded 53455 existing records. [2025-10-02T17:03:07.263016] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:07.270580] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-02T17:03:07.271408] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T17:03:07.271491] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-02T17:03:07.281365] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-02T17:03:07.281449] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-02T17:03:07.478173] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-02T17:03:07.682937] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:08.273023] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-02T17:03:09.057720] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T17:03:09.072983] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-02T17:03:09.505217] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T17:03:09.873044] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-02T17:03:10.568736] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T17:03:10.673044] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-10-02T17:03:11.219785] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T17:03:11.473049] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-02T17:03:12.273016] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-02T17:03:12.431270] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T17:03:12.550817] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T17:03:13.073062] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-02T17:03:13.873003] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-02T17:03:14.005676] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T17:03:14.583973] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T17:03:14.673057] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-02T17:03:15.406063] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T17:03:15.472986] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-02T17:03:16.181190] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T17:03:16.273004] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-02T17:03:17.012568] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T17:03:17.073031] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-02T17:03:17.872988] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-02T17:03:18.149581] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T17:03:18.170487] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T17:03:18.172247] [INFO ] [REMOTE ] ADCT: Full fetch complete (51432 records). [2025-10-02T17:03:18.172347] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-02T17:03:18.606415] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-02T17:03:18.606509] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-02T17:03:18.607128] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-02T17:03:18.607194] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-02T17:03:18.608510] [DEBUG] [LOCAL ] ADCT: Trimmed 51432 records to 34861 (keeping 200 days of data) [2025-10-02T17:03:18.694775] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-02T17:03:18.822311] [DEBUG] [LOCAL ] ADCT: Primary data saved (34861 records). [2025-10-02T17:03:18.822463] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-02T17:03:18.827137] [INFO ] [MAIN ] Update Progress: 30/2370 symbols completed. ADCT took 31.7s. Estimated remaining: 4h 13m 31s. Rate: 9.2 symbols/min [2025-10-02T17:03:19.015281] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:19.044841] [DEBUG] [LOCAL ] ADX: Loaded 27468 existing records from primary storage. [2025-10-02T17:03:19.045117] [INFO ] [MAIN ] ADX: Loaded 27468 existing records. [2025-10-02T17:03:19.252335] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:19.252729] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-02T17:03:19.252809] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-02T17:03:19.253682] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-02T17:03:19.253793] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-02T17:03:19.476704] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-02T17:03:19.478470] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T17:03:19.740486] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:20.244445] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T17:03:20.272979] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-02T17:03:21.073023] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-02T17:03:21.357719] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T17:03:21.810620] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T17:03:21.873065] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-02T17:03:22.661672] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T17:03:22.673147] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-02T17:03:23.422112] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T17:03:23.473003] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-10-02T17:03:24.273049] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-02T17:03:24.456440] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T17:03:24.562102] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T17:03:25.073001] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-02T17:03:25.873059] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-02T17:03:26.170267] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T17:03:26.376679] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T17:03:26.672993] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-02T17:03:27.344824] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T17:03:27.473008] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-02T17:03:27.650317] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T17:03:28.273041] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-02T17:03:29.071798] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:03:29.081020] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-02T17:03:29.873027] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-02T17:03:29.973233] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T17:03:30.295339] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T17:03:30.673045] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-02T17:03:31.286777] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-02T17:03:31.473015] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-02T17:03:32.273050] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-02T17:03:32.677813] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-02T17:03:32.821248] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T17:03:32.823451] [INFO ] [REMOTE ] ADNT: Full fetch complete (67932 records). [2025-10-02T17:03:32.823680] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-02T17:03:33.081486] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-02T17:03:33.279430] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-02T17:03:33.279556] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-02T17:03:33.280558] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-02T17:03:33.280671] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-02T17:03:33.282470] [DEBUG] [LOCAL ] ADNT: Trimmed 67932 records to 47495 (keeping 200 days of data) [2025-10-02T17:03:33.619317] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T17:03:33.636769] [DEBUG] [LOCAL ] ADNT: Primary data saved (47495 records). [2025-10-02T17:03:33.636872] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-02T17:03:33.638334] [INFO ] [MAIN ] Update Progress: 31/2370 symbols completed. ADNT took 31.9s. Estimated remaining: 4h 23m 52s. Rate: 8.9 symbols/min [2025-10-02T17:03:33.818899] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:33.874539] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-02T17:03:33.876711] [DEBUG] [LOCAL ] AEE: Loaded 50091 existing records from primary storage. [2025-10-02T17:03:33.877099] [INFO ] [MAIN ] AEE: Loaded 50091 existing records. [2025-10-02T17:03:34.075424] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:34.075735] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-02T17:03:34.075804] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-02T17:03:34.077661] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-02T17:03:34.077748] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-02T17:03:34.472179] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:34.673044] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-02T17:03:34.760202] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T17:03:34.765671] [INFO ] [REMOTE ] ADM: Full fetch complete (77240 records). [2025-10-02T17:03:34.765833] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-02T17:03:35.288528] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-02T17:03:35.288758] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-02T17:03:35.295270] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-02T17:03:35.305934] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-02T17:03:35.307600] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T17:03:35.314548] [DEBUG] [LOCAL ] ADM: Trimmed 77240 records to 53777 (keeping 200 days of data) [2025-10-02T17:03:35.520962] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-10-02T17:03:35.681896] [DEBUG] [LOCAL ] ADM: Primary data saved (53777 records). [2025-10-02T17:03:35.682045] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-02T17:03:35.682131] [INFO ] [MAIN ] Update Progress: 32/2370 symbols completed. ADM took 44.7s. Estimated remaining: 4h 17m 60s. Rate: 9.1 symbols/min [2025-10-02T17:03:35.864462] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:35.875912] [DEBUG] [LOCAL ] AEFC: Loaded 8514 existing records from primary storage. [2025-10-02T17:03:35.876136] [INFO ] [MAIN ] AEFC: Loaded 8514 existing records. [2025-10-02T17:03:36.078509] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:36.078844] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-02T17:03:36.078914] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-02T17:03:36.079171] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-10-02T17:03:36.079244] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-02T17:03:36.280682] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-02T17:03:36.487382] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:36.582414] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T17:03:37.072995] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-10-02T17:03:37.290967] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T17:03:37.707260] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T17:03:37.727591] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T17:03:37.873029] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-02T17:03:38.673042] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-02T17:03:39.037670] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T17:03:39.473027] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-02T17:03:40.272989] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-02T17:03:40.341138] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T17:03:40.828415] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T17:03:41.072996] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-02T17:03:41.560279] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T17:03:41.872995] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-02T17:03:42.594836] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-02T17:03:42.673028] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-02T17:03:42.708365] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T17:03:43.396769] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T17:03:43.473048] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-02T17:03:44.273006] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-02T17:03:44.975583] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T17:03:44.977693] [INFO ] [REMOTE ] ADT: Full fetch complete (77195 records). [2025-10-02T17:03:44.977841] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-02T17:03:45.078181] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-02T17:03:45.465232] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-10-02T17:03:45.465386] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-10-02T17:03:45.466704] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-10-02T17:03:45.466782] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-10-02T17:03:45.468769] [DEBUG] [LOCAL ] ADT: Trimmed 77195 records to 53842 (keeping 200 days of data) [2025-10-02T17:03:45.747751] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T17:03:45.874165] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-02T17:03:45.892195] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T17:03:45.924141] [DEBUG] [LOCAL ] ADT: Primary data saved (53842 records). [2025-10-02T17:03:45.924637] [INFO ] [MAIN ] ADT: Full history saved. [2025-10-02T17:03:45.926013] [INFO ] [MAIN ] Update Progress: 33/2370 symbols completed. ADT took 39.1s. Estimated remaining: 4h 22m 10s. Rate: 8.9 symbols/min [2025-10-02T17:03:46.117223] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:46.169591] [DEBUG] [LOCAL ] AEG: Loaded 49557 existing records from primary storage. [2025-10-02T17:03:46.169967] [INFO ] [MAIN ] AEG: Loaded 49557 existing records. [2025-10-02T17:03:46.368473] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:46.368755] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-02T17:03:46.368810] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-02T17:03:46.369754] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-02T17:03:46.369822] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-02T17:03:46.678099] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-02T17:03:46.785083] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:47.148849] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T17:03:47.473005] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-10-02T17:03:48.273005] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-02T17:03:48.368869] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T17:03:49.073310] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-02T17:03:49.206443] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T17:03:49.291860] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T17:03:49.873013] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-02T17:03:50.563531] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T17:03:50.672995] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-02T17:03:50.985615] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:03:51.473019] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-02T17:03:51.536664] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T17:03:52.273013] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-02T17:03:53.053804] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:03:53.072981] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-02T17:03:53.872992] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-02T17:03:54.052052] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T17:03:54.589615] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T17:03:54.672970] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-02T17:03:54.801620] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:03:55.218173] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-02T17:03:55.473036] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-02T17:03:56.229691] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-02T17:03:56.273039] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-02T17:03:57.073019] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-02T17:03:57.608736] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T17:03:57.873008] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-02T17:03:58.075970] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T17:03:58.078400] [INFO ] [REMOTE ] ADX: Full fetch complete (42041 records). [2025-10-02T17:03:58.078516] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-02T17:03:58.534515] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-10-02T17:03:58.534695] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-10-02T17:03:58.535245] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-10-02T17:03:58.535319] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-10-02T17:03:58.536773] [DEBUG] [LOCAL ] ADX: Trimmed 42041 records to 27720 (keeping 200 days of data) [2025-10-02T17:03:58.675706] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-02T17:03:58.741576] [DEBUG] [LOCAL ] ADX: Primary data saved (27720 records). [2025-10-02T17:03:58.741760] [INFO ] [MAIN ] ADX: Full history saved. [2025-10-02T17:03:58.741903] [INFO ] [MAIN ] Update Progress: 34/2370 symbols completed. ADX took 39.9s. Estimated remaining: 4h 29m 1s. Rate: 8.7 symbols/min [2025-10-02T17:03:58.954826] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:03:59.021323] [DEBUG] [LOCAL ] AEM: Loaded 53463 existing records from primary storage. [2025-10-02T17:03:59.021799] [INFO ] [MAIN ] AEM: Loaded 53463 existing records. [2025-10-02T17:03:59.237051] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:03:59.237325] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-02T17:03:59.237383] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-02T17:03:59.238681] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-02T17:03:59.238748] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-02T17:03:59.478221] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-02T17:03:59.670703] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:03:59.703500] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T17:04:00.190759] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T17:04:00.273007] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-02T17:04:00.573632] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T17:04:01.073013] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-02T17:04:01.872994] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-10-02T17:04:01.955596] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:04:01.959533] [INFO ] [REMOTE ] AEFC: Full fetch complete (12125 records). [2025-10-02T17:04:01.959374] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T17:04:01.959866] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-02T17:04:02.396985] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-02T17:04:02.397078] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-02T17:04:02.397335] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-02T17:04:02.397380] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-02T17:04:02.397965] [DEBUG] [LOCAL ] AEFC: Trimmed 12125 records to 8541 (keeping 200 days of data) [2025-10-02T17:04:02.455927] [DEBUG] [LOCAL ] AEFC: Primary data saved (8541 records). [2025-10-02T17:04:02.456070] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-02T17:04:02.456178] [INFO ] [MAIN ] Update Progress: 35/2370 symbols completed. AEFC took 26.8s. Estimated remaining: 4h 25m 21s. Rate: 8.8 symbols/min [2025-10-02T17:04:02.649776] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:02.682095] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-02T17:04:02.720699] [DEBUG] [LOCAL ] AEO: Loaded 53557 existing records from primary storage. [2025-10-02T17:04:02.721174] [INFO ] [MAIN ] AEO: Loaded 53557 existing records. [2025-10-02T17:04:02.948811] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:04:02.949052] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-02T17:04:02.949101] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-02T17:04:02.950149] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-02T17:04:02.950214] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-02T17:04:03.372104] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:03.478196] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-10-02T17:04:03.500084] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T17:04:04.273014] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-02T17:04:04.696614] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-02T17:04:05.073034] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-02T17:04:05.237200] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T17:04:05.873056] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-02T17:04:06.048349] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T17:04:06.678149] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-02T17:04:06.709269] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:04:07.473062] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-02T17:04:07.578006] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T17:04:08.273002] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-02T17:04:08.563451] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-10-02T17:04:08.881462] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T17:04:08.883687] [INFO ] [REMOTE ] AEE: Full fetch complete (72616 records). [2025-10-02T17:04:08.883863] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-02T17:04:09.079290] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-02T17:04:09.343332] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-02T17:04:09.343427] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-02T17:04:09.344248] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-02T17:04:09.344319] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-02T17:04:09.346038] [DEBUG] [LOCAL ] AEE: Trimmed 72616 records to 50446 (keeping 200 days of data) [2025-10-02T17:04:09.706346] [DEBUG] [LOCAL ] AEE: Primary data saved (50446 records). [2025-10-02T17:04:09.706543] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-02T17:04:09.706639] [INFO ] [MAIN ] Update Progress: 36/2370 symbols completed. AEE took 36.1s. Estimated remaining: 4h 25m 42s. Rate: 8.8 symbols/min [2025-10-02T17:04:09.883740] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-02T17:04:09.914279] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:09.971394] [DEBUG] [LOCAL ] AER: Loaded 48362 existing records from primary storage. [2025-10-02T17:04:09.971745] [INFO ] [MAIN ] AER: Loaded 48362 existing records. [2025-10-02T17:04:10.195783] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:04:10.210072] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-02T17:04:10.211697] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-02T17:04:10.210565] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-02T17:04:10.223879] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-02T17:04:10.224003] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-02T17:04:10.623931] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:10.673029] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-10-02T17:04:11.070633] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T17:04:11.473062] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-02T17:04:11.879697] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-02T17:04:12.273053] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-02T17:04:12.436034] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T17:04:13.073038] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-02T17:04:13.204864] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T17:04:13.873031] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-02T17:04:14.094213] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T17:04:14.673017] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-02T17:04:15.019802] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-02T17:04:15.472984] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-02T17:04:15.776725] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T17:04:16.273038] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-02T17:04:16.588444] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T17:04:17.073288] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-02T17:04:17.363444] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T17:04:17.873069] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-02T17:04:18.153828] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T17:04:18.419239] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T17:04:18.424381] [INFO ] [REMOTE ] AEG: Full fetch complete (70350 records). [2025-10-02T17:04:18.424565] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-02T17:04:18.682749] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-02T17:04:18.850039] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-02T17:04:18.850162] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-02T17:04:18.850937] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-02T17:04:18.851012] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-02T17:04:18.852845] [DEBUG] [LOCAL ] AEG: Trimmed 70350 records to 49924 (keeping 200 days of data) [2025-10-02T17:04:19.178639] [DEBUG] [LOCAL ] AEG: Primary data saved (49924 records). [2025-10-02T17:04:19.178813] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-02T17:04:19.179864] [INFO ] [MAIN ] Update Progress: 37/2370 symbols completed. AEG took 33.3s. Estimated remaining: 4h 28m 22s. Rate: 8.7 symbols/min [2025-10-02T17:04:19.451796] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:04:19.473039] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-02T17:04:20.273048] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-02T17:04:20.942808] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-02T17:04:21.073047] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-02T17:04:21.398893] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-02T17:04:21.491418] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T17:04:21.872994] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-02T17:04:22.673085] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-02T17:04:23.143699] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-02T17:04:23.473053] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-02T17:04:23.539062] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T17:04:24.273015] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-02T17:04:24.497912] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T17:04:25.073048] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-02T17:04:25.619617] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-02T17:04:25.873159] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-02T17:04:26.241631] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-02T17:04:26.524344] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T17:04:26.673036] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-02T17:04:27.473150] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-02T17:04:27.853190] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T17:04:28.273054] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-02T17:04:28.441440] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T17:04:29.073071] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-02T17:04:29.804173] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-02T17:04:29.873032] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-02T17:04:30.076749] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:04:30.673014] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-02T17:04:30.747456] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T17:04:31.473083] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-02T17:04:31.648288] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-02T17:04:31.650714] [INFO ] [REMOTE ] AEO: Full fetch complete (77445 records). [2025-10-02T17:04:31.650850] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-02T17:04:32.059536] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-02T17:04:32.059678] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-02T17:04:32.060725] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-02T17:04:32.060797] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-02T17:04:32.063085] [DEBUG] [LOCAL ] AEO: Trimmed 77445 records to 53947 (keeping 200 days of data) [2025-10-02T17:04:32.393756] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-02T17:04:32.403056] [INFO ] [REMOTE ] AEM: Full fetch complete (77160 records). [2025-10-02T17:04:32.406077] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-02T17:04:32.431993] [DEBUG] [LOCAL ] AEO: Primary data saved (53947 records). [2025-10-02T17:04:32.446283] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-02T17:04:32.469385] [INFO ] [MAIN ] Update Progress: 38/2370 symbols completed. AEO took 30.0s. Estimated remaining: 4h 34m 47s. Rate: 8.5 symbols/min [2025-10-02T17:04:32.958708] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-02T17:04:32.958901] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-02T17:04:32.959851] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-02T17:04:32.959985] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-02T17:04:32.961788] [DEBUG] [LOCAL ] AEM: Trimmed 77160 records to 53853 (keeping 200 days of data) [2025-10-02T17:04:33.304606] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T17:04:33.342433] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-02T17:04:33.372884] [DEBUG] [LOCAL ] AEM: Primary data saved (53853 records). [2025-10-02T17:04:33.373064] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-02T17:04:33.374722] [INFO ] [MAIN ] Update Progress: 39/2370 symbols completed. AEM took 34.6s. Estimated remaining: 4h 28m 31s. Rate: 8.7 symbols/min [2025-10-02T17:04:35.236760] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T17:04:35.247808] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-02T17:04:36.617995] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:04:36.632303] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-02T17:04:37.953458] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T17:04:37.955795] [INFO ] [REMOTE ] AER: Full fetch complete (69630 records). [2025-10-02T17:04:37.955966] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-02T17:04:38.381523] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-02T17:04:38.381621] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-02T17:04:38.382365] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-02T17:04:38.382455] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-02T17:04:38.383986] [DEBUG] [LOCAL ] AER: Trimmed 69630 records to 48702 (keeping 200 days of data) [2025-10-02T17:04:38.705187] [DEBUG] [LOCAL ] AER: Primary data saved (48702 records). [2025-10-02T17:04:38.705339] [INFO ] [MAIN ] AER: Full history saved. [2025-10-02T17:04:38.705424] [INFO ] [MAIN ] Update Progress: 40/2370 symbols completed. AER took 29.0s. Estimated remaining: 4h 26m 52s. Rate: 8.7 symbols/min [2025-10-02T17:04:39.445128] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:39.517114] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:39.521228] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:39.560347] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:39.561097] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-02T17:04:39.561247] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-02T17:04:39.561414] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-02T17:04:39.561580] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-02T17:04:39.561737] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-02T17:04:39.561788] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-02T17:04:39.698592] [DEBUG] [LOCAL ] AFB: Loaded 11341 existing records from primary storage. [2025-10-02T17:04:39.731360] [INFO ] [MAIN ] AFB: Loaded 11341 existing records. [2025-10-02T17:04:40.048017] [DEBUG] [LOCAL ] AESI: Loaded 49476 existing records from primary storage. [2025-10-02T17:04:40.156463] [DEBUG] [LOCAL ] AES: Loaded 53670 existing records from primary storage. [2025-10-02T17:04:40.161682] [INFO ] [MAIN ] AESI: Loaded 49476 existing records. [2025-10-02T17:04:40.183018] [INFO ] [MAIN ] AES: Loaded 53670 existing records. [2025-10-02T17:04:40.212671] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:04:40.235500] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-02T17:04:40.262820] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-02T17:04:40.413473] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-02T17:04:40.423609] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:40.434076] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-02T17:04:40.449937] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2024-12. [2025-10-02T17:04:40.733222] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:04:40.808812] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-02T17:04:40.850149] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:04:40.853638] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:04:40.859413] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-02T17:04:40.859590] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-02T17:04:40.868691] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-02T17:04:40.859295] [WARN ] [REMOTE ] AEXA: No data returned for month 2024-12 [2025-10-02T17:04:40.873056] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-02T17:04:40.872933] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:04:40.879242] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-02T17:04:40.907637] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-02T17:04:40.881211] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-02T17:04:40.935381] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:04:40.935299] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-02T17:04:40.956492] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-02T17:04:41.091776] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-02T17:04:41.207869] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-02T17:04:41.279598] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-02T17:04:41.337988] [INFO ] [MAIN ] Update Progress: 41/2370 symbols completed. AEXA took 2.6s. Estimated remaining: 4h 22m 45s. Rate: 8.9 symbols/min [2025-10-02T17:04:41.516366] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:41.604501] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-10-02T17:04:42.256003] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:04:42.393808] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:42.430887] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:42.431593] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-10-02T17:04:42.432860] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-10-02T17:04:42.472815] [DEBUG] [LOCAL ] AFG: Loaded 32410 existing records from primary storage. [2025-10-02T17:04:42.473226] [INFO ] [MAIN ] AFG: Loaded 32410 existing records. [2025-10-02T17:04:42.601622] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T17:04:42.620865] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-02T17:04:42.692004] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:04:42.692418] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-02T17:04:42.692530] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-02T17:04:42.693141] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-02T17:04:42.693216] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-02T17:04:43.117141] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:04:43.117503] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-10-02T17:04:43.461765] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-02T17:04:43.464946] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-02T17:04:43.991586] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T17:04:44.001417] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-02T17:04:44.432354] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-02T17:04:44.444267] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-02T17:04:44.465803] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-02T17:04:44.468820] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-02T17:04:44.535826] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:04:44.541549] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-02T17:04:45.146200] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T17:04:45.149912] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-02T17:04:45.420632] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-02T17:04:45.426563] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-02T17:04:45.617257] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T17:04:45.626700] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-02T17:04:46.184677] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T17:04:46.195592] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-02T17:04:46.217617] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T17:04:46.672986] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-02T17:04:46.823193] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T17:04:47.239518] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T17:04:47.276065] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-02T17:04:47.473016] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-02T17:04:47.825246] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T17:04:48.273017] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-02T17:04:48.864300] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T17:04:49.012450] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T17:04:49.073012] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-02T17:04:49.873006] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-02T17:04:50.673037] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-02T17:04:50.729986] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-02T17:04:50.991742] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T17:04:51.473052] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-02T17:04:52.131256] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:04:52.273042] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-02T17:04:53.072982] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-02T17:04:53.260394] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T17:04:53.390977] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T17:04:53.873037] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-02T17:04:54.603778] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:04:54.673005] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-02T17:04:55.473016] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-02T17:04:55.686770] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T17:04:55.924813] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T17:04:56.273025] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-02T17:04:56.951486] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T17:04:57.073027] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-02T17:04:57.847783] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T17:04:57.872966] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-02T17:04:57.881707] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T17:04:58.673006] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-02T17:04:58.827361] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T17:04:59.473034] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-02T17:04:59.994716] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T17:05:00.273039] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-02T17:05:00.311083] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T17:05:01.073052] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-02T17:05:01.873053] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-02T17:05:02.410707] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-02T17:05:02.436469] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T17:05:02.673041] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-02T17:05:03.473037] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-02T17:05:03.803072] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T17:05:04.024694] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T17:05:04.026008] [INFO ] [REMOTE ] AFB: Full fetch complete (16696 records). [2025-10-02T17:05:04.026146] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-02T17:05:04.278153] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-02T17:05:04.441556] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-02T17:05:04.441664] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-02T17:05:04.441987] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-02T17:05:04.442045] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-02T17:05:04.442879] [DEBUG] [LOCAL ] AFB: Trimmed 16696 records to 11470 (keeping 200 days of data) [2025-10-02T17:05:04.513776] [DEBUG] [LOCAL ] AFB: Primary data saved (11470 records). [2025-10-02T17:05:04.513921] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-02T17:05:04.514005] [INFO ] [MAIN ] Update Progress: 42/2370 symbols completed. AFB took 25.7s. Estimated remaining: 4h 37m 47s. Rate: 8.4 symbols/min [2025-10-02T17:05:04.700460] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:04.700638] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-10-02T17:05:04.700720] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-10-02T17:05:04.700911] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-02T17:05:04.700990] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-02T17:05:04.701063] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-02T17:05:04.701152] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-02T17:05:05.072982] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-02T17:05:05.108663] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:05.146365] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-02T17:05:05.873063] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-10-02T17:05:06.188221] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T17:05:06.223131] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T17:05:06.315417] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-02T17:05:06.673013] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-02T17:05:07.473059] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-02T17:05:07.942936] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T17:05:07.945979] [INFO ] [REMOTE ] AFG: Full fetch complete (46011 records). [2025-10-02T17:05:07.946067] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-02T17:05:08.278269] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-02T17:05:08.414089] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-02T17:05:08.414183] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-02T17:05:08.414729] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-02T17:05:08.414792] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-02T17:05:08.415954] [DEBUG] [LOCAL ] AFG: Trimmed 46011 records to 32624 (keeping 200 days of data) [2025-10-02T17:05:08.629021] [DEBUG] [LOCAL ] AFG: Primary data saved (32624 records). [2025-10-02T17:05:08.629163] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-02T17:05:08.630516] [INFO ] [MAIN ] Update Progress: 43/2370 symbols completed. AFG took 27.2s. Estimated remaining: 4h 34m 55s. Rate: 8.5 symbols/min [2025-10-02T17:05:08.826493] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:08.860682] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T17:05:08.863801] [DEBUG] [LOCAL ] AFGC: Loaded 2555 existing records from primary storage. [2025-10-02T17:05:08.874876] [INFO ] [MAIN ] AFGC: Loaded 2555 existing records. [2025-10-02T17:05:09.073230] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-02T17:05:09.077399] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:05:09.078738] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-02T17:05:09.078795] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-02T17:05:09.079091] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-02T17:05:09.079159] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-02T17:05:09.470492] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:09.873001] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-02T17:05:10.269260] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T17:05:10.385991] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-02T17:05:10.580955] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T17:05:10.583189] [INFO ] [REMOTE ] AESI: Full fetch complete (70477 records). [2025-10-02T17:05:10.583328] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-02T17:05:10.678192] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-02T17:05:11.020017] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-02T17:05:11.020133] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-02T17:05:11.020966] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-02T17:05:11.021044] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-02T17:05:11.022755] [DEBUG] [LOCAL ] AESI: Trimmed 70477 records to 49859 (keeping 200 days of data) [2025-10-02T17:05:11.146471] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-02T17:05:11.341132] [DEBUG] [LOCAL ] AESI: Primary data saved (49859 records). [2025-10-02T17:05:11.341276] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-02T17:05:11.341369] [INFO ] [MAIN ] Update Progress: 44/2370 symbols completed. AESI took 32.6s. Estimated remaining: 4h 30m 57s. Rate: 8.6 symbols/min [2025-10-02T17:05:11.485028] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-02T17:05:11.520881] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:11.521293] [DEBUG] [LOCAL ] AFGD: No existing data file found in primary storage. [2025-10-02T17:05:11.521352] [WARN ] [MAIN ] AFGD: No existing data found, performing full refresh instead. [2025-10-02T17:05:11.521469] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-02T17:05:11.521513] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-02T17:05:11.521558] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-02T17:05:11.521592] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-02T17:05:11.918046] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:12.121442] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T17:05:12.273000] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-02T17:05:12.902029] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T17:05:13.073003] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-02T17:05:13.333139] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-02T17:05:13.872995] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-10-02T17:05:14.477577] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-02T17:05:14.673027] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-02T17:05:15.472999] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-02T17:05:16.039096] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T17:05:16.273022] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-02T17:05:16.731289] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-02T17:05:16.768043] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-02T17:05:17.073010] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-02T17:05:17.534025] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-02T17:05:17.873001] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-02T17:05:18.673034] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-10-02T17:05:19.384042] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T17:05:19.473044] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-02T17:05:19.560385] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-02T17:05:19.562769] [INFO ] [REMOTE ] AES: Full fetch complete (77722 records). [2025-10-02T17:05:19.562929] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-02T17:05:19.918334] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-02T17:05:20.026391] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-02T17:05:20.026491] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-02T17:05:20.027327] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-02T17:05:20.027408] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-02T17:05:20.029432] [DEBUG] [LOCAL ] AES: Trimmed 77722 records to 54060 (keeping 200 days of data) [2025-10-02T17:05:20.273335] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-02T17:05:20.379428] [DEBUG] [LOCAL ] AES: Primary data saved (54060 records). [2025-10-02T17:05:20.379608] [INFO ] [MAIN ] AES: Full history saved. [2025-10-02T17:05:20.380926] [INFO ] [MAIN ] Update Progress: 45/2370 symbols completed. AES took 41.7s. Estimated remaining: 4h 32m 36s. Rate: 8.5 symbols/min [2025-10-02T17:05:20.581964] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:20.587358] [DEBUG] [LOCAL ] AFGE: Loaded 2457 existing records from primary storage. [2025-10-02T17:05:20.587564] [INFO ] [MAIN ] AFGE: Loaded 2457 existing records. [2025-10-02T17:05:20.786510] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:05:20.786780] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-02T17:05:20.786831] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-02T17:05:20.787118] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-02T17:05:20.787204] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-02T17:05:21.078629] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-02T17:05:21.147254] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T17:05:21.233566] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:21.560514] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T17:05:21.873018] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-02T17:05:22.341762] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-02T17:05:22.673065] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-02T17:05:23.140984] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T17:05:23.473000] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-10-02T17:05:23.945741] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-02T17:05:24.273041] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-02T17:05:24.789550] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T17:05:25.073005] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-02T17:05:25.432565] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-02T17:05:25.873007] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-02T17:05:26.346023] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T17:05:26.672999] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-02T17:05:27.134698] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T17:05:27.135401] [INFO ] [REMOTE ] AFGB: Full fetch complete (3679 records). [2025-10-02T17:05:27.135474] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-02T17:05:27.486368] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-02T17:05:27.534826] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-02T17:05:27.534912] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-02T17:05:27.535192] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-02T17:05:27.535253] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-02T17:05:27.535606] [DEBUG] [LOCAL ] AFGB: Trimmed 3679 records to 2357 (keeping 200 days of data) [2025-10-02T17:05:27.551598] [DEBUG] [LOCAL ] AFGB: Primary data saved (2357 records). [2025-10-02T17:05:27.551709] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-02T17:05:27.551819] [INFO ] [MAIN ] Update Progress: 46/2370 symbols completed. AFGB took 23.0s. Estimated remaining: 4h 32m 36s. Rate: 8.5 symbols/min [2025-10-02T17:05:27.739130] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:27.796855] [DEBUG] [LOCAL ] AFL: Loaded 53146 existing records from primary storage. [2025-10-02T17:05:27.797207] [INFO ] [MAIN ] AFL: Loaded 53146 existing records. [2025-10-02T17:05:27.997098] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:05:27.997315] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-02T17:05:27.997398] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-02T17:05:28.006190] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-02T17:05:28.006327] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-02T17:05:28.120091] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-02T17:05:28.278173] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-02T17:05:28.406098] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:28.711410] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T17:05:29.073001] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-02T17:05:29.352792] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-02T17:05:29.873004] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-02T17:05:30.491277] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T17:05:30.673007] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-02T17:05:31.143612] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-02T17:05:31.473001] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-02T17:05:32.178404] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T17:05:32.273000] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-02T17:05:32.629689] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-02T17:05:33.073013] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-02T17:05:33.534908] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-02T17:05:33.873015] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-02T17:05:34.320874] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T17:05:34.673012] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-10-02T17:05:35.473005] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-02T17:05:35.994838] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-02T17:05:36.272996] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-02T17:05:36.746965] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T17:05:36.833196] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-02T17:05:37.073004] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-02T17:05:37.873035] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-02T17:05:38.358454] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T17:05:38.673017] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-02T17:05:38.875870] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T17:05:39.139628] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-02T17:05:39.472993] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-02T17:05:39.928756] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-02T17:05:40.272998] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-02T17:05:40.717493] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T17:05:41.072996] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-02T17:05:41.547016] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T17:05:41.547755] [INFO ] [REMOTE ] AFGC: Full fetch complete (3736 records). [2025-10-02T17:05:41.547828] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-02T17:05:41.878089] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-02T17:05:41.945476] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-02T17:05:41.945601] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-02T17:05:41.945770] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-02T17:05:41.945831] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-02T17:05:41.946294] [DEBUG] [LOCAL ] AFGC: Trimmed 3736 records to 2561 (keeping 200 days of data) [2025-10-02T17:05:41.964405] [DEBUG] [LOCAL ] AFGC: Primary data saved (2561 records). [2025-10-02T17:05:41.964528] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-02T17:05:41.964689] [INFO ] [MAIN ] Update Progress: 47/2370 symbols completed. AFGC took 33.3s. Estimated remaining: 4h 38m 33s. Rate: 8.3 symbols/min [2025-10-02T17:05:42.148239] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:42.205041] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-02T17:05:42.205394] [INFO ] [MAIN ] AG: Loaded 53643 existing records. [2025-10-02T17:05:42.424255] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:05:42.424566] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-02T17:05:42.424618] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-02T17:05:42.425485] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-02T17:05:42.425551] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-02T17:05:42.549063] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T17:05:42.678663] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-02T17:05:42.832581] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:43.473005] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-10-02T17:05:44.272984] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-02T17:05:44.381229] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T17:05:44.810189] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-02T17:05:45.073040] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-02T17:05:45.589885] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-02T17:05:45.655883] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T17:05:45.873042] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-02T17:05:46.673025] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-02T17:05:47.081150] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-02T17:05:47.473043] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-02T17:05:47.874955] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-02T17:05:47.956877] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-02T17:05:48.272989] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-02T17:05:48.718934] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T17:05:48.719697] [INFO ] [REMOTE ] AFGD: Full fetch complete (3131 records). [2025-10-02T17:05:48.719837] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-02T17:05:49.079143] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-02T17:05:49.129510] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-10-02T17:05:49.129591] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-10-02T17:05:49.129777] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-10-02T17:05:49.129870] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-10-02T17:05:49.130258] [DEBUG] [LOCAL ] AFGD: Trimmed 3131 records to 1827 (keeping 200 days of data) [2025-10-02T17:05:49.142983] [DEBUG] [LOCAL ] AFGD: Primary data saved (1827 records). [2025-10-02T17:05:49.143319] [INFO ] [MAIN ] AFGD: Full history saved. [2025-10-02T17:05:49.143427] [INFO ] [MAIN ] Update Progress: 48/2370 symbols completed. AFGD took 37.8s. Estimated remaining: 4h 38m 25s. Rate: 8.3 symbols/min [2025-10-02T17:05:49.345195] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:49.404296] [DEBUG] [LOCAL ] AGCO: Loaded 42377 existing records from primary storage. [2025-10-02T17:05:49.404870] [INFO ] [MAIN ] AGCO: Loaded 42377 existing records. [2025-10-02T17:05:49.608716] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:05:49.612293] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-02T17:05:49.612105] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T17:05:49.613471] [INFO ] [REMOTE ] AFGE: Full fetch complete (3482 records). [2025-10-02T17:05:49.613588] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-02T17:05:49.613766] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-02T17:05:49.648680] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-02T17:05:49.675610] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-02T17:05:49.881244] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-02T17:05:50.465055] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-02T17:05:50.495397] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-02T17:05:50.525032] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-02T17:05:50.530567] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:50.531361] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-02T17:05:50.532128] [DEBUG] [LOCAL ] AFGE: Trimmed 3482 records to 2467 (keeping 200 days of data) [2025-10-02T17:05:50.554006] [DEBUG] [LOCAL ] AFGE: Primary data saved (2467 records). [2025-10-02T17:05:50.554175] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-02T17:05:50.554313] [INFO ] [MAIN ] Update Progress: 49/2370 symbols completed. AFGE took 30.2s. Estimated remaining: 4h 33m 44s. Rate: 8.5 symbols/min [2025-10-02T17:05:50.678210] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-10-02T17:05:50.826968] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:05:50.864382] [DEBUG] [LOCAL ] AGD: Loaded 18028 existing records from primary storage. [2025-10-02T17:05:50.864759] [INFO ] [MAIN ] AGD: Loaded 18028 existing records. [2025-10-02T17:05:51.137928] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:05:51.138230] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-02T17:05:51.138310] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-02T17:05:51.138607] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-02T17:05:51.138720] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-02T17:05:51.480417] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-02T17:05:51.633562] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:05:51.665778] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T17:05:52.272969] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-02T17:05:52.548133] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T17:05:53.072992] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-10-02T17:05:53.506775] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T17:05:53.883282] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-02T17:05:53.890803] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T17:05:54.053480] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T17:05:54.673001] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-02T17:05:55.383821] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:05:55.473017] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-02T17:05:56.273041] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-02T17:05:56.860932] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-02T17:05:56.933539] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:05:57.072971] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-02T17:05:57.481575] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T17:05:57.873052] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-02T17:05:58.672999] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-02T17:05:59.185076] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-02T17:05:59.226199] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T17:05:59.473053] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-02T17:06:00.091241] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T17:06:00.273037] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-02T17:06:00.348455] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T17:06:01.073042] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-02T17:06:01.873008] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-02T17:06:01.997053] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T17:06:02.271111] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T17:06:02.672994] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-02T17:06:03.473007] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-02T17:06:03.645365] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T17:06:04.272966] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-02T17:06:04.459856] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-02T17:06:04.569801] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T17:06:05.073005] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-02T17:06:05.872975] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-02T17:06:06.129718] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T17:06:06.360535] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T17:06:06.673039] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-02T17:06:07.472497] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T17:06:07.476278] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-02T17:06:08.273004] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-02T17:06:08.505237] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:06:08.754919] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-02T17:06:09.073085] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-02T17:06:09.404671] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:06:09.873038] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-02T17:06:10.673024] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-02T17:06:10.941637] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T17:06:11.178757] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T17:06:11.346293] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-02T17:06:11.473064] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-02T17:06:12.273001] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-02T17:06:13.072999] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-02T17:06:13.684795] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-02T17:06:13.872981] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-02T17:06:13.913379] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T17:06:13.990960] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T17:06:14.673052] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-02T17:06:15.473030] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-02T17:06:15.577495] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T17:06:15.705404] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T17:06:16.273019] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-02T17:06:17.073029] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-02T17:06:17.263830] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-02T17:06:17.265183] [INFO ] [REMOTE ] AGD: Full fetch complete (25564 records). [2025-10-02T17:06:17.265273] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-02T17:06:17.451540] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-02T17:06:17.486110] [INFO ] [REMOTE ] AG: Full fetch complete (77606 records). [2025-10-02T17:06:17.527768] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-02T17:06:17.883181] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-02T17:06:17.900975] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-02T17:06:17.975113] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-02T17:06:17.990584] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-02T17:06:18.036512] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-02T17:06:18.100589] [DEBUG] [LOCAL ] AGD: Trimmed 25564 records to 18158 (keeping 200 days of data) [2025-10-02T17:06:18.245063] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-02T17:06:18.245475] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-02T17:06:18.279425] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-02T17:06:18.280314] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-02T17:06:18.285393] [DEBUG] [LOCAL ] AG: Trimmed 77606 records to 54032 (keeping 200 days of data) [2025-10-02T17:06:18.408517] [DEBUG] [LOCAL ] AGD: Primary data saved (18158 records). [2025-10-02T17:06:18.412259] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-02T17:06:18.412416] [INFO ] [MAIN ] Update Progress: 50/2370 symbols completed. AGD took 27.9s. Estimated remaining: 4h 49m 41s. Rate: 8.0 symbols/min [2025-10-02T17:06:18.523681] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T17:06:18.656394] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:18.724972] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-02T17:06:18.836231] [DEBUG] [LOCAL ] AGI: Loaded 53416 existing records from primary storage. [2025-10-02T17:06:18.838573] [INFO ] [MAIN ] AGI: Loaded 53416 existing records. [2025-10-02T17:06:19.063267] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:06:19.067998] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-02T17:06:19.068197] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-02T17:06:19.105527] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-10-02T17:06:19.111621] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-02T17:06:19.587949] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:19.591576] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-10-02T17:06:19.598865] [DEBUG] [LOCAL ] AG: Primary data saved (54032 records). [2025-10-02T17:06:19.599049] [INFO ] [MAIN ] AG: Full history saved. [2025-10-02T17:06:19.601196] [INFO ] [MAIN ] Update Progress: 51/2370 symbols completed. AG took 37.6s. Estimated remaining: 4h 44m 47s. Rate: 8.1 symbols/min [2025-10-02T17:06:19.792959] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:19.831047] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T17:06:19.909184] [DEBUG] [LOCAL ] AGL: Loaded 52447 existing records from primary storage. [2025-10-02T17:06:19.909557] [INFO ] [MAIN ] AGL: Loaded 52447 existing records. [2025-10-02T17:06:20.115932] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:06:20.116285] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-02T17:06:20.116390] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-02T17:06:20.117577] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-10-02T17:06:20.117663] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-02T17:06:20.209266] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T17:06:20.274729] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-02T17:06:20.571616] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:21.072989] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-02T17:06:21.239342] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T17:06:21.604808] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T17:06:21.611409] [INFO ] [REMOTE ] AFL: Full fetch complete (76915 records). [2025-10-02T17:06:21.611717] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-02T17:06:21.878178] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-10-02T17:06:22.088858] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-02T17:06:22.088958] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-02T17:06:22.089726] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-02T17:06:22.089837] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-02T17:06:22.092273] [DEBUG] [LOCAL ] AFL: Trimmed 76915 records to 53536 (keeping 200 days of data) [2025-10-02T17:06:22.417773] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:06:22.443936] [INFO ] [REMOTE ] AGCO: Full fetch complete (61851 records). [2025-10-02T17:06:22.446772] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-02T17:06:22.594246] [DEBUG] [LOCAL ] AFL: Primary data saved (53536 records). [2025-10-02T17:06:22.599634] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-02T17:06:22.625116] [INFO ] [MAIN ] Update Progress: 52/2370 symbols completed. AFL took 55.1s. Estimated remaining: 4h 41m 26s. Rate: 8.2 symbols/min [2025-10-02T17:06:22.704201] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-02T17:06:23.058147] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:23.118453] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-02T17:06:23.121319] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-02T17:06:23.122099] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-02T17:06:23.122180] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-02T17:06:23.128871] [DEBUG] [LOCAL ] AGM: Loaded 10179 existing records from primary storage. [2025-10-02T17:06:23.128453] [DEBUG] [LOCAL ] AGCO: Trimmed 61851 records to 42677 (keeping 200 days of data) [2025-10-02T17:06:23.129297] [INFO ] [MAIN ] AGM: Loaded 10179 existing records. [2025-10-02T17:06:23.476884] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:06:23.587448] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-02T17:06:23.599249] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-02T17:06:23.600835] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-02T17:06:23.601853] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-02T17:06:23.720693] [DEBUG] [LOCAL ] AGCO: Primary data saved (42677 records). [2025-10-02T17:06:23.778699] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-02T17:06:23.802833] [INFO ] [MAIN ] Update Progress: 53/2370 symbols completed. AGCO took 34.7s. Estimated remaining: 4h 36m 52s. Rate: 8.4 symbols/min [2025-10-02T17:06:23.810049] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T17:06:23.941045] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-02T17:06:24.228199] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:24.308888] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:24.309896] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-10-02T17:06:24.353674] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T17:06:24.373910] [DEBUG] [LOCAL ] AGO: Loaded 27914 existing records from primary storage. [2025-10-02T17:06:24.374175] [INFO ] [MAIN ] AGO: Loaded 27914 existing records. [2025-10-02T17:06:24.574208] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:06:24.574450] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-02T17:06:24.574575] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-02T17:06:24.575670] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-02T17:06:24.575733] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-02T17:06:24.963318] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:25.073071] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-02T17:06:25.111487] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T17:06:25.873014] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-02T17:06:25.926680] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-02T17:06:26.501301] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T17:06:26.573170] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T17:06:26.673030] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-10-02T17:06:27.473012] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-02T17:06:27.956014] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T17:06:27.986164] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-02T17:06:28.273002] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-02T17:06:28.865218] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T17:06:29.073029] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-02T17:06:29.872998] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-02T17:06:30.673007] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-02T17:06:30.960680] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T17:06:31.276615] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T17:06:31.473001] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-02T17:06:31.618621] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T17:06:32.273002] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-02T17:06:33.036445] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-02T17:06:33.072957] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-02T17:06:33.326677] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T17:06:33.620578] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-02T17:06:33.872993] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-02T17:06:34.673028] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-02T17:06:34.945083] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T17:06:35.473008] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-02T17:06:36.273008] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-02T17:06:36.500335] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:06:36.680512] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-02T17:06:37.073016] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-02T17:06:37.763739] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T17:06:37.882146] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-02T17:06:37.903904] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T17:06:38.672991] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-02T17:06:39.235105] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T17:06:39.473004] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-02T17:06:40.272980] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-02T17:06:40.562623] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-02T17:06:40.972924] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T17:06:41.073046] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-02T17:06:41.873042] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-02T17:06:41.943479] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:06:42.673048] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-02T17:06:42.987666] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T17:06:43.104781] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T17:06:43.473075] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-02T17:06:44.272988] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-02T17:06:44.524615] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T17:06:45.023493] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T17:06:45.073015] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-02T17:06:45.140828] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T17:06:45.873046] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-02T17:06:46.206769] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T17:06:46.673006] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-02T17:06:47.473015] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-02T17:06:47.793747] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T17:06:48.065252] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T17:06:48.188326] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T17:06:48.273004] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-02T17:06:48.994351] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T17:06:48.995625] [INFO ] [REMOTE ] AGM: Full fetch complete (12835 records). [2025-10-02T17:06:48.995734] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-02T17:06:49.078204] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-02T17:06:49.436193] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-02T17:06:49.436335] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-02T17:06:49.436672] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-02T17:06:49.436739] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-02T17:06:49.437230] [DEBUG] [LOCAL ] AGM: Trimmed 12835 records to 10296 (keeping 200 days of data) [2025-10-02T17:06:49.502965] [DEBUG] [LOCAL ] AGM: Primary data saved (10296 records). [2025-10-02T17:06:49.503101] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-02T17:06:49.503183] [INFO ] [MAIN ] Update Progress: 54/2370 symbols completed. AGM took 26.9s. Estimated remaining: 4h 49m 60s. Rate: 8.0 symbols/min [2025-10-02T17:06:49.694466] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:49.695479] [DEBUG] [LOCAL ] AGRO: No existing data file found in primary storage. [2025-10-02T17:06:49.695537] [WARN ] [MAIN ] AGRO: No existing data found, performing full refresh instead. [2025-10-02T17:06:49.695760] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-02T17:06:49.695831] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-02T17:06:49.696053] [DEBUG] [LOCAL ] AGRO: No primary data file found to delete. [2025-10-02T17:06:49.696108] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-02T17:06:49.884897] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-02T17:06:50.093278] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:50.672994] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-10-02T17:06:50.898042] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T17:06:51.267905] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T17:06:51.473056] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-02T17:06:52.225753] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T17:06:52.272997] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-02T17:06:53.073014] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-02T17:06:53.270836] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:06:53.719147] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T17:06:53.720884] [INFO ] [REMOTE ] AGI: Full fetch complete (76421 records). [2025-10-02T17:06:53.721010] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-02T17:06:53.721923] [FATAL] [VALIDATOR ] AGI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:06:53.722024] [FATAL] [MAIN ] AGI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:06:53.722070] [WARN ] [MAIN ] AGI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:06:53.722142] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-02T17:06:53.722209] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-02T17:06:53.722248] [INFO ] [LOCAL ] AGI: Starting deletion of derivative data. [2025-10-02T17:06:53.722703] [DEBUG] [LOCAL ] AGI: Deleted derivative data file. [2025-10-02T17:06:53.722802] [INFO ] [MAIN ] Update Progress: 55/2370 symbols completed. AGI took 35.3s. Estimated remaining: 4h 47m 33s. Rate: 8.1 symbols/min [2025-10-02T17:06:53.884405] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-02T17:06:53.923914] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:53.964667] [DEBUG] [LOCAL ] AGX: Loaded 33195 existing records from primary storage. [2025-10-02T17:06:53.964968] [INFO ] [MAIN ] AGX: Loaded 33195 existing records. [2025-10-02T17:06:54.164271] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:06:54.164565] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-02T17:06:54.164706] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-02T17:06:54.167234] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-10-02T17:06:54.167300] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-02T17:06:54.587174] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T17:06:54.585963] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:54.672976] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-02T17:06:55.014141] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T17:06:55.473015] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-02T17:06:55.898888] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T17:06:56.273020] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-02T17:06:56.553585] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T17:06:56.555753] [INFO ] [REMOTE ] AGO: Full fetch complete (39419 records). [2025-10-02T17:06:56.555886] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-02T17:06:56.985876] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-02T17:06:56.985962] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-02T17:06:56.986412] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-02T17:06:56.986479] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-02T17:06:56.987537] [DEBUG] [LOCAL ] AGO: Trimmed 39419 records to 28176 (keeping 200 days of data) [2025-10-02T17:06:57.084382] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-10-02T17:06:57.174151] [DEBUG] [LOCAL ] AGO: Primary data saved (28176 records). [2025-10-02T17:06:57.174304] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-02T17:06:57.174399] [INFO ] [MAIN ] Update Progress: 56/2370 symbols completed. AGO took 33.3s. Estimated remaining: 4h 44m 41s. Rate: 8.1 symbols/min [2025-10-02T17:06:57.359128] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:06:57.397997] [DEBUG] [LOCAL ] AHH: Loaded 41122 existing records from primary storage. [2025-10-02T17:06:57.398572] [INFO ] [MAIN ] AHH: Loaded 41122 existing records. [2025-10-02T17:06:57.648728] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:06:57.649005] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-02T17:06:57.649075] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-02T17:06:57.658953] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-02T17:06:57.670409] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-02T17:06:57.740268] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T17:06:57.878741] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-02T17:06:58.078421] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:06:58.673001] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-10-02T17:06:58.711064] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T17:06:59.473008] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-02T17:06:59.917451] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-10-02T17:07:00.179834] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T17:07:00.273055] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-02T17:07:01.073011] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-02T17:07:01.290353] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T17:07:01.873021] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-02T17:07:02.069313] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:07:02.181069] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:07:02.672990] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-02T17:07:03.399386] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T17:07:03.473030] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-02T17:07:04.273011] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-02T17:07:04.444743] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T17:07:04.504314] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:07:05.073012] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-02T17:07:05.725245] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T17:07:05.727403] [INFO ] [REMOTE ] AGL: Full fetch complete (75522 records). [2025-10-02T17:07:05.727520] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-02T17:07:05.888002] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-02T17:07:06.180879] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-02T17:07:06.180972] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-02T17:07:06.181790] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-02T17:07:06.181861] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-02T17:07:06.183471] [DEBUG] [LOCAL ] AGL: Trimmed 75522 records to 52833 (keeping 200 days of data) [2025-10-02T17:07:06.501244] [DEBUG] [LOCAL ] AGL: Primary data saved (52833 records). [2025-10-02T17:07:06.501388] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-02T17:07:06.503054] [INFO ] [MAIN ] Update Progress: 57/2370 symbols completed. AGL took 46.9s. Estimated remaining: 4h 45m 52s. Rate: 8.1 symbols/min [2025-10-02T17:07:06.655710] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T17:07:06.682090] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-02T17:07:06.729464] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:06.729692] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-02T17:07:06.729747] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-02T17:07:06.729861] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-02T17:07:06.729908] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-02T17:07:06.729958] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-02T17:07:06.730002] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-02T17:07:07.125847] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:07.335054] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T17:07:07.473022] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-10-02T17:07:07.684176] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:07:07.684524] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-10-02T17:07:07.684677] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:07:07.684768] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-02T17:07:07.684859] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:07:07.684947] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-02T17:07:07.685023] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-02T17:07:07.685062] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-02T17:07:07.685103] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-02T17:07:07.685150] [INFO ] [MAIN ] Update Progress: 58/2370 symbols completed. AHL took 1.2s. Estimated remaining: 4h 41m 36s. Rate: 8.2 symbols/min [2025-10-02T17:07:07.900230] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:07.921946] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T17:07:07.978847] [DEBUG] [LOCAL ] AHR: Loaded 49165 existing records from primary storage. [2025-10-02T17:07:07.979197] [INFO ] [MAIN ] AHR: Loaded 49165 existing records. [2025-10-02T17:07:08.172793] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:07:08.173001] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-02T17:07:08.173050] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-02T17:07:08.174437] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-10-02T17:07:08.174501] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-02T17:07:08.278176] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-02T17:07:08.558270] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:09.073021] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-10-02T17:07:09.872987] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-02T17:07:09.978278] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T17:07:10.672987] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-02T17:07:10.790096] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T17:07:11.473018] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-02T17:07:11.674221] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T17:07:12.273009] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-02T17:07:12.405702] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T17:07:12.807606] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T17:07:13.073009] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-02T17:07:13.293625] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T17:07:13.873009] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-02T17:07:14.247575] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T17:07:14.673004] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-02T17:07:15.138843] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T17:07:15.472999] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-02T17:07:16.031385] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T17:07:16.273044] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-02T17:07:16.513259] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T17:07:16.514784] [INFO ] [REMOTE ] AGRO: Full fetch complete (49644 records). [2025-10-02T17:07:16.514879] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-02T17:07:16.938283] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-02T17:07:16.938381] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-02T17:07:16.939019] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-02T17:07:16.939091] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-02T17:07:16.940390] [DEBUG] [LOCAL ] AGRO: Trimmed 49644 records to 33687 (keeping 200 days of data) [2025-10-02T17:07:17.102213] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-02T17:07:17.150793] [DEBUG] [LOCAL ] AGRO: Primary data saved (33687 records). [2025-10-02T17:07:17.150928] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-02T17:07:17.151001] [INFO ] [MAIN ] Update Progress: 59/2370 symbols completed. AGRO took 27.6s. Estimated remaining: 4h 42m 54s. Rate: 8.2 symbols/min [2025-10-02T17:07:17.338616] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:17.346299] [DEBUG] [LOCAL ] AHT: Loaded 6134 existing records from primary storage. [2025-10-02T17:07:17.346505] [INFO ] [MAIN ] AHT: Loaded 6134 existing records. [2025-10-02T17:07:17.542686] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:07:17.543023] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-02T17:07:17.543087] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-02T17:07:17.543414] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-02T17:07:17.543474] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-02T17:07:17.881211] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-02T17:07:17.982139] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T17:07:17.980660] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:18.673005] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-02T17:07:18.731148] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T17:07:19.473020] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-10-02T17:07:19.527939] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T17:07:20.147440] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T17:07:20.170200] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-02T17:07:20.272995] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-02T17:07:20.929461] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-02T17:07:21.073009] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-02T17:07:21.873012] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-02T17:07:22.635829] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T17:07:22.672994] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-02T17:07:23.307473] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T17:07:23.472998] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-02T17:07:23.570744] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T17:07:24.273009] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-02T17:07:25.072983] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-02T17:07:25.222085] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T17:07:25.873003] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-02T17:07:25.920458] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T17:07:26.673027] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-02T17:07:26.809855] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T17:07:26.960365] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T17:07:26.962144] [INFO ] [REMOTE ] AHH: Full fetch complete (60186 records). [2025-10-02T17:07:26.962257] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-02T17:07:27.386505] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-02T17:07:27.386596] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-02T17:07:27.387278] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-02T17:07:27.387350] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-02T17:07:27.388812] [DEBUG] [LOCAL ] AHH: Trimmed 60186 records to 41379 (keeping 200 days of data) [2025-10-02T17:07:27.477421] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-02T17:07:27.650437] [DEBUG] [LOCAL ] AHH: Primary data saved (41379 records). [2025-10-02T17:07:27.650576] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-02T17:07:27.650680] [INFO ] [MAIN ] Update Progress: 60/2370 symbols completed. AHH took 30.5s. Estimated remaining: 4h 44m 48s. Rate: 8.1 symbols/min [2025-10-02T17:07:27.844872] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:27.864893] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T17:07:27.926149] [DEBUG] [LOCAL ] AI: Loaded 53750 existing records from primary storage. [2025-10-02T17:07:27.926490] [INFO ] [MAIN ] AI: Loaded 53750 existing records. [2025-10-02T17:07:28.131772] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:07:28.132043] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-02T17:07:28.132103] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-02T17:07:28.133271] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-02T17:07:28.133363] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-02T17:07:28.278190] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-02T17:07:28.540486] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:28.986173] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T17:07:29.073002] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-10-02T17:07:29.873007] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-02T17:07:29.937938] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T17:07:30.520021] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T17:07:30.673000] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-02T17:07:31.297401] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-02T17:07:31.351144] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-02T17:07:31.472997] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-02T17:07:32.272993] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-02T17:07:32.778545] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-02T17:07:33.078056] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-02T17:07:33.097255] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T17:07:33.872996] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-02T17:07:34.673004] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-02T17:07:35.358058] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T17:07:35.473080] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-02T17:07:35.633270] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-10-02T17:07:36.224966] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T17:07:36.226566] [INFO ] [REMOTE ] AGX: Full fetch complete (48823 records). [2025-10-02T17:07:36.226751] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-02T17:07:36.277748] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-02T17:07:36.358747] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T17:07:36.665413] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-02T17:07:36.665507] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-02T17:07:36.666117] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-02T17:07:36.666182] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-02T17:07:36.667467] [DEBUG] [LOCAL ] AGX: Trimmed 48823 records to 33402 (keeping 200 days of data) [2025-10-02T17:07:36.888006] [DEBUG] [LOCAL ] AGX: Primary data saved (33402 records). [2025-10-02T17:07:36.888175] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-02T17:07:36.888264] [INFO ] [MAIN ] Update Progress: 61/2370 symbols completed. AGX took 43.2s. Estimated remaining: 4h 45m 50s. Rate: 8.1 symbols/min [2025-10-02T17:07:37.068052] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:37.073021] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-02T17:07:37.124886] [DEBUG] [LOCAL ] AIG: Loaded 53472 existing records from primary storage. [2025-10-02T17:07:37.125290] [INFO ] [MAIN ] AIG: Loaded 53472 existing records. [2025-10-02T17:07:37.314269] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:07:37.314501] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-02T17:07:37.314551] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-02T17:07:37.315854] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-02T17:07:37.315917] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-02T17:07:37.705248] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:37.841947] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T17:07:37.872978] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-02T17:07:38.376437] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-02T17:07:38.673029] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-02T17:07:39.387281] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T17:07:39.473011] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-10-02T17:07:39.796864] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T17:07:40.273052] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-02T17:07:41.072982] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-02T17:07:41.348556] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T17:07:41.876623] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-02T17:07:41.878983] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T17:07:42.451696] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-10-02T17:07:42.673003] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-02T17:07:43.301980] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T17:07:43.302879] [INFO ] [REMOTE ] AHT: Full fetch complete (9332 records). [2025-10-02T17:07:43.302953] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-02T17:07:43.482081] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-02T17:07:43.743045] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-02T17:07:43.743221] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-02T17:07:43.743454] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-02T17:07:43.743526] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-02T17:07:43.744217] [DEBUG] [LOCAL ] AHT: Trimmed 9332 records to 6188 (keeping 200 days of data) [2025-10-02T17:07:43.809338] [DEBUG] [LOCAL ] AHT: Primary data saved (6188 records). [2025-10-02T17:07:43.809874] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-02T17:07:43.811772] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T17:07:43.810267] [INFO ] [MAIN ] Update Progress: 62/2370 symbols completed. AHT took 26.7s. Estimated remaining: 4h 45m 24s. Rate: 8.1 symbols/min [2025-10-02T17:07:44.011532] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:44.011741] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-02T17:07:44.011791] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-02T17:07:44.011912] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-02T17:07:44.011956] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-02T17:07:44.012000] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-02T17:07:44.012035] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-02T17:07:44.281381] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-02T17:07:44.415974] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:45.073033] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-10-02T17:07:45.277893] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:07:45.278246] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-10-02T17:07:45.278339] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:07:45.278386] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-02T17:07:45.278447] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:07:45.278520] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-02T17:07:45.278582] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-02T17:07:45.278617] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-02T17:07:45.278693] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-02T17:07:45.278792] [INFO ] [MAIN ] Update Progress: 63/2370 symbols completed. AII took 1.5s. Estimated remaining: 4h 41m 38s. Rate: 8.2 symbols/min [2025-10-02T17:07:45.504723] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:45.529812] [DEBUG] [LOCAL ] AIN: Loaded 24554 existing records from primary storage. [2025-10-02T17:07:45.530128] [INFO ] [MAIN ] AIN: Loaded 24554 existing records. [2025-10-02T17:07:45.766211] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:07:45.766558] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-02T17:07:45.766661] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-02T17:07:45.767408] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-02T17:07:45.767493] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-02T17:07:45.890525] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-02T17:07:46.197340] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T17:07:46.336226] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:46.338391] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-10-02T17:07:46.673045] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-02T17:07:47.473048] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-10-02T17:07:47.739911] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T17:07:47.889244] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T17:07:47.891412] [INFO ] [REMOTE ] AHR: Full fetch complete (70817 records). [2025-10-02T17:07:47.891536] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-02T17:07:48.283960] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-02T17:07:48.334969] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-10-02T17:07:48.335109] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-10-02T17:07:48.335828] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-10-02T17:07:48.336007] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-10-02T17:07:48.350757] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T17:07:48.355428] [DEBUG] [LOCAL ] AHR: Trimmed 70817 records to 49515 (keeping 200 days of data) [2025-10-02T17:07:48.680471] [DEBUG] [LOCAL ] AHR: Primary data saved (49515 records). [2025-10-02T17:07:48.680681] [INFO ] [MAIN ] AHR: Full history saved. [2025-10-02T17:07:48.682243] [INFO ] [MAIN ] Update Progress: 64/2370 symbols completed. AHR took 41.0s. Estimated remaining: 4h 39m 10s. Rate: 8.3 symbols/min [2025-10-02T17:07:48.863695] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:07:48.863926] [DEBUG] [LOCAL ] AIO: No existing data file found in primary storage. [2025-10-02T17:07:48.863985] [WARN ] [MAIN ] AIO: No existing data found, performing full refresh instead. [2025-10-02T17:07:48.864100] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-02T17:07:48.864143] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-02T17:07:48.864188] [DEBUG] [LOCAL ] AIO: No primary data file found to delete. [2025-10-02T17:07:48.864222] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-02T17:07:49.078196] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-02T17:07:49.298138] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:07:49.873002] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-02T17:07:50.013376] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T17:07:50.190438] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:07:50.673055] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-02T17:07:51.473028] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-10-02T17:07:51.647817] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T17:07:51.855506] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T17:07:52.273015] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-02T17:07:52.289754] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T17:07:53.072998] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-02T17:07:53.337041] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T17:07:53.868809] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T17:07:53.873281] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-02T17:07:54.673010] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-02T17:07:54.884441] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T17:07:55.473060] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-02T17:07:56.273022] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-02T17:07:56.607032] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:07:56.804779] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-02T17:07:57.072979] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-02T17:07:57.144105] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T17:07:57.873004] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-02T17:07:57.978567] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T17:07:58.672997] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-02T17:07:58.774000] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T17:07:59.473012] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-02T17:08:00.273032] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-02T17:08:00.879144] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T17:08:01.073033] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-02T17:08:01.137510] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-02T17:08:01.873051] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-02T17:08:01.983713] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T17:08:02.181290] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T17:08:02.673053] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-02T17:08:03.473014] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-02T17:08:04.273170] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-02T17:08:04.445184] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T17:08:04.510489] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-10-02T17:08:04.537211] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T17:08:05.073006] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-02T17:08:05.394803] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T17:08:05.873012] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-02T17:08:06.673032] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-02T17:08:06.731065] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T17:08:07.473029] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-02T17:08:07.513130] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-02T17:08:08.099427] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-02T17:08:08.273026] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-02T17:08:09.073013] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-02T17:08:09.092345] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T17:08:09.386278] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T17:08:09.873021] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-02T17:08:10.673011] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-02T17:08:10.855691] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-02T17:08:10.857770] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-10-02T17:08:10.857873] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-02T17:08:11.282930] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-02T17:08:11.283049] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-02T17:08:11.283922] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-02T17:08:11.284040] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-02T17:08:11.285731] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 54140 (keeping 200 days of data) [2025-10-02T17:08:11.443103] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T17:08:11.516411] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-02T17:08:11.564377] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-02T17:08:11.694231] [DEBUG] [LOCAL ] AI: Primary data saved (54140 records). [2025-10-02T17:08:11.694382] [INFO ] [MAIN ] AI: Full history saved. [2025-10-02T17:08:11.694482] [INFO ] [MAIN ] Update Progress: 65/2370 symbols completed. AI took 44.0s. Estimated remaining: 4h 48m 21s. Rate: 8.0 symbols/min [2025-10-02T17:08:11.883232] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:11.911133] [DEBUG] [LOCAL ] AIR: Loaded 28191 existing records from primary storage. [2025-10-02T17:08:11.911448] [INFO ] [MAIN ] AIR: Loaded 28191 existing records. [2025-10-02T17:08:12.128227] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:08:12.128503] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-02T17:08:12.128555] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-02T17:08:12.129465] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-02T17:08:12.129530] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-02T17:08:12.278189] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-02T17:08:12.562171] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:12.566799] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T17:08:12.568443] [INFO ] [REMOTE ] AIN: Full fetch complete (33421 records). [2025-10-02T17:08:12.568570] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-02T17:08:12.987684] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-02T17:08:12.987785] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-02T17:08:12.988260] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-02T17:08:12.988347] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-02T17:08:12.989261] [DEBUG] [LOCAL ] AIN: Trimmed 33421 records to 24750 (keeping 200 days of data) [2025-10-02T17:08:13.089982] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-02T17:08:13.158326] [DEBUG] [LOCAL ] AIN: Primary data saved (24750 records). [2025-10-02T17:08:13.158459] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-02T17:08:13.158565] [INFO ] [MAIN ] Update Progress: 66/2370 symbols completed. AIN took 27.9s. Estimated remaining: 4h 44m 43s. Rate: 8.1 symbols/min [2025-10-02T17:08:13.370081] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:13.400421] [DEBUG] [LOCAL ] AIT: Loaded 27516 existing records from primary storage. [2025-10-02T17:08:13.400766] [INFO ] [MAIN ] AIT: Loaded 27516 existing records. [2025-10-02T17:08:13.652400] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:08:13.652711] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-02T17:08:13.652792] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-02T17:08:13.654264] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-02T17:08:13.654340] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-02T17:08:13.874056] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-10-02T17:08:13.959933] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T17:08:14.094886] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:14.130997] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T17:08:14.673020] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-10-02T17:08:15.181387] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T17:08:15.472969] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-02T17:08:15.905198] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T17:08:16.273051] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-02T17:08:16.533281] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T17:08:17.073069] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-02T17:08:17.304507] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T17:08:17.726848] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T17:08:17.873036] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-02T17:08:18.673064] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-02T17:08:19.410499] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T17:08:19.473042] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-02T17:08:19.622598] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T17:08:20.273004] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-02T17:08:20.521917] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T17:08:21.073012] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-02T17:08:21.598495] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T17:08:21.872997] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-02T17:08:22.656194] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T17:08:22.662947] [INFO ] [REMOTE ] AIG: Full fetch complete (77379 records). [2025-10-02T17:08:22.663092] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-02T17:08:22.678538] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-02T17:08:23.112058] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-02T17:08:23.117369] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-02T17:08:23.125270] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-02T17:08:23.125435] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-02T17:08:23.127155] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T17:08:23.133600] [DEBUG] [LOCAL ] AIG: Trimmed 77379 records to 53862 (keeping 200 days of data) [2025-10-02T17:08:23.473041] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-02T17:08:23.489256] [DEBUG] [LOCAL ] AIG: Primary data saved (53862 records). [2025-10-02T17:08:23.489454] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-02T17:08:23.491593] [INFO ] [MAIN ] Update Progress: 67/2370 symbols completed. AIG took 46.6s. Estimated remaining: 4h 46m 15s. Rate: 8.0 symbols/min [2025-10-02T17:08:23.682074] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:23.727038] [DEBUG] [LOCAL ] AIV: Loaded 40387 existing records from primary storage. [2025-10-02T17:08:23.727387] [INFO ] [MAIN ] AIV: Loaded 40387 existing records. [2025-10-02T17:08:23.946117] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:08:23.946539] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-02T17:08:23.946688] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-02T17:08:23.956501] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-02T17:08:23.968979] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-02T17:08:23.975919] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T17:08:24.278142] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-02T17:08:24.401946] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:24.457315] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T17:08:24.459075] [INFO ] [REMOTE ] AIO: Full fetch complete (20173 records). [2025-10-02T17:08:24.459188] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-02T17:08:24.874231] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-02T17:08:24.874311] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-02T17:08:24.874619] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-02T17:08:24.874704] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-02T17:08:24.875931] [DEBUG] [LOCAL ] AIO: Trimmed 20173 records to 13422 (keeping 200 days of data) [2025-10-02T17:08:24.967465] [DEBUG] [LOCAL ] AIO: Primary data saved (13422 records). [2025-10-02T17:08:24.967609] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-02T17:08:24.967715] [INFO ] [MAIN ] Update Progress: 68/2370 symbols completed. AIO took 36.3s. Estimated remaining: 4h 42m 45s. Rate: 8.1 symbols/min [2025-10-02T17:08:25.074841] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-10-02T17:08:25.150369] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:25.187885] [DEBUG] [LOCAL ] AIZ: Loaded 29857 existing records from primary storage. [2025-10-02T17:08:25.188224] [INFO ] [MAIN ] AIZ: Loaded 29857 existing records. [2025-10-02T17:08:25.391458] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:08:25.391841] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-02T17:08:25.391899] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-02T17:08:25.392601] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-02T17:08:25.392706] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-02T17:08:25.813118] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:08:25.819574] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:25.873011] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-10-02T17:08:26.235935] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T17:08:26.673026] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-02T17:08:27.007389] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T17:08:27.473030] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-02T17:08:28.182285] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T17:08:28.273068] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-02T17:08:28.795183] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T17:08:29.073091] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-02T17:08:29.483710] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T17:08:29.873015] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-02T17:08:30.330148] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T17:08:30.672994] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-02T17:08:31.127122] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T17:08:31.472998] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-02T17:08:32.160673] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T17:08:32.273008] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-02T17:08:32.980981] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T17:08:33.073002] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-02T17:08:33.873850] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-02T17:08:33.873748] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T17:08:34.188425] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T17:08:34.672995] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-02T17:08:35.326734] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T17:08:35.473002] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-02T17:08:35.961574] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T17:08:36.273015] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-02T17:08:36.978865] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T17:08:37.073047] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-02T17:08:37.861306] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T17:08:37.873145] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-02T17:08:37.954804] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T17:08:38.673025] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-02T17:08:38.994965] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T17:08:38.997072] [INFO ] [REMOTE ] AIR: Full fetch complete (39105 records). [2025-10-02T17:08:38.997252] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-02T17:08:39.427118] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-02T17:08:39.427209] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-02T17:08:39.427686] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-02T17:08:39.427760] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-02T17:08:39.428912] [DEBUG] [LOCAL ] AIR: Trimmed 39105 records to 28562 (keeping 200 days of data) [2025-10-02T17:08:39.489855] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-02T17:08:39.617114] [DEBUG] [LOCAL ] AIR: Primary data saved (28562 records). [2025-10-02T17:08:39.617269] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-02T17:08:39.617386] [INFO ] [MAIN ] Update Progress: 69/2370 symbols completed. AIR took 27.9s. Estimated remaining: 4h 46m 41s. Rate: 8.0 symbols/min [2025-10-02T17:08:39.822402] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:39.829471] [DEBUG] [LOCAL ] AIZN: Loaded 4025 existing records from primary storage. [2025-10-02T17:08:39.829764] [INFO ] [MAIN ] AIZN: Loaded 4025 existing records. [2025-10-02T17:08:40.043859] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:08:40.070542] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-02T17:08:40.071428] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-02T17:08:40.072359] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:08:40.082775] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-02T17:08:40.083739] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-02T17:08:40.283365] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-02T17:08:40.503593] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:41.069466] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:08:41.076972] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-10-02T17:08:41.827092] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T17:08:41.876469] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-02T17:08:41.882130] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T17:08:42.488452] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T17:08:42.673017] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-02T17:08:43.473013] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-02T17:08:44.071204] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T17:08:44.273002] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-02T17:08:44.804608] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-02T17:08:45.073024] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-02T17:08:45.553796] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T17:08:45.564214] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T17:08:45.873011] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-02T17:08:46.673081] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-02T17:08:47.097900] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-02T17:08:47.423303] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T17:08:47.473037] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-02T17:08:48.273026] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-02T17:08:48.883601] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T17:08:49.073026] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-02T17:08:49.347091] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T17:08:49.438954] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-02T17:08:49.873013] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-02T17:08:50.442843] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T17:08:50.673019] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-02T17:08:51.204498] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T17:08:51.473014] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-02T17:08:52.073778] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T17:08:52.273048] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-02T17:08:52.731133] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T17:08:53.073016] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-02T17:08:53.678309] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-02T17:08:53.873001] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-02T17:08:54.673063] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-02T17:08:55.472980] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-02T17:08:55.519447] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T17:08:55.604342] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T17:08:55.605729] [INFO ] [REMOTE ] AIT: Full fetch complete (39380 records). [2025-10-02T17:08:55.605833] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-02T17:08:56.039463] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T17:08:56.039799] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-02T17:08:56.040734] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-02T17:08:56.040831] [INFO ] [REMOTE ] AIZN: Full fetch complete (5907 records). [2025-10-02T17:08:56.041030] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-02T17:08:56.041619] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-02T17:08:56.064373] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-02T17:08:56.159730] [DEBUG] [LOCAL ] AIT: Trimmed 39380 records to 27668 (keeping 200 days of data) [2025-10-02T17:08:56.278101] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-02T17:08:56.568490] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-02T17:08:56.568910] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-02T17:08:56.569496] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-02T17:08:56.571397] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-02T17:08:56.573533] [DEBUG] [LOCAL ] AIZN: Trimmed 5907 records to 4082 (keeping 200 days of data) [2025-10-02T17:08:56.608903] [DEBUG] [LOCAL ] AIZN: Primary data saved (4082 records). [2025-10-02T17:08:56.609608] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-02T17:08:56.611468] [INFO ] [MAIN ] Update Progress: 70/2370 symbols completed. AIZN took 17.0s. Estimated remaining: 4h 51m 46s. Rate: 7.9 symbols/min [2025-10-02T17:08:56.814595] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:56.894351] [DEBUG] [LOCAL ] AIT: Primary data saved (27668 records). [2025-10-02T17:08:56.894495] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-02T17:08:56.894579] [INFO ] [MAIN ] Update Progress: 71/2370 symbols completed. AIT took 43.7s. Estimated remaining: 4h 47m 41s. Rate: 8.0 symbols/min [2025-10-02T17:08:57.020151] [DEBUG] [LOCAL ] AJG: Loaded 46880 existing records from primary storage. [2025-10-02T17:08:57.031297] [INFO ] [MAIN ] AJG: Loaded 46880 existing records. [2025-10-02T17:08:57.078119] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-02T17:08:57.197428] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:08:57.209876] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-02T17:08:57.229472] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-02T17:08:57.230210] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-02T17:08:57.241014] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-02T17:08:57.272537] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-02T17:08:57.277784] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-02T17:08:57.394693] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:08:57.418173] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-02T17:08:57.436456] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-02T17:08:57.458030] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-02T17:08:57.462901] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-02T17:08:57.991032] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:58.017843] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-10-02T17:08:58.145553] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T17:08:58.208636] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:08:58.515624] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-02T17:08:58.673011] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-10-02T17:08:58.910351] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T17:08:59.473002] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-02T17:08:59.829264] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-02T17:09:00.273052] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-02T17:09:00.544495] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T17:09:01.073023] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-02T17:09:01.611510] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T17:09:01.624944] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T17:09:01.626357] [INFO ] [REMOTE ] AIV: Full fetch complete (59511 records). [2025-10-02T17:09:01.626446] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-02T17:09:01.627240] [FATAL] [VALIDATOR ] AIV: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:09:01.627376] [FATAL] [MAIN ] AIV: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:09:01.627459] [WARN ] [MAIN ] AIV: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:09:01.627551] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-02T17:09:01.627628] [DEBUG] [LOCAL ] AIV: No primary data file found to delete. [2025-10-02T17:09:01.627711] [INFO ] [LOCAL ] AIV: Starting deletion of derivative data. [2025-10-02T17:09:01.628145] [DEBUG] [LOCAL ] AIV: Deleted derivative data file. [2025-10-02T17:09:01.628953] [INFO ] [MAIN ] Update Progress: 72/2370 symbols completed. AIV took 38.1s. Estimated remaining: 4h 46m 5s. Rate: 8.0 symbols/min [2025-10-02T17:09:01.826500] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:09:01.872975] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-02T17:09:01.892058] [DEBUG] [LOCAL ] AKR: Loaded 45714 existing records from primary storage. [2025-10-02T17:09:01.892439] [INFO ] [MAIN ] AKR: Loaded 45714 existing records. [2025-10-02T17:09:02.099097] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:09:02.099407] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-02T17:09:02.099459] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-02T17:09:02.103043] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-02T17:09:02.103111] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-02T17:09:02.510481] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T17:09:02.526596] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:09:02.673007] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-02T17:09:03.139740] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-02T17:09:03.473051] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-02T17:09:04.273045] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-02T17:09:05.073035] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-10-02T17:09:05.263290] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T17:09:05.684306] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T17:09:05.872989] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-02T17:09:06.419150] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T17:09:06.673023] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-02T17:09:07.473010] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-02T17:09:07.613420] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T17:09:08.047734] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:09:08.273011] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-02T17:09:08.996268] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T17:09:09.073046] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-02T17:09:09.149496] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:09:09.151138] [INFO ] [REMOTE ] AIZ: Full fetch complete (42906 records). [2025-10-02T17:09:09.151264] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-02T17:09:09.555361] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-02T17:09:09.555467] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-02T17:09:09.556027] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-02T17:09:09.556097] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-02T17:09:09.557405] [DEBUG] [LOCAL ] AIZ: Trimmed 42906 records to 30062 (keeping 200 days of data) [2025-10-02T17:09:09.759851] [DEBUG] [LOCAL ] AIZ: Primary data saved (30062 records). [2025-10-02T17:09:09.760014] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-02T17:09:09.761278] [INFO ] [MAIN ] Update Progress: 73/2370 symbols completed. AIZ took 44.8s. Estimated remaining: 4h 46m 19s. Rate: 8.0 symbols/min [2025-10-02T17:09:09.877256] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-02T17:09:09.953230] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:09:10.000222] [DEBUG] [LOCAL ] AL: Loaded 44286 existing records from primary storage. [2025-10-02T17:09:10.000596] [INFO ] [MAIN ] AL: Loaded 44286 existing records. [2025-10-02T17:09:10.194443] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:09:10.194782] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-02T17:09:10.194844] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-02T17:09:10.201007] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-02T17:09:10.201083] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-02T17:09:10.585313] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:09:10.672983] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-10-02T17:09:10.927224] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-02T17:09:11.394582] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T17:09:11.472981] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-02T17:09:11.964563] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T17:09:12.272998] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-02T17:09:13.073051] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-02T17:09:13.363896] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T17:09:13.685848] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T17:09:13.799617] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:09:13.872977] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-02T17:09:14.673006] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-02T17:09:15.257037] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T17:09:15.473016] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-02T17:09:16.054939] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T17:09:16.272996] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-02T17:09:16.696355] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T17:09:17.073017] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-02T17:09:17.864304] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T17:09:17.874547] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-02T17:09:18.178224] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-02T17:09:18.587363] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T17:09:18.673011] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-02T17:09:19.472994] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-02T17:09:20.273017] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-02T17:09:20.336845] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T17:09:21.073013] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-02T17:09:21.254838] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T17:09:21.872992] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-02T17:09:22.068722] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:09:22.161200] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-02T17:09:22.499405] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T17:09:22.672990] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-02T17:09:23.472998] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-02T17:09:24.182926] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:09:24.273017] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-02T17:09:25.073003] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-02T17:09:25.217775] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T17:09:25.479547] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T17:09:25.873018] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-02T17:09:26.673005] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-02T17:09:26.745114] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T17:09:27.193833] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T17:09:27.404573] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T17:09:27.472967] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-02T17:09:28.273005] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-02T17:09:28.716690] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T17:09:28.718728] [INFO ] [REMOTE ] AJG: Full fetch complete (69532 records). [2025-10-02T17:09:28.718832] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-02T17:09:29.078211] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-02T17:09:29.144096] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-02T17:09:29.144198] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-02T17:09:29.145035] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-02T17:09:29.145108] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-02T17:09:29.146789] [DEBUG] [LOCAL ] AJG: Trimmed 69532 records to 47189 (keeping 200 days of data) [2025-10-02T17:09:29.458294] [DEBUG] [LOCAL ] AJG: Primary data saved (47189 records). [2025-10-02T17:09:29.458432] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-02T17:09:29.459305] [INFO ] [MAIN ] Update Progress: 74/2370 symbols completed. AJG took 32.8s. Estimated remaining: 4h 52m 30s. Rate: 7.8 symbols/min [2025-10-02T17:09:29.546891] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T17:09:29.653979] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:09:29.710639] [DEBUG] [LOCAL ] ALB: Loaded 53234 existing records from primary storage. [2025-10-02T17:09:29.710998] [INFO ] [MAIN ] ALB: Loaded 53234 existing records. [2025-10-02T17:09:29.883011] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-02T17:09:29.916042] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:09:29.917503] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-02T17:09:29.917592] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-02T17:09:29.921578] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-02T17:09:29.921714] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-02T17:09:30.371757] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-02T17:09:30.378256] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:09:30.673001] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-02T17:09:31.198318] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T17:09:31.473005] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-10-02T17:09:32.091530] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T17:09:32.093540] [INFO ] [REMOTE ] AKR: Full fetch complete (65490 records). [2025-10-02T17:09:32.093632] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-02T17:09:32.283087] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-02T17:09:32.565448] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-02T17:09:32.565539] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-02T17:09:32.566202] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-02T17:09:32.566268] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-02T17:09:32.567914] [DEBUG] [LOCAL ] AKR: Trimmed 65490 records to 46065 (keeping 200 days of data) [2025-10-02T17:09:32.755162] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T17:09:32.764744] [INFO ] [REMOTE ] AKA: Full fetch complete (2407 records). [2025-10-02T17:09:32.792223] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-02T17:09:33.011424] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T17:09:33.013791] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:09:33.014514] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:09:33.017224] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-02T17:09:33.017999] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-02T17:09:33.018359] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-02T17:09:33.019782] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-02T17:09:33.020709] [INFO ] [MAIN ] Update Progress: 75/2370 symbols completed. AKA took 36.1s. Estimated remaining: 4h 50m 18s. Rate: 7.9 symbols/min [2025-10-02T17:09:33.084432] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-02T17:09:33.230999] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:09:33.279217] [DEBUG] [LOCAL ] AKR: Primary data saved (46065 records). [2025-10-02T17:09:33.279463] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-02T17:09:33.280804] [INFO ] [MAIN ] Update Progress: 76/2370 symbols completed. AKR took 31.7s. Estimated remaining: 4h 46m 29s. Rate: 8.0 symbols/min [2025-10-02T17:09:33.503638] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:09:33.506207] [DEBUG] [LOCAL ] ALC: Loaded 50825 existing records from primary storage. [2025-10-02T17:09:33.506566] [INFO ] [MAIN ] ALC: Loaded 50825 existing records. [2025-10-02T17:09:33.723479] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-02T17:09:33.801410] [DEBUG] [LOCAL ] ALE: Loaded 30653 existing records from primary storage. [2025-10-02T17:09:33.810580] [INFO ] [MAIN ] ALE: Loaded 30653 existing records. [2025-10-02T17:09:33.824117] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:09:33.829450] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-02T17:09:33.849688] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-02T17:09:33.894545] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-02T17:09:33.894469] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-10-02T17:09:33.914001] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-02T17:09:34.170595] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:09:34.198472] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-02T17:09:34.208374] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-02T17:09:34.291421] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-02T17:09:34.307542] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-02T17:09:34.538427] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:09:34.682421] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-10-02T17:09:34.843193] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:09:34.866295] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T17:09:35.473014] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-10-02T17:09:35.893580] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-02T17:09:36.272972] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-02T17:09:36.426912] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T17:09:36.578110] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T17:09:37.073013] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-02T17:09:37.494572] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T17:09:37.873052] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-02T17:09:38.056740] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T17:09:38.673049] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-02T17:09:39.473024] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-02T17:09:39.615614] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T17:09:39.774168] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T17:09:40.273033] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-02T17:09:41.073012] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-02T17:09:41.182299] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T17:09:41.239743] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T17:09:41.873050] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-02T17:09:42.615991] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T17:09:42.673041] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-02T17:09:43.473001] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-02T17:09:43.557989] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T17:09:44.272985] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-02T17:09:44.668108] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-02T17:09:45.073038] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-02T17:09:45.107144] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-02T17:09:45.774875] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T17:09:45.776930] [INFO ] [REMOTE ] AL: Full fetch complete (62715 records). [2025-10-02T17:09:45.777072] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-02T17:09:45.881850] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-02T17:09:46.196671] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-02T17:09:46.196775] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-02T17:09:46.197429] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-02T17:09:46.197476] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-02T17:09:46.199732] [DEBUG] [LOCAL ] AL: Trimmed 62715 records to 44640 (keeping 200 days of data) [2025-10-02T17:09:46.492111] [DEBUG] [LOCAL ] AL: Primary data saved (44640 records). [2025-10-02T17:09:46.492356] [INFO ] [MAIN ] AL: Full history saved. [2025-10-02T17:09:46.493304] [INFO ] [MAIN ] Update Progress: 77/2370 symbols completed. AL took 36.7s. Estimated remaining: 4h 49m 12s. Rate: 7.9 symbols/min [2025-10-02T17:09:46.521945] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T17:09:46.673088] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-02T17:09:47.473012] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-02T17:09:47.552370] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T17:09:48.272990] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-02T17:09:48.375551] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T17:09:48.531401] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T17:09:49.073028] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-02T17:09:49.873058] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-02T17:09:50.416307] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-02T17:09:50.673005] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-02T17:09:50.801900] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T17:09:50.830161] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-02T17:09:51.473024] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-02T17:09:52.273083] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-02T17:09:52.641819] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T17:09:53.073032] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-02T17:09:53.132045] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-10-02T17:09:53.873012] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-02T17:09:54.064592] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T17:09:54.459467] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T17:09:54.673050] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-02T17:09:55.473008] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-02T17:09:55.800959] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T17:09:56.048195] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T17:09:56.273002] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-02T17:09:57.073037] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-02T17:09:57.424273] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-02T17:09:57.873049] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-02T17:09:58.516147] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-02T17:09:58.541528] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T17:09:58.672998] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-02T17:09:59.473015] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-02T17:09:59.766435] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T17:09:59.984951] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T17:09:59.987760] [INFO ] [REMOTE ] ALE: Full fetch complete (42934 records). [2025-10-02T17:09:59.987923] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-02T17:10:00.278196] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-02T17:10:00.418504] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-02T17:10:00.418586] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-02T17:10:00.419069] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-02T17:10:00.419131] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-02T17:10:00.420218] [DEBUG] [LOCAL ] ALE: Trimmed 42934 records to 30960 (keeping 200 days of data) [2025-10-02T17:10:00.608167] [DEBUG] [LOCAL ] ALE: Primary data saved (30960 records). [2025-10-02T17:10:00.608306] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-02T17:10:00.608391] [INFO ] [MAIN ] Update Progress: 78/2370 symbols completed. ALE took 27.3s. Estimated remaining: 4h 52m 17s. Rate: 7.8 symbols/min [2025-10-02T17:10:01.440470] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-02T17:10:01.442946] [INFO ] [REMOTE ] ALB: Full fetch complete (76848 records). [2025-10-02T17:10:01.443126] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-02T17:10:01.922846] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-02T17:10:01.923101] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-02T17:10:01.923908] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-02T17:10:01.923974] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-02T17:10:01.925614] [DEBUG] [LOCAL ] ALB: Trimmed 76848 records to 53622 (keeping 200 days of data) [2025-10-02T17:10:02.207376] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T17:10:02.221935] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-02T17:10:02.332865] [DEBUG] [LOCAL ] ALB: Primary data saved (53622 records). [2025-10-02T17:10:02.333023] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-02T17:10:02.333123] [INFO ] [MAIN ] Update Progress: 79/2370 symbols completed. ALB took 32.9s. Estimated remaining: 4h 49m 17s. Rate: 7.9 symbols/min [2025-10-02T17:10:03.784631] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T17:10:03.796423] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-02T17:10:05.588100] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-02T17:10:05.590288] [INFO ] [REMOTE ] ALC: Full fetch complete (72604 records). [2025-10-02T17:10:05.590537] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-02T17:10:05.591960] [FATAL] [VALIDATOR ] ALC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:10:05.592105] [FATAL] [MAIN ] ALC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:10:05.592191] [WARN ] [MAIN ] ALC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:10:05.592280] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-02T17:10:05.592359] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-02T17:10:05.592404] [INFO ] [LOCAL ] ALC: Starting deletion of derivative data. [2025-10-02T17:10:05.592767] [DEBUG] [LOCAL ] ALC: Deleted derivative data file. [2025-10-02T17:10:05.592907] [INFO ] [MAIN ] Update Progress: 80/2370 symbols completed. ALC took 32.6s. Estimated remaining: 4h 47m 6s. Rate: 8.0 symbols/min [2025-10-02T17:10:06.404226] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:06.453006] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:06.421398] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:06.457353] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:06.473926] [DEBUG] [LOCAL ] ALG: Loaded 10239 existing records from primary storage. [2025-10-02T17:10:06.474387] [INFO ] [MAIN ] ALG: Loaded 10239 existing records. [2025-10-02T17:10:06.624483] [DEBUG] [LOCAL ] ALEX: Loaded 31083 existing records from primary storage. [2025-10-02T17:10:06.635231] [INFO ] [MAIN ] ALEX: Loaded 31083 existing records. [2025-10-02T17:10:06.862362] [DEBUG] [LOCAL ] ALK: Loaded 53054 existing records from primary storage. [2025-10-02T17:10:06.835115] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:06.873254] [INFO ] [MAIN ] ALK: Loaded 53054 existing records. [2025-10-02T17:10:06.879786] [DEBUG] [LOCAL ] ALIT: Loaded 52766 existing records from primary storage. [2025-10-02T17:10:06.873437] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-02T17:10:06.896739] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-02T17:10:06.905853] [INFO ] [MAIN ] ALIT: Loaded 52766 existing records. [2025-10-02T17:10:06.927283] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-02T17:10:06.985788] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-02T17:10:07.300037] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:07.339709] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-02T17:10:07.354129] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-02T17:10:07.389703] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-02T17:10:07.415995] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-02T17:10:07.518576] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:07.551256] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-02T17:10:07.626752] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-02T17:10:07.690555] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:07.714453] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-02T17:10:07.734623] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-02T17:10:07.745245] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-02T17:10:07.755759] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-02T17:10:07.793524] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-02T17:10:07.810367] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-02T17:10:08.306425] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:08.348480] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-10-02T17:10:08.966960] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:08.986852] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-10-02T17:10:09.042411] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:09.078412] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:09.080183] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-10-02T17:10:09.080559] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-10-02T17:10:09.841013] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T17:10:09.844400] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-02T17:10:10.222886] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T17:10:10.230142] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-02T17:10:10.742599] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T17:10:10.745800] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-02T17:10:10.818386] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T17:10:10.829760] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-02T17:10:11.010700] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T17:10:11.022718] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-02T17:10:11.217078] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T17:10:11.223589] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-02T17:10:11.629083] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T17:10:11.632198] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-02T17:10:12.311896] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T17:10:12.318379] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-02T17:10:12.392399] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T17:10:12.396332] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-02T17:10:12.432592] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T17:10:12.793364] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-02T17:10:13.073072] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-02T17:10:13.594430] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T17:10:13.743457] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T17:10:13.873012] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-02T17:10:14.673015] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-02T17:10:14.744983] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T17:10:15.473016] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-02T17:10:15.546621] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:10:16.168224] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T17:10:16.273037] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-02T17:10:16.946694] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T17:10:17.073017] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-02T17:10:17.187709] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T17:10:17.872995] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-02T17:10:18.673026] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-02T17:10:18.723358] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T17:10:18.852423] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T17:10:19.473003] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-02T17:10:19.660046] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T17:10:20.273003] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-02T17:10:21.073002] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-02T17:10:21.347995] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T17:10:21.433911] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T17:10:21.873007] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-02T17:10:22.672994] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-02T17:10:22.900917] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T17:10:23.472981] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-02T17:10:23.483196] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T17:10:23.654005] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T17:10:24.272996] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-02T17:10:24.854866] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T17:10:25.072989] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-02T17:10:25.872980] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-02T17:10:26.131335] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T17:10:26.173335] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T17:10:26.502026] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T17:10:26.673020] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-02T17:10:27.228039] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T17:10:27.472999] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-02T17:10:28.273028] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-02T17:10:28.722813] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T17:10:28.926451] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T17:10:28.927484] [INFO ] [REMOTE ] ALG: Full fetch complete (15892 records). [2025-10-02T17:10:28.927594] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-02T17:10:29.078084] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-02T17:10:29.367708] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-02T17:10:29.367811] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-02T17:10:29.368149] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-02T17:10:29.368214] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-02T17:10:29.369057] [DEBUG] [LOCAL ] ALG: Trimmed 15892 records to 10293 (keeping 200 days of data) [2025-10-02T17:10:29.451128] [DEBUG] [LOCAL ] ALG: Primary data saved (10293 records). [2025-10-02T17:10:29.451290] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-02T17:10:29.451457] [INFO ] [MAIN ] Update Progress: 81/2370 symbols completed. ALG took 23.9s. Estimated remaining: 4h 54m 40s. Rate: 7.8 symbols/min [2025-10-02T17:10:29.670002] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:29.730329] [DEBUG] [LOCAL ] ALL: Loaded 50049 existing records from primary storage. [2025-10-02T17:10:29.730830] [INFO ] [MAIN ] ALL: Loaded 50049 existing records. [2025-10-02T17:10:29.878359] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-02T17:10:30.051681] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:30.051985] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-02T17:10:30.052050] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-02T17:10:30.053369] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-10-02T17:10:30.053452] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-02T17:10:30.659078] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:30.672995] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-02T17:10:30.720284] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T17:10:31.128817] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T17:10:31.472995] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-02T17:10:32.272984] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-10-02T17:10:32.588913] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-02T17:10:33.037032] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T17:10:33.073024] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-02T17:10:33.872993] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-02T17:10:34.100301] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T17:10:34.672987] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-02T17:10:34.920899] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T17:10:35.397920] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T17:10:35.472992] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-02T17:10:35.549576] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:10:35.551219] [INFO ] [REMOTE ] ALEX: Full fetch complete (44583 records). [2025-10-02T17:10:35.551306] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-02T17:10:35.986755] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-02T17:10:35.986847] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-02T17:10:35.987394] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-02T17:10:35.987449] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-02T17:10:35.988822] [DEBUG] [LOCAL ] ALEX: Trimmed 44583 records to 31342 (keeping 200 days of data) [2025-10-02T17:10:36.192472] [DEBUG] [LOCAL ] ALEX: Primary data saved (31342 records). [2025-10-02T17:10:36.192614] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-02T17:10:36.192725] [INFO ] [MAIN ] Update Progress: 82/2370 symbols completed. ALEX took 30.6s. Estimated remaining: 4h 54m 5s. Rate: 7.8 symbols/min [2025-10-02T17:10:36.278127] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-02T17:10:36.378221] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:36.427190] [DEBUG] [LOCAL ] ALLE: Loaded 44729 existing records from primary storage. [2025-10-02T17:10:36.427535] [INFO ] [MAIN ] ALLE: Loaded 44729 existing records. [2025-10-02T17:10:36.626629] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:36.626958] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-02T17:10:36.627023] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-02T17:10:36.628428] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-10-02T17:10:36.628491] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-02T17:10:37.018304] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:37.073007] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-10-02T17:10:37.214607] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T17:10:37.837478] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T17:10:37.840024] [INFO ] [REMOTE ] ALIT: Full fetch complete (76426 records). [2025-10-02T17:10:37.840211] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-02T17:10:37.880434] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-02T17:10:38.289733] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-02T17:10:38.289871] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-02T17:10:38.290677] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-02T17:10:38.290743] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-02T17:10:38.292276] [DEBUG] [LOCAL ] ALIT: Trimmed 76426 records to 53155 (keeping 200 days of data) [2025-10-02T17:10:38.627071] [DEBUG] [LOCAL ] ALIT: Primary data saved (53155 records). [2025-10-02T17:10:38.627223] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-02T17:10:38.628422] [INFO ] [MAIN ] Update Progress: 83/2370 symbols completed. ALIT took 33.0s. Estimated remaining: 4h 51m 32s. Rate: 7.8 symbols/min [2025-10-02T17:10:38.678234] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-02T17:10:38.837699] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:38.865017] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T17:10:38.925823] [DEBUG] [LOCAL ] ALLY: Loaded 53217 existing records from primary storage. [2025-10-02T17:10:38.926224] [INFO ] [MAIN ] ALLY: Loaded 53217 existing records. [2025-10-02T17:10:39.118749] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:39.119028] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-02T17:10:39.119091] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-02T17:10:39.120408] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-10-02T17:10:39.120471] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-02T17:10:39.474709] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-02T17:10:39.530298] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:39.562594] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T17:10:40.273008] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-10-02T17:10:40.321074] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T17:10:41.073021] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-02T17:10:41.124501] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T17:10:41.836673] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T17:10:41.872966] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-02T17:10:42.564393] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T17:10:42.672988] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-02T17:10:43.400011] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T17:10:43.473068] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-02T17:10:44.273024] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-02T17:10:44.454288] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-02T17:10:44.456520] [INFO ] [REMOTE ] ALK: Full fetch complete (76834 records). [2025-10-02T17:10:44.456719] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-02T17:10:44.911874] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-02T17:10:44.911968] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-02T17:10:44.912737] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-02T17:10:44.912801] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-02T17:10:44.914438] [DEBUG] [LOCAL ] ALK: Trimmed 76834 records to 53444 (keeping 200 days of data) [2025-10-02T17:10:45.091180] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-02T17:10:45.258239] [DEBUG] [LOCAL ] ALK: Primary data saved (53444 records). [2025-10-02T17:10:45.258402] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-02T17:10:45.258605] [INFO ] [MAIN ] Update Progress: 84/2370 symbols completed. ALK took 39.7s. Estimated remaining: 4h 50m 56s. Rate: 7.9 symbols/min [2025-10-02T17:10:45.482184] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:10:45.515918] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-02T17:10:45.567293] [DEBUG] [LOCAL ] ALSN: Loaded 43288 existing records from primary storage. [2025-10-02T17:10:45.567601] [INFO ] [MAIN ] ALSN: Loaded 43288 existing records. [2025-10-02T17:10:45.772991] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:10:45.773448] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-02T17:10:45.773567] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-02T17:10:45.774866] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-02T17:10:45.774928] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-02T17:10:45.879905] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-02T17:10:46.192784] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:10:46.221074] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-02T17:10:46.552566] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T17:10:46.673010] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-10-02T17:10:47.473012] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-02T17:10:47.634228] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T17:10:48.273015] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-02T17:10:48.486869] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T17:10:49.073011] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-02T17:10:49.451829] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T17:10:49.743695] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:10:49.873001] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-02T17:10:50.567380] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T17:10:50.673052] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-02T17:10:51.473047] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-02T17:10:51.642805] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T17:10:52.273037] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-02T17:10:52.403464] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T17:10:53.072968] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-02T17:10:53.417098] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T17:10:53.873034] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-02T17:10:54.258500] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T17:10:54.673356] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-02T17:10:54.676796] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T17:10:55.473012] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-02T17:10:55.722443] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T17:10:56.273000] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-02T17:10:56.366342] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T17:10:56.768200] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T17:10:57.073048] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-02T17:10:57.872999] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-02T17:10:58.061860] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T17:10:58.673050] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-02T17:10:58.801354] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T17:10:59.187545] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T17:10:59.473051] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-02T17:11:00.206151] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T17:11:00.272978] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-02T17:11:01.073046] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-02T17:11:01.523739] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T17:11:01.873043] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-02T17:11:02.468660] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-02T17:11:02.626512] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T17:11:02.629348] [INFO ] [REMOTE ] ALL: Full fetch complete (72464 records). [2025-10-02T17:11:02.629558] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-02T17:11:02.678148] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-02T17:11:03.070347] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-02T17:11:03.070472] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-02T17:11:03.071398] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-02T17:11:03.071498] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-02T17:11:03.073243] [DEBUG] [LOCAL ] ALL: Trimmed 72464 records to 50411 (keeping 200 days of data) [2025-10-02T17:11:03.423742] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T17:11:03.450350] [DEBUG] [LOCAL ] ALL: Primary data saved (50411 records). [2025-10-02T17:11:03.450478] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-02T17:11:03.453340] [INFO ] [MAIN ] Update Progress: 85/2370 symbols completed. ALL took 34.0s. Estimated remaining: 4h 55m 33s. Rate: 7.7 symbols/min [2025-10-02T17:11:03.478194] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-02T17:11:03.643176] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:03.671041] [DEBUG] [LOCAL ] ALTG: Loaded 23483 existing records from primary storage. [2025-10-02T17:11:03.671323] [INFO ] [MAIN ] ALTG: Loaded 23483 existing records. [2025-10-02T17:11:03.874935] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:03.875214] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-02T17:11:03.875276] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-02T17:11:03.876066] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-02T17:11:03.876161] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-02T17:11:04.295282] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:04.286023] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-02T17:11:04.471047] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T17:11:04.990504] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:11:05.072999] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-02T17:11:05.819459] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T17:11:05.873044] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-10-02T17:11:06.673020] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-02T17:11:06.782332] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T17:11:07.188323] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T17:11:07.473043] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-02T17:11:08.070151] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T17:11:08.073809] [INFO ] [REMOTE ] ALLE: Full fetch complete (64767 records). [2025-10-02T17:11:08.073955] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-02T17:11:08.278243] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-02T17:11:08.514371] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-10-02T17:11:08.514462] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-10-02T17:11:08.515187] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-10-02T17:11:08.515252] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-10-02T17:11:08.516639] [DEBUG] [LOCAL ] ALLE: Trimmed 64767 records to 45033 (keeping 200 days of data) [2025-10-02T17:11:08.821829] [DEBUG] [LOCAL ] ALLE: Primary data saved (45033 records). [2025-10-02T17:11:08.821971] [INFO ] [MAIN ] ALLE: Full history saved. [2025-10-02T17:11:08.825505] [INFO ] [MAIN ] Update Progress: 86/2370 symbols completed. ALLE took 32.6s. Estimated remaining: 4h 54m 21s. Rate: 7.8 symbols/min [2025-10-02T17:11:09.033050] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:09.052405] [DEBUG] [LOCAL ] ALUR: Loaded 10774 existing records from primary storage. [2025-10-02T17:11:09.052757] [INFO ] [MAIN ] ALUR: Loaded 10774 existing records. [2025-10-02T17:11:09.078109] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-02T17:11:09.295362] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:09.295923] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-02T17:11:09.299145] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T17:11:09.296509] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-02T17:11:09.308903] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-02T17:11:09.309063] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-02T17:11:09.479626] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T17:11:09.721586] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:09.873010] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-10-02T17:11:10.672996] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-02T17:11:11.023352] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T17:11:11.275473] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T17:11:11.473010] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-02T17:11:11.833890] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T17:11:12.273042] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-02T17:11:13.073031] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-02T17:11:13.280163] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-02T17:11:13.282254] [INFO ] [REMOTE ] ALLY: Full fetch complete (76912 records). [2025-10-02T17:11:13.282377] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-02T17:11:13.745951] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-02T17:11:13.746053] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-02T17:11:13.746869] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-02T17:11:13.746942] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-02T17:11:13.748631] [DEBUG] [LOCAL ] ALLY: Trimmed 76912 records to 53605 (keeping 200 days of data) [2025-10-02T17:11:13.873482] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-02T17:11:14.050228] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T17:11:14.162930] [DEBUG] [LOCAL ] ALLY: Primary data saved (53605 records). [2025-10-02T17:11:14.163078] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-02T17:11:14.163213] [INFO ] [MAIN ] Update Progress: 87/2370 symbols completed. ALLY took 35.5s. Estimated remaining: 4h 53m 11s. Rate: 7.8 symbols/min [2025-10-02T17:11:14.303858] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T17:11:14.385442] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:14.442345] [DEBUG] [LOCAL ] ALV: Loaded 42369 existing records from primary storage. [2025-10-02T17:11:14.442668] [INFO ] [MAIN ] ALV: Loaded 42369 existing records. [2025-10-02T17:11:14.642399] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:14.642658] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-02T17:11:14.642724] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-02T17:11:14.643892] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-02T17:11:14.643956] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-02T17:11:14.678166] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-02T17:11:15.030502] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:15.280806] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T17:11:15.472997] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-02T17:11:15.846869] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T17:11:16.273062] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-10-02T17:11:16.339169] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T17:11:17.073000] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-02T17:11:17.873016] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-02T17:11:17.931942] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T17:11:18.338383] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-02T17:11:18.672992] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-02T17:11:19.309606] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T17:11:19.473013] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-02T17:11:20.272989] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-02T17:11:20.308185] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T17:11:20.763734] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T17:11:21.072999] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-02T17:11:21.809334] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T17:11:21.873025] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-02T17:11:21.916525] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T17:11:22.673081] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-02T17:11:23.481949] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-02T17:11:23.487237] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T17:11:23.596137] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T17:11:24.272981] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-02T17:11:24.510201] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:11:25.073065] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-02T17:11:25.533609] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T17:11:25.535756] [INFO ] [REMOTE ] ALSN: Full fetch complete (62191 records). [2025-10-02T17:11:25.535914] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-02T17:11:25.874098] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-02T17:11:26.002767] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-02T17:11:26.002929] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-02T17:11:26.003743] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-02T17:11:26.003885] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-02T17:11:26.012122] [DEBUG] [LOCAL ] ALSN: Trimmed 62191 records to 43607 (keeping 200 days of data) [2025-10-02T17:11:26.024480] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T17:11:26.323197] [DEBUG] [LOCAL ] ALSN: Primary data saved (43607 records). [2025-10-02T17:11:26.323331] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-02T17:11:26.323430] [INFO ] [MAIN ] Update Progress: 88/2370 symbols completed. ALSN took 41.1s. Estimated remaining: 4h 54m 59s. Rate: 7.7 symbols/min [2025-10-02T17:11:26.514966] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:26.526362] [DEBUG] [LOCAL ] ALX: Loaded 6227 existing records from primary storage. [2025-10-02T17:11:26.526592] [INFO ] [MAIN ] ALX: Loaded 6227 existing records. [2025-10-02T17:11:26.678151] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-02T17:11:26.724795] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:26.725014] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-02T17:11:26.725065] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-02T17:11:26.725503] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-10-02T17:11:26.725564] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-02T17:11:27.125552] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:27.472988] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-02T17:11:27.664989] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T17:11:27.708494] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T17:11:28.270160] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T17:11:28.275701] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-10-02T17:11:28.934413] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-02T17:11:29.073008] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-02T17:11:29.873007] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-02T17:11:30.673048] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-02T17:11:30.836740] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:11:31.105871] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T17:11:31.175445] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T17:11:31.473032] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-02T17:11:32.013333] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-02T17:11:32.273007] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-02T17:11:33.073027] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-02T17:11:33.157511] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:11:33.160238] [INFO ] [REMOTE ] ALTG: Full fetch complete (33698 records). [2025-10-02T17:11:33.160369] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-02T17:11:33.600068] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-02T17:11:33.600404] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-02T17:11:33.600930] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-02T17:11:33.600998] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-02T17:11:33.602034] [DEBUG] [LOCAL ] ALTG: Trimmed 33698 records to 23685 (keeping 200 days of data) [2025-10-02T17:11:33.741573] [DEBUG] [LOCAL ] ALTG: Primary data saved (23685 records). [2025-10-02T17:11:33.741732] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-02T17:11:33.741823] [INFO ] [MAIN ] Update Progress: 89/2370 symbols completed. ALTG took 30.3s. Estimated remaining: 4h 54m 42s. Rate: 7.7 symbols/min [2025-10-02T17:11:33.878178] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-02T17:11:33.940699] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:33.998146] [DEBUG] [LOCAL ] AM: Loaded 52063 existing records from primary storage. [2025-10-02T17:11:33.998535] [INFO ] [MAIN ] AM: Loaded 52063 existing records. [2025-10-02T17:11:34.194663] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:34.194887] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-02T17:11:34.194970] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-02T17:11:34.196542] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-02T17:11:34.196604] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-02T17:11:34.623060] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T17:11:34.629545] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:34.672977] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-02T17:11:34.748004] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T17:11:35.473040] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-02T17:11:35.935867] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T17:11:35.951314] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T17:11:36.273029] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-02T17:11:36.796636] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-02T17:11:37.073057] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-02T17:11:37.873010] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-02T17:11:38.550700] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T17:11:38.573875] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-02T17:11:38.673066] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-02T17:11:39.415587] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T17:11:39.473028] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-10-02T17:11:40.273022] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-02T17:11:41.000351] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-02T17:11:41.001957] [INFO ] [REMOTE ] ALUR: Full fetch complete (20295 records). [2025-10-02T17:11:41.002102] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-02T17:11:41.078903] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-02T17:11:41.434086] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-02T17:11:41.434291] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-02T17:11:41.434710] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-02T17:11:41.434817] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-02T17:11:41.435777] [DEBUG] [LOCAL ] ALUR: Trimmed 20295 records to 10816 (keeping 200 days of data) [2025-10-02T17:11:41.536052] [DEBUG] [LOCAL ] ALUR: Primary data saved (10816 records). [2025-10-02T17:11:41.523191] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T17:11:41.536359] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-02T17:11:41.549200] [INFO ] [MAIN ] Update Progress: 90/2370 symbols completed. ALUR took 32.7s. Estimated remaining: 4h 54m 36s. Rate: 7.7 symbols/min [2025-10-02T17:11:41.743776] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:41.786718] [DEBUG] [LOCAL ] AMBC: Loaded 36580 existing records from primary storage. [2025-10-02T17:11:41.787003] [INFO ] [MAIN ] AMBC: Loaded 36580 existing records. [2025-10-02T17:11:41.878190] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-02T17:11:41.985997] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:41.986216] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-02T17:11:41.986269] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-02T17:11:41.987224] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-02T17:11:41.987287] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-02T17:11:42.425476] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:42.429735] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T17:11:42.672981] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-02T17:11:42.781158] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T17:11:43.473043] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-02T17:11:44.094322] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-02T17:11:44.126146] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T17:11:44.273035] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-10-02T17:11:45.073020] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-02T17:11:45.610988] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T17:11:45.872990] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-02T17:11:46.672978] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-02T17:11:46.782579] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T17:11:47.105617] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T17:11:47.473023] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-02T17:11:48.043861] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:11:48.273006] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-02T17:11:48.387726] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T17:11:49.073035] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-02T17:11:49.851895] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T17:11:49.870242] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-02T17:11:49.872940] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-02T17:11:50.638934] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T17:11:50.672976] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-02T17:11:51.473033] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-02T17:11:51.922170] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T17:11:51.924093] [INFO ] [REMOTE ] ALV: Full fetch complete (61807 records). [2025-10-02T17:11:51.924205] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-02T17:11:52.278407] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-02T17:11:52.363107] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-02T17:11:52.363195] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-02T17:11:52.363872] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-02T17:11:52.363936] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-02T17:11:52.365278] [DEBUG] [LOCAL ] ALV: Trimmed 61807 records to 42666 (keeping 200 days of data) [2025-10-02T17:11:52.650918] [DEBUG] [LOCAL ] ALV: Primary data saved (42666 records). [2025-10-02T17:11:52.651050] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-02T17:11:52.651134] [INFO ] [MAIN ] Update Progress: 91/2370 symbols completed. ALV took 38.5s. Estimated remaining: 4h 55m 52s. Rate: 7.7 symbols/min [2025-10-02T17:11:52.853171] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:52.853992] [DEBUG] [LOCAL ] AMBP: No existing data file found in primary storage. [2025-10-02T17:11:52.854062] [WARN ] [MAIN ] AMBP: No existing data found, performing full refresh instead. [2025-10-02T17:11:52.854224] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-02T17:11:52.854280] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-02T17:11:52.854335] [DEBUG] [LOCAL ] AMBP: No primary data file found to delete. [2025-10-02T17:11:52.854392] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-02T17:11:53.051586] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T17:11:53.078917] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-02T17:11:53.291789] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:53.350766] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T17:11:53.873004] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-02T17:11:54.396033] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T17:11:54.673054] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-02T17:11:55.357821] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T17:11:55.358980] [INFO ] [REMOTE ] ALX: Full fetch complete (7160 records). [2025-10-02T17:11:55.359066] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-02T17:11:55.475801] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-02T17:11:55.783581] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-02T17:11:55.783802] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-02T17:11:55.784024] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-02T17:11:55.784141] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-02T17:11:55.794694] [DEBUG] [LOCAL ] ALX: Trimmed 7160 records to 6303 (keeping 200 days of data) [2025-10-02T17:11:55.832458] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T17:11:55.867754] [DEBUG] [LOCAL ] ALX: Primary data saved (6303 records). [2025-10-02T17:11:55.867890] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-02T17:11:55.867971] [INFO ] [MAIN ] Update Progress: 92/2370 symbols completed. ALX took 29.5s. Estimated remaining: 4h 53m 51s. Rate: 7.8 symbols/min [2025-10-02T17:11:56.053412] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:56.053568] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-02T17:11:56.053608] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-02T17:11:56.053742] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-02T17:11:56.053790] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-02T17:11:56.053833] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-02T17:11:56.053866] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-02T17:11:56.282862] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-10-02T17:11:56.443241] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:56.990919] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T17:11:57.073045] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-10-02T17:11:57.330142] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:11:57.330460] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-10-02T17:11:57.330552] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:11:57.330609] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-02T17:11:57.330703] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:11:57.330780] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-02T17:11:57.330845] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-02T17:11:57.330882] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-02T17:11:57.330924] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-02T17:11:57.330974] [INFO ] [MAIN ] Update Progress: 93/2370 symbols completed. AMBQ took 1.5s. Estimated remaining: 4h 51m 10s. Rate: 7.8 symbols/min [2025-10-02T17:11:57.518324] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:11:57.575445] [DEBUG] [LOCAL ] AMC: Loaded 53760 existing records from primary storage. [2025-10-02T17:11:57.575842] [INFO ] [MAIN ] AMC: Loaded 53760 existing records. [2025-10-02T17:11:57.785480] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:11:57.785789] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-02T17:11:57.785864] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-02T17:11:57.796388] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-02T17:11:57.812798] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-02T17:11:57.849549] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T17:11:57.875268] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-02T17:11:58.223166] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:11:58.673023] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-10-02T17:11:59.472986] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-02T17:11:59.576501] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T17:12:00.273038] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-02T17:12:01.073004] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-02T17:12:01.104768] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:12:01.517337] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-10-02T17:12:01.873883] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-02T17:12:01.877709] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T17:12:02.425764] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T17:12:02.673054] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-02T17:12:03.446041] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T17:12:03.472965] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-02T17:12:04.035176] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T17:12:04.273010] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-02T17:12:05.073048] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-02T17:12:05.633594] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T17:12:05.873013] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-02T17:12:05.942487] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-10-02T17:12:06.673036] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-02T17:12:07.417951] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T17:12:07.472983] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-02T17:12:07.557023] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-02T17:12:08.273003] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-02T17:12:08.655587] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-02T17:12:08.860195] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T17:12:09.073007] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-02T17:12:09.717399] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T17:12:09.873031] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-02T17:12:10.469466] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T17:12:10.673044] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-02T17:12:10.780396] [DEBUG] [REMOTE ] AMBC: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-02T17:12:10.780938] [WARN ] [REMOTE ] AMBC: No data returned for month 2025-08 [2025-10-02T17:12:10.781093] [FATAL] [REMOTE ] AMBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:12:10.781266] [FATAL] [MAIN ] AMBC: Failed to fetch primary data. [2025-10-02T17:12:10.781341] [WARN ] [MAIN ] AMBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:12:10.781429] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-02T17:12:10.781499] [DEBUG] [LOCAL ] AMBC: No primary data file found to delete. [2025-10-02T17:12:10.781539] [INFO ] [LOCAL ] AMBC: Starting deletion of derivative data. [2025-10-02T17:12:10.782078] [DEBUG] [LOCAL ] AMBC: Deleted derivative data file. [2025-10-02T17:12:10.783624] [INFO ] [MAIN ] Update Progress: 94/2370 symbols completed. AMBC took 29.2s. Estimated remaining: 4h 53m 22s. Rate: 7.8 symbols/min [2025-10-02T17:12:10.972359] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:11.034485] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-10-02T17:12:11.034857] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-10-02T17:12:11.244844] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:11.245217] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-02T17:12:11.245274] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-02T17:12:11.246789] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-02T17:12:11.246853] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-02T17:12:11.480707] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-02T17:12:11.647343] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:11.677821] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:12:12.273017] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-02T17:12:12.796099] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T17:12:13.073017] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-02T17:12:13.872986] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-02T17:12:14.242350] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T17:12:14.244411] [INFO ] [REMOTE ] AM: Full fetch complete (75588 records). [2025-10-02T17:12:14.244513] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-02T17:12:14.678212] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-10-02T17:12:14.706115] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-10-02T17:12:14.706207] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-10-02T17:12:14.707118] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-10-02T17:12:14.707305] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-10-02T17:12:14.709068] [DEBUG] [LOCAL ] AM: Trimmed 75588 records to 52439 (keeping 200 days of data) [2025-10-02T17:12:15.211414] [DEBUG] [LOCAL ] AM: Primary data saved (52439 records). [2025-10-02T17:12:15.211606] [INFO ] [MAIN ] AM: Full history saved. [2025-10-02T17:12:15.212552] [INFO ] [MAIN ] Update Progress: 95/2370 symbols completed. AM took 41.5s. Estimated remaining: 4h 51m 55s. Rate: 7.8 symbols/min [2025-10-02T17:12:15.491549] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:15.531904] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (3.26 seconds). [2025-10-02T17:12:15.548761] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-02T17:12:15.600822] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T17:12:15.662598] [DEBUG] [LOCAL ] AME: Loaded 48490 existing records from primary storage. [2025-10-02T17:12:15.662985] [INFO ] [MAIN ] AME: Loaded 48490 existing records. [2025-10-02T17:12:15.886715] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:15.887004] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-02T17:12:15.887062] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-02T17:12:15.888729] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-02T17:12:15.888810] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-02T17:12:16.279833] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-02T17:12:16.287148] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:16.742143] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-02T17:12:17.073030] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-10-02T17:12:17.877633] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-02T17:12:17.880915] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:12:18.002369] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-02T17:12:18.672962] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-02T17:12:18.787549] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T17:12:19.093518] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-02T17:12:19.473006] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-02T17:12:20.130593] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T17:12:20.273021] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-02T17:12:21.072978] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-02T17:12:21.230743] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T17:12:21.499943] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T17:12:21.501768] [INFO ] [REMOTE ] AMBP: Full fetch complete (65665 records). [2025-10-02T17:12:21.501888] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-02T17:12:21.878105] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-02T17:12:22.031159] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-02T17:12:22.031274] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-02T17:12:22.031963] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-02T17:12:22.032029] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-02T17:12:22.033397] [DEBUG] [LOCAL ] AMBP: Trimmed 65665 records to 45246 (keeping 200 days of data) [2025-10-02T17:12:22.314236] [DEBUG] [LOCAL ] AMBP: Primary data saved (45246 records). [2025-10-02T17:12:22.314408] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-02T17:12:22.314504] [INFO ] [MAIN ] Update Progress: 96/2370 symbols completed. AMBP took 29.7s. Estimated remaining: 4h 51m 33s. Rate: 7.8 symbols/min [2025-10-02T17:12:22.507065] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:22.532946] [DEBUG] [LOCAL ] AMG: Loaded 20419 existing records from primary storage. [2025-10-02T17:12:22.533570] [INFO ] [MAIN ] AMG: Loaded 20419 existing records. [2025-10-02T17:12:22.682416] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-02T17:12:22.796102] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:22.796509] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-02T17:12:22.796749] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-02T17:12:22.797538] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-02T17:12:22.797604] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-02T17:12:22.948488] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T17:12:23.242233] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:23.472994] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-10-02T17:12:24.250535] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-02T17:12:24.278831] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-02T17:12:24.292076] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T17:12:24.591262] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T17:12:25.073046] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-02T17:12:25.873001] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-02T17:12:26.673015] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-02T17:12:26.859991] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-02T17:12:26.904031] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T17:12:27.069536] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T17:12:27.473042] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-02T17:12:28.222391] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T17:12:28.273022] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-02T17:12:29.072999] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-02T17:12:29.430827] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T17:12:29.872964] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-02T17:12:30.191543] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T17:12:30.369302] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-02T17:12:30.673039] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-02T17:12:31.473024] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-02T17:12:31.699762] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T17:12:31.738581] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T17:12:32.273008] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-02T17:12:33.073025] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-02T17:12:33.871063] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-02T17:12:33.881834] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-02T17:12:34.103039] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T17:12:34.673042] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-02T17:12:34.920333] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T17:12:34.965721] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T17:12:35.473042] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-02T17:12:36.259323] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T17:12:36.278112] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-02T17:12:36.288760] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T17:12:37.073011] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-02T17:12:37.872990] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-02T17:12:38.282556] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T17:12:38.673050] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-02T17:12:38.977190] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T17:12:39.380973] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T17:12:39.473060] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-02T17:12:39.640971] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T17:12:40.273003] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-02T17:12:40.576125] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T17:12:41.073010] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-02T17:12:41.761320] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T17:12:41.873013] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-02T17:12:42.673059] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-02T17:12:43.145723] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-02T17:12:43.417890] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T17:12:43.473043] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-02T17:12:43.621383] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T17:12:44.273008] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-02T17:12:45.072978] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-02T17:12:45.304559] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-02T17:12:45.306837] [INFO ] [REMOTE ] AMC: Full fetch complete (77924 records). [2025-10-02T17:12:45.307003] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-02T17:12:45.736769] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-02T17:12:45.736860] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-02T17:12:45.737679] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-02T17:12:45.737746] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-02T17:12:45.739343] [DEBUG] [LOCAL ] AMC: Trimmed 77924 records to 54150 (keeping 200 days of data) [2025-10-02T17:12:45.908036] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-02T17:12:45.924189] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-02T17:12:45.954031] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-10-02T17:12:45.954677] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-02T17:12:46.425548] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-02T17:12:46.429238] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-02T17:12:46.430331] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-02T17:12:46.463952] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-02T17:12:46.518106] [DEBUG] [LOCAL ] AMC: Primary data saved (54150 records). [2025-10-02T17:12:46.518320] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 54059 (keeping 200 days of data) [2025-10-02T17:12:46.518681] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-02T17:12:46.519446] [INFO ] [MAIN ] Update Progress: 97/2370 symbols completed. AMC took 49.2s. Estimated remaining: 4h 57m 52s. Rate: 7.6 symbols/min [2025-10-02T17:12:46.815263] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:46.853543] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T17:12:46.867478] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-02T17:12:47.018039] [DEBUG] [LOCAL ] AMH: Loaded 51715 existing records from primary storage. [2025-10-02T17:12:47.019948] [INFO ] [MAIN ] AMH: Loaded 51715 existing records. [2025-10-02T17:12:47.184480] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T17:12:47.266628] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:47.273703] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-02T17:12:47.273984] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-02T17:12:47.310499] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-02T17:12:47.335443] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-02T17:12:47.474950] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-02T17:12:47.500331] [DEBUG] [LOCAL ] AMCR: Primary data saved (54059 records). [2025-10-02T17:12:47.514038] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-02T17:12:47.544674] [INFO ] [MAIN ] Update Progress: 98/2370 symbols completed. AMCR took 36.8s. Estimated remaining: 4h 55m 6s. Rate: 7.7 symbols/min [2025-10-02T17:12:47.966868] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:47.986511] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:48.032260] [DEBUG] [LOCAL ] AMN: Loaded 41777 existing records from primary storage. [2025-10-02T17:12:48.032548] [INFO ] [MAIN ] AMN: Loaded 41777 existing records. [2025-10-02T17:12:48.229551] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:48.229949] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-02T17:12:48.230099] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-02T17:12:48.231143] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-02T17:12:48.231205] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-02T17:12:48.279483] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-10-02T17:12:48.360885] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T17:12:48.425710] [INFO ] [REMOTE ] AMG: Full fetch complete (29801 records). [2025-10-02T17:12:48.500629] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-02T17:12:48.772403] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:49.074684] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-10-02T17:12:49.080553] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-02T17:12:49.134569] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-02T17:12:49.134678] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-02T17:12:49.135129] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-02T17:12:49.135192] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-02T17:12:49.136158] [DEBUG] [LOCAL ] AMG: Trimmed 29801 records to 20522 (keeping 200 days of data) [2025-10-02T17:12:49.273087] [DEBUG] [LOCAL ] AMG: Primary data saved (20522 records). [2025-10-02T17:12:49.273234] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-02T17:12:49.273326] [INFO ] [MAIN ] Update Progress: 99/2370 symbols completed. AMG took 27.0s. Estimated remaining: 4h 52m 39s. Rate: 7.8 symbols/min [2025-10-02T17:12:49.477777] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:49.515119] [DEBUG] [LOCAL ] AMP: Loaded 32225 existing records from primary storage. [2025-10-02T17:12:49.515427] [INFO ] [MAIN ] AMP: Loaded 32225 existing records. [2025-10-02T17:12:49.711511] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:49.711953] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-02T17:12:49.712020] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-02T17:12:49.713229] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-02T17:12:49.713295] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-02T17:12:49.877098] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-02T17:12:50.138595] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:50.169672] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T17:12:50.674475] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-02T17:12:50.680098] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T17:12:51.472969] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-02T17:12:51.553245] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T17:12:51.555308] [INFO ] [REMOTE ] AME: Full fetch complete (69859 records). [2025-10-02T17:12:51.555410] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-02T17:12:52.003857] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-02T17:12:52.004003] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-02T17:12:52.004925] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-02T17:12:52.005015] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-02T17:12:52.006508] [DEBUG] [LOCAL ] AME: Trimmed 69859 records to 48837 (keeping 200 days of data) [2025-10-02T17:12:52.273168] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-10-02T17:12:52.361172] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T17:12:52.382769] [DEBUG] [LOCAL ] AME: Primary data saved (48837 records). [2025-10-02T17:12:52.382923] [INFO ] [MAIN ] AME: Full history saved. [2025-10-02T17:12:52.384559] [INFO ] [MAIN ] Update Progress: 100/2370 symbols completed. AME took 37.2s. Estimated remaining: 4h 50m 47s. Rate: 7.8 symbols/min [2025-10-02T17:12:52.571275] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:12:52.628777] [DEBUG] [LOCAL ] AMPX: Loaded 52297 existing records from primary storage. [2025-10-02T17:12:52.629135] [INFO ] [MAIN ] AMPX: Loaded 52297 existing records. [2025-10-02T17:12:52.842539] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:12:52.842872] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-02T17:12:52.842997] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-02T17:12:52.844450] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-10-02T17:12:52.844530] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-02T17:12:53.066904] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:12:53.073723] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-02T17:12:53.314324] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:12:53.545911] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T17:12:53.872988] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-02T17:12:54.673040] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-10-02T17:12:54.734818] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T17:12:55.002635] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T17:12:55.473046] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-02T17:12:56.272985] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-02T17:12:56.674572] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-02T17:12:56.807789] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T17:12:57.073023] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-02T17:12:57.872984] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-02T17:12:58.135006] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T17:12:58.495675] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T17:12:58.673047] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-02T17:12:59.072342] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T17:12:59.473012] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-02T17:13:00.273004] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-02T17:13:00.434875] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:13:01.072998] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-02T17:13:01.309933] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T17:13:01.796974] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T17:13:01.873041] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-02T17:13:02.673005] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-02T17:13:02.887911] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T17:13:03.281946] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:13:03.473051] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-02T17:13:04.272986] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-02T17:13:04.306128] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T17:13:05.073906] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-02T17:13:05.076665] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T17:13:05.839075] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T17:13:05.872963] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-02T17:13:06.388943] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T17:13:06.673029] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-02T17:13:07.472979] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-02T17:13:07.659895] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T17:13:08.148963] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T17:13:08.273024] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-02T17:13:09.049384] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:13:09.072987] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-02T17:13:09.446576] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-02T17:13:09.873035] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-02T17:13:10.609947] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T17:13:10.673031] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-02T17:13:11.472974] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-02T17:13:11.653877] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T17:13:11.736617] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T17:13:12.273020] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-02T17:13:12.882280] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T17:13:12.890063] [INFO ] [REMOTE ] AMN: Full fetch complete (60379 records). [2025-10-02T17:13:12.890382] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-02T17:13:13.078240] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-02T17:13:13.339316] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-02T17:13:13.339406] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-02T17:13:13.340043] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-02T17:13:13.340132] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-02T17:13:13.342388] [DEBUG] [LOCAL ] AMN: Trimmed 60379 records to 42097 (keeping 200 days of data) [2025-10-02T17:13:13.610814] [DEBUG] [LOCAL ] AMN: Primary data saved (42097 records). [2025-10-02T17:13:13.610956] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-02T17:13:13.611088] [INFO ] [MAIN ] Update Progress: 101/2370 symbols completed. AMN took 26.0s. Estimated remaining: 4h 55m 43s. Rate: 7.7 symbols/min [2025-10-02T17:13:13.807352] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:13.830568] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T17:13:13.883225] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-02T17:13:13.887575] [DEBUG] [LOCAL ] AMPY: Loaded 37804 existing records from primary storage. [2025-10-02T17:13:13.888141] [INFO ] [MAIN ] AMPY: Loaded 37804 existing records. [2025-10-02T17:13:14.091590] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:14.091841] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-02T17:13:14.091891] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-02T17:13:14.092879] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-02T17:13:14.092958] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-02T17:13:14.500584] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:14.672986] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-02T17:13:14.777087] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:13:15.472983] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-02T17:13:15.536369] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T17:13:16.135683] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T17:13:16.273018] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-02T17:13:16.869518] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T17:13:16.872046] [INFO ] [REMOTE ] AMH: Full fetch complete (74797 records). [2025-10-02T17:13:16.872168] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-02T17:13:17.073440] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-02T17:13:17.321539] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-02T17:13:17.321628] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-02T17:13:17.322775] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-02T17:13:17.322847] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-02T17:13:17.324633] [DEBUG] [LOCAL ] AMH: Trimmed 74797 records to 52100 (keeping 200 days of data) [2025-10-02T17:13:17.643523] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T17:13:17.694955] [DEBUG] [LOCAL ] AMH: Primary data saved (52100 records). [2025-10-02T17:13:17.695107] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-02T17:13:17.695194] [INFO ] [MAIN ] Update Progress: 102/2370 symbols completed. AMH took 31.2s. Estimated remaining: 4h 54m 12s. Rate: 7.7 symbols/min [2025-10-02T17:13:17.878404] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-10-02T17:13:17.880964] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:17.926397] [DEBUG] [LOCAL ] AMR: Loaded 28962 existing records from primary storage. [2025-10-02T17:13:17.926755] [INFO ] [MAIN ] AMR: Loaded 28962 existing records. [2025-10-02T17:13:18.126734] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:18.126984] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-02T17:13:18.127086] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-02T17:13:18.127826] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-02T17:13:18.127899] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-02T17:13:18.511863] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:18.672999] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-10-02T17:13:18.983861] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T17:13:19.247701] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-10-02T17:13:19.472993] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-02T17:13:19.837831] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T17:13:20.273011] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-02T17:13:21.072978] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-02T17:13:21.322720] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T17:13:21.534415] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T17:13:21.872974] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-02T17:13:22.228410] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T17:13:22.673113] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-02T17:13:23.472985] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-02T17:13:23.671067] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T17:13:23.861817] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T17:13:23.863396] [INFO ] [REMOTE ] AMP: Full fetch complete (47621 records). [2025-10-02T17:13:23.863497] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-02T17:13:24.282461] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-02T17:13:24.379716] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-02T17:13:24.380733] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-02T17:13:24.382238] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-02T17:13:24.382381] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-02T17:13:24.404926] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T17:13:24.413064] [DEBUG] [LOCAL ] AMP: Trimmed 47621 records to 32439 (keeping 200 days of data) [2025-10-02T17:13:24.709488] [DEBUG] [LOCAL ] AMP: Primary data saved (32439 records). [2025-10-02T17:13:24.709721] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-02T17:13:24.711201] [INFO ] [MAIN ] Update Progress: 103/2370 symbols completed. AMP took 35.4s. Estimated remaining: 4h 53m 47s. Rate: 7.7 symbols/min [2025-10-02T17:13:24.945012] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:25.004839] [DEBUG] [LOCAL ] AMRC: Loaded 38146 existing records from primary storage. [2025-10-02T17:13:25.005321] [INFO ] [MAIN ] AMRC: Loaded 38146 existing records. [2025-10-02T17:13:25.078268] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-02T17:13:25.247337] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:25.247631] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-02T17:13:25.247720] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-02T17:13:25.248867] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-02T17:13:25.249000] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-02T17:13:25.715208] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:25.872979] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-10-02T17:13:26.156326] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T17:13:26.184550] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:13:26.673003] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-02T17:13:27.359033] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T17:13:27.472993] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-02T17:13:27.830590] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T17:13:28.273031] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-02T17:13:28.756705] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T17:13:29.073052] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-02T17:13:29.317985] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T17:13:29.873000] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-02T17:13:30.673040] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-02T17:13:31.291333] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-02T17:13:31.473030] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-02T17:13:31.544463] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:13:31.691487] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T17:13:32.273003] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-02T17:13:33.073044] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-02T17:13:33.564981] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-02T17:13:33.863298] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T17:13:33.872949] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-02T17:13:34.636679] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T17:13:34.673005] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-02T17:13:35.446231] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T17:13:35.472964] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-02T17:13:36.272989] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-02T17:13:36.431276] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-02T17:13:36.434198] [INFO ] [REMOTE ] AMPX: Full fetch complete (74712 records). [2025-10-02T17:13:36.434375] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-02T17:13:36.906449] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-10-02T17:13:36.906627] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-10-02T17:13:36.907489] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-10-02T17:13:36.907542] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-10-02T17:13:36.909113] [DEBUG] [LOCAL ] AMPX: Trimmed 74712 records to 52687 (keeping 200 days of data) [2025-10-02T17:13:37.097625] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-02T17:13:37.153298] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T17:13:37.270837] [DEBUG] [LOCAL ] AMPX: Primary data saved (52687 records). [2025-10-02T17:13:37.270983] [INFO ] [MAIN ] AMPX: Full history saved. [2025-10-02T17:13:37.271727] [INFO ] [MAIN ] Update Progress: 104/2370 symbols completed. AMPX took 44.9s. Estimated remaining: 4h 55m 24s. Rate: 7.7 symbols/min [2025-10-02T17:13:37.462615] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:37.462974] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-02T17:13:37.463068] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-02T17:13:37.463253] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-02T17:13:37.463304] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-02T17:13:37.463368] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-02T17:13:37.463432] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-02T17:13:37.881548] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-02T17:13:37.941318] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:37.965149] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T17:13:38.176575] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T17:13:38.673036] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-10-02T17:13:38.884531] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:13:38.884923] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-10-02T17:13:38.885027] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:13:38.885078] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-02T17:13:38.885113] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:13:38.885187] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-02T17:13:38.885271] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-02T17:13:38.885327] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-02T17:13:38.885389] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-02T17:13:38.885457] [INFO ] [MAIN ] Update Progress: 105/2370 symbols completed. AMRZ took 1.6s. Estimated remaining: 4h 53m 2s. Rate: 7.7 symbols/min [2025-10-02T17:13:39.081226] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:39.140481] [DEBUG] [LOCAL ] AMT: Loaded 52425 existing records from primary storage. [2025-10-02T17:13:39.140867] [INFO ] [MAIN ] AMT: Loaded 52425 existing records. [2025-10-02T17:13:39.349424] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:39.366865] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-02T17:13:39.367573] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-02T17:13:39.368310] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T17:13:39.370741] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-02T17:13:39.375255] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-02T17:13:39.478147] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-02T17:13:39.804276] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:40.273043] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-02T17:13:40.828399] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T17:13:41.072998] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-02T17:13:41.674579] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:13:41.872995] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-02T17:13:42.457078] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T17:13:42.672999] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-02T17:13:43.435948] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T17:13:43.472963] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-02T17:13:44.069311] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T17:13:44.273015] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-10-02T17:13:45.065499] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T17:13:45.073638] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-02T17:13:45.650430] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T17:13:45.872984] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-02T17:13:46.672991] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-02T17:13:46.768244] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T17:13:47.473036] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-02T17:13:47.867619] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-02T17:13:47.955270] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T17:13:48.273011] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-02T17:13:48.860828] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T17:13:49.073000] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-02T17:13:49.143344] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T17:13:49.872998] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-02T17:13:50.259736] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T17:13:50.261426] [INFO ] [REMOTE ] AMRC: Full fetch complete (53061 records). [2025-10-02T17:13:50.261511] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-02T17:13:50.667091] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-02T17:13:50.667405] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-02T17:13:50.668122] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-02T17:13:50.668188] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-02T17:13:50.669423] [DEBUG] [LOCAL ] AMRC: Trimmed 53061 records to 38431 (keeping 200 days of data) [2025-10-02T17:13:50.673012] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-02T17:13:50.904866] [DEBUG] [LOCAL ] AMRC: Primary data saved (38431 records). [2025-10-02T17:13:50.905069] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-02T17:13:50.905237] [INFO ] [MAIN ] Update Progress: 106/2370 symbols completed. AMRC took 26.2s. Estimated remaining: 4h 54m 25s. Rate: 7.7 symbols/min [2025-10-02T17:13:51.107728] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:51.109570] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T17:13:51.137845] [DEBUG] [LOCAL ] AMTB: Loaded 20347 existing records from primary storage. [2025-10-02T17:13:51.138190] [INFO ] [MAIN ] AMTB: Loaded 20347 existing records. [2025-10-02T17:13:51.345131] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:51.345357] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-02T17:13:51.345408] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-02T17:13:51.346233] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-02T17:13:51.346297] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-02T17:13:51.478142] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-02T17:13:51.773007] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:52.273001] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-10-02T17:13:52.306197] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T17:13:52.445801] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T17:13:52.447249] [INFO ] [REMOTE ] AMR: Full fetch complete (40101 records). [2025-10-02T17:13:52.447334] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-02T17:13:52.866531] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-02T17:13:52.866615] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-02T17:13:52.867146] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-02T17:13:52.867206] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-02T17:13:52.868284] [DEBUG] [LOCAL ] AMR: Trimmed 40101 records to 29181 (keeping 200 days of data) [2025-10-02T17:13:53.051851] [DEBUG] [LOCAL ] AMR: Primary data saved (29181 records). [2025-10-02T17:13:53.052003] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-02T17:13:53.052134] [INFO ] [MAIN ] Update Progress: 107/2370 symbols completed. AMR took 35.4s. Estimated remaining: 4h 52m 18s. Rate: 7.7 symbols/min [2025-10-02T17:13:53.083440] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-02T17:13:53.248620] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:53.254722] [DEBUG] [LOCAL ] AMTD: Loaded 3610 existing records from primary storage. [2025-10-02T17:13:53.254944] [INFO ] [MAIN ] AMTD: Loaded 3610 existing records. [2025-10-02T17:13:53.477671] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:53.477968] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-02T17:13:53.478109] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-02T17:13:53.478489] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-02T17:13:53.478552] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-02T17:13:53.696468] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:13:53.878092] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-02T17:13:53.909284] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:54.221785] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T17:13:54.224519] [INFO ] [REMOTE ] AMPY: Full fetch complete (51441 records). [2025-10-02T17:13:54.224618] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-02T17:13:54.664850] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-10-02T17:13:54.664969] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-10-02T17:13:54.665575] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-10-02T17:13:54.665692] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-10-02T17:13:54.667436] [DEBUG] [LOCAL ] AMPY: Trimmed 51441 records to 38186 (keeping 200 days of data) [2025-10-02T17:13:54.673049] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-10-02T17:13:54.902943] [DEBUG] [LOCAL ] AMPY: Primary data saved (38186 records). [2025-10-02T17:13:54.903092] [INFO ] [MAIN ] AMPY: Full history saved. [2025-10-02T17:13:54.904270] [INFO ] [MAIN ] Update Progress: 108/2370 symbols completed. AMPY took 41.3s. Estimated remaining: 4h 50m 7s. Rate: 7.8 symbols/min [2025-10-02T17:13:55.091440] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:13:55.150154] [DEBUG] [LOCAL ] AMTM: Loaded 50643 existing records from primary storage. [2025-10-02T17:13:55.150494] [INFO ] [MAIN ] AMTM: Loaded 50643 existing records. [2025-10-02T17:13:55.353865] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:13:55.354185] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-02T17:13:55.354252] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-02T17:13:55.355489] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-02T17:13:55.355553] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-02T17:13:55.472928] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T17:13:55.473037] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-02T17:13:55.751679] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-02T17:13:55.843947] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:13:56.273047] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-10-02T17:13:56.578266] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:13:57.073017] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-02T17:13:57.873006] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-02T17:13:58.184312] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T17:13:58.185412] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T17:13:58.673046] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-02T17:13:59.132037] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T17:13:59.472972] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-02T17:13:59.511081] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T17:14:00.061758] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T17:14:00.273010] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-02T17:14:01.073014] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-02T17:14:01.872980] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-02T17:14:02.025754] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T17:14:02.338152] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-02T17:14:02.651306] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T17:14:02.672969] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-02T17:14:03.473003] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-02T17:14:04.273028] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-02T17:14:04.557501] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T17:14:05.072976] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-02T17:14:05.152613] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T17:14:05.177515] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T17:14:05.872999] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-02T17:14:06.645057] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T17:14:06.672967] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-02T17:14:07.275258] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T17:14:07.473004] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-02T17:14:08.273001] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-02T17:14:08.576624] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-02T17:14:08.751713] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T17:14:08.767133] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-02T17:14:09.072997] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-02T17:14:09.872998] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-02T17:14:10.406623] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-02T17:14:10.494983] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T17:14:10.672998] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-02T17:14:11.473021] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-02T17:14:11.761577] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T17:14:12.273014] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-02T17:14:13.072963] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-02T17:14:13.297595] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T17:14:13.872976] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-02T17:14:14.074246] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T17:14:14.131302] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T17:14:14.616054] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T17:14:14.673004] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-02T17:14:15.473005] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-02T17:14:16.197341] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T17:14:16.272988] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-02T17:14:16.544693] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T17:14:16.809921] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-02T17:14:17.073049] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-02T17:14:17.659605] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T17:14:17.872999] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-02T17:14:18.673012] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-02T17:14:19.167427] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:14:19.473017] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-02T17:14:20.271206] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:14:20.281324] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-02T17:14:20.534225] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T17:14:21.073016] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-02T17:14:21.829687] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T17:14:21.872984] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-02T17:14:21.976591] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:14:22.586841] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:14:22.588201] [INFO ] [REMOTE ] AMTB: Full fetch complete (29908 records). [2025-10-02T17:14:22.588278] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-02T17:14:22.678189] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-02T17:14:23.002470] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-02T17:14:23.002582] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-02T17:14:23.003018] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-02T17:14:23.003081] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-02T17:14:23.004146] [DEBUG] [LOCAL ] AMTB: Trimmed 29908 records to 20465 (keeping 200 days of data) [2025-10-02T17:14:23.133093] [DEBUG] [LOCAL ] AMTB: Primary data saved (20465 records). [2025-10-02T17:14:23.133222] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-02T17:14:23.133305] [INFO ] [MAIN ] Update Progress: 109/2370 symbols completed. AMTB took 32.2s. Estimated remaining: 4h 57m 5s. Rate: 7.6 symbols/min [2025-10-02T17:14:23.324167] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:14:23.334186] [DEBUG] [LOCAL ] AMWL: Loaded 8847 existing records from primary storage. [2025-10-02T17:14:23.334406] [INFO ] [MAIN ] AMWL: Loaded 8847 existing records. [2025-10-02T17:14:23.478149] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-02T17:14:23.537730] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:14:23.538240] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-02T17:14:23.538298] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-02T17:14:23.538639] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-10-02T17:14:23.538728] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-02T17:14:23.947424] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:14:24.273005] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-10-02T17:14:24.313881] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T17:14:24.449093] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-02T17:14:24.454050] [INFO ] [REMOTE ] AMT: Full fetch complete (76012 records). [2025-10-02T17:14:24.454194] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-02T17:14:24.894071] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-02T17:14:24.894169] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-02T17:14:24.895010] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-02T17:14:24.895079] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-02T17:14:24.896766] [DEBUG] [LOCAL ] AMT: Trimmed 76012 records to 52808 (keeping 200 days of data) [2025-10-02T17:14:25.008450] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-02T17:14:25.108305] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-02T17:14:25.273616] [DEBUG] [LOCAL ] AMT: Primary data saved (52808 records). [2025-10-02T17:14:25.273800] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-02T17:14:25.274460] [INFO ] [MAIN ] Update Progress: 110/2370 symbols completed. AMT took 46.4s. Estimated remaining: 4h 54m 59s. Rate: 7.7 symbols/min [2025-10-02T17:14:25.466814] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:14:25.517568] [DEBUG] [LOCAL ] AMX: Loaded 49131 existing records from primary storage. [2025-10-02T17:14:25.517941] [INFO ] [MAIN ] AMX: Loaded 49131 existing records. [2025-10-02T17:14:25.729327] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:14:25.729620] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-02T17:14:25.729723] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-02T17:14:25.731102] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-02T17:14:25.731167] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-02T17:14:25.774544] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-02T17:14:25.805285] [INFO ] [REMOTE ] AMTD: Full fetch complete (5587 records). [2025-10-02T17:14:25.833303] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-02T17:14:25.882434] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-02T17:14:26.529501] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:14:26.618340] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-02T17:14:26.618426] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-02T17:14:26.618583] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-02T17:14:26.618622] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-02T17:14:26.619101] [DEBUG] [LOCAL ] AMTD: Trimmed 5587 records to 3668 (keeping 200 days of data) [2025-10-02T17:14:26.640370] [DEBUG] [LOCAL ] AMTD: Primary data saved (3668 records). [2025-10-02T17:14:26.640488] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-02T17:14:26.640572] [INFO ] [MAIN ] Update Progress: 111/2370 symbols completed. AMTD took 33.6s. Estimated remaining: 4h 52m 40s. Rate: 7.7 symbols/min [2025-10-02T17:14:26.678289] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-02T17:14:26.859337] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:14:26.859528] [DEBUG] [LOCAL ] AN: No existing data file found in primary storage. [2025-10-02T17:14:26.859580] [WARN ] [MAIN ] AN: No existing data found, performing full refresh instead. [2025-10-02T17:14:26.859722] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-02T17:14:26.859771] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-02T17:14:26.859823] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-02T17:14:26.859871] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-02T17:14:27.303620] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:14:27.472983] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-10-02T17:14:27.625067] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T17:14:27.660002] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T17:14:28.273007] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-02T17:14:28.679720] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T17:14:29.073000] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-02T17:14:29.593416] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T17:14:29.595582] [INFO ] [REMOTE ] AMTM: Full fetch complete (73983 records). [2025-10-02T17:14:29.595791] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-02T17:14:29.884503] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-02T17:14:30.038571] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-02T17:14:30.038692] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-02T17:14:30.039489] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-02T17:14:30.039560] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-02T17:14:30.041271] [DEBUG] [LOCAL ] AMTM: Trimmed 73983 records to 51033 (keeping 200 days of data) [2025-10-02T17:14:30.358693] [DEBUG] [LOCAL ] AMTM: Primary data saved (51033 records). [2025-10-02T17:14:30.358842] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-02T17:14:30.359871] [INFO ] [MAIN ] Update Progress: 112/2370 symbols completed. AMTM took 35.5s. Estimated remaining: 4h 51m 10s. Rate: 7.8 symbols/min [2025-10-02T17:14:30.563442] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:14:30.594617] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T17:14:30.661111] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-02T17:14:30.661441] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-02T17:14:30.682790] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-10-02T17:14:30.810863] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T17:14:30.877621] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:14:30.877862] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-02T17:14:30.877911] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-02T17:14:30.879298] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-02T17:14:30.879359] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-02T17:14:31.271633] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:14:31.473042] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-10-02T17:14:32.273039] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-02T17:14:32.335565] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T17:14:32.973678] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T17:14:33.073021] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-02T17:14:33.760979] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-02T17:14:33.872976] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-02T17:14:33.887401] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T17:14:34.673002] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-02T17:14:35.473026] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-02T17:14:35.879926] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-02T17:14:36.137792] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T17:14:36.273034] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-02T17:14:36.460375] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T17:14:37.073013] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-02T17:14:37.873013] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-02T17:14:38.527729] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-02T17:14:38.610284] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T17:14:38.645013] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T17:14:38.672985] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-02T17:14:39.253312] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T17:14:39.473002] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-02T17:14:40.228316] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-02T17:14:40.273060] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-02T17:14:41.073044] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-02T17:14:41.873023] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-02T17:14:42.022718] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T17:14:42.607541] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-02T17:14:42.673037] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-02T17:14:43.128413] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-02T17:14:43.473044] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-02T17:14:44.231559] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T17:14:44.273032] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-02T17:14:45.073049] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-02T17:14:45.726984] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T17:14:45.728215] [INFO ] [REMOTE ] AMWL: Full fetch complete (14114 records). [2025-10-02T17:14:45.728290] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-02T17:14:45.884302] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-02T17:14:45.928958] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T17:14:46.179246] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-02T17:14:46.179516] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-02T17:14:46.180121] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-02T17:14:46.180206] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-02T17:14:46.181098] [DEBUG] [LOCAL ] AMWL: Trimmed 14114 records to 8926 (keeping 200 days of data) [2025-10-02T17:14:46.260108] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-02T17:14:46.288085] [DEBUG] [LOCAL ] AMWL: Primary data saved (8926 records). [2025-10-02T17:14:46.288313] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-02T17:14:46.288431] [INFO ] [MAIN ] Update Progress: 113/2370 symbols completed. AMWL took 23.2s. Estimated remaining: 4h 53m 46s. Rate: 7.7 symbols/min [2025-10-02T17:14:46.475589] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:14:46.533928] [DEBUG] [LOCAL ] ANF: Loaded 52129 existing records from primary storage. [2025-10-02T17:14:46.534349] [INFO ] [MAIN ] ANF: Loaded 52129 existing records. [2025-10-02T17:14:46.678191] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-02T17:14:46.756320] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:14:46.756569] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-02T17:14:46.756620] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-02T17:14:46.757889] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-02T17:14:46.757999] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-02T17:14:47.158704] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:14:47.418907] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:14:47.473009] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-02T17:14:48.273026] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-10-02T17:14:48.805483] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-02T17:14:49.072989] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-02T17:14:49.173288] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T17:14:49.873031] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-02T17:14:50.341125] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T17:14:50.673112] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-02T17:14:51.102443] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-02T17:14:51.364986] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T17:14:51.473029] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-02T17:14:52.214724] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T17:14:52.272979] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-02T17:14:52.972427] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T17:14:53.073034] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-02T17:14:53.804666] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:14:53.872980] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-02T17:14:54.673046] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-02T17:14:55.480692] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-02T17:14:55.489104] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-02T17:14:55.921732] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-02T17:14:56.133385] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T17:14:56.273041] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-02T17:14:56.894847] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:14:57.073031] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-02T17:14:57.834810] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T17:14:57.872954] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-02T17:14:58.681596] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-02T17:14:58.686334] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-02T17:14:59.472991] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-02T17:14:59.816882] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T17:15:00.273028] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-02T17:15:01.073073] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-02T17:15:01.501198] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T17:15:01.570759] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-10-02T17:15:01.873037] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-02T17:15:02.146059] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T17:15:02.354839] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-02T17:15:02.673005] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-02T17:15:03.473012] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-02T17:15:04.114869] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:15:04.273001] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-02T17:15:04.500778] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-10-02T17:15:05.010147] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T17:15:05.073011] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-02T17:15:05.712451] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T17:15:05.872996] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-02T17:15:06.673031] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-02T17:15:06.999868] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T17:15:07.110455] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T17:15:07.473013] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-02T17:15:08.273036] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-02T17:15:08.405879] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T17:15:08.407203] [INFO ] [REMOTE ] AN: Full fetch complete (47439 records). [2025-10-02T17:15:08.407288] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-02T17:15:08.407947] [FATAL] [VALIDATOR ] AN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:15:08.408080] [FATAL] [MAIN ] AN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:15:08.408148] [WARN ] [MAIN ] AN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:15:08.408218] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-02T17:15:08.408281] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-10-02T17:15:08.408317] [INFO ] [LOCAL ] AN: Starting deletion of derivative data. [2025-10-02T17:15:08.408374] [DEBUG] [LOCAL ] AN: No derivative data file found to delete. [2025-10-02T17:15:08.408466] [INFO ] [MAIN ] Update Progress: 114/2370 symbols completed. AN took 41.8s. Estimated remaining: 4h 58m 21s. Rate: 7.6 symbols/min [2025-10-02T17:15:08.622031] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:08.622236] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-02T17:15:08.622421] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-02T17:15:08.627381] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-02T17:15:08.629210] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-02T17:15:08.629974] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-02T17:15:08.630223] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-02T17:15:08.630338] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-02T17:15:08.635889] [INFO ] [REMOTE ] ANET: Full fetch complete (77860 records). [2025-10-02T17:15:08.684987] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-02T17:15:09.103720] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-02T17:15:09.615737] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:09.631172] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T17:15:09.661897] [INFO ] [REMOTE ] AMX: Full fetch complete (70751 records). [2025-10-02T17:15:09.683399] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-02T17:15:09.884150] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-10-02T17:15:09.901056] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-02T17:15:09.916053] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-02T17:15:09.946061] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-02T17:15:09.958327] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-02T17:15:10.028520] [DEBUG] [LOCAL ] ANET: Trimmed 77860 records to 54156 (keeping 200 days of data) [2025-10-02T17:15:10.232168] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:15:10.277248] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-10-02T17:15:10.301511] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:15:10.303800] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-02T17:15:10.329041] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:15:10.336473] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-02T17:15:10.399036] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-02T17:15:10.424402] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-02T17:15:10.432278] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-02T17:15:10.432720] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-02T17:15:10.432856] [INFO ] [MAIN ] Update Progress: 115/2370 symbols completed. ANGX took 2.0s. Estimated remaining: 4h 56m 18s. Rate: 7.6 symbols/min [2025-10-02T17:15:10.432997] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-02T17:15:10.443295] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-02T17:15:10.452411] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-02T17:15:10.556701] [DEBUG] [LOCAL ] AMX: Trimmed 70751 records to 49493 (keeping 200 days of data) [2025-10-02T17:15:10.838310] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:10.886466] [DEBUG] [LOCAL ] ANRO: Loaded 18746 existing records from primary storage. [2025-10-02T17:15:10.890503] [INFO ] [MAIN ] ANRO: Loaded 18746 existing records. [2025-10-02T17:15:11.135850] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:15:11.183198] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-02T17:15:11.203276] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-02T17:15:11.206700] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-10-02T17:15:11.207582] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-02T17:15:11.395438] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-02T17:15:11.461085] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-02T17:15:11.834448] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:11.835955] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-10-02T17:15:11.843956] [DEBUG] [LOCAL ] ANET: Primary data saved (54156 records). [2025-10-02T17:15:11.844573] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-02T17:15:11.849002] [INFO ] [MAIN ] Update Progress: 116/2370 symbols completed. ANET took 41.5s. Estimated remaining: 4h 54m 4s. Rate: 7.7 symbols/min [2025-10-02T17:15:12.076976] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:12.162595] [DEBUG] [LOCAL ] AMX: Primary data saved (49493 records). [2025-10-02T17:15:12.170720] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-02T17:15:12.170944] [INFO ] [MAIN ] Update Progress: 117/2370 symbols completed. AMX took 46.9s. Estimated remaining: 4h 51m 32s. Rate: 7.7 symbols/min [2025-10-02T17:15:12.172737] [DEBUG] [LOCAL ] ANVS: Loaded 23194 existing records from primary storage. [2025-10-02T17:15:12.172959] [INFO ] [MAIN ] ANVS: Loaded 23194 existing records. [2025-10-02T17:15:12.365033] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:15:12.365248] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-02T17:15:12.365298] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-02T17:15:12.366266] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-02T17:15:12.366331] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-02T17:15:12.751888] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:12.752218] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-10-02T17:15:12.911980] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T17:15:12.913575] [INFO ] [REMOTE ] ANF: Full fetch complete (75226 records). [2025-10-02T17:15:12.913733] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-02T17:15:12.914618] [FATAL] [VALIDATOR ] ANF: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:15:12.914739] [FATAL] [MAIN ] ANF: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:15:12.914783] [WARN ] [MAIN ] ANF: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:15:12.914854] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-02T17:15:12.914921] [DEBUG] [LOCAL ] ANF: No primary data file found to delete. [2025-10-02T17:15:12.914963] [INFO ] [LOCAL ] ANF: Starting deletion of derivative data. [2025-10-02T17:15:12.915567] [DEBUG] [LOCAL ] ANF: Deleted derivative data file. [2025-10-02T17:15:12.915690] [INFO ] [MAIN ] Update Progress: 118/2370 symbols completed. ANF took 26.6s. Estimated remaining: 4h 49m 10s. Rate: 7.8 symbols/min [2025-10-02T17:15:13.312252] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T17:15:13.319295] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-02T17:15:14.310728] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T17:15:14.315358] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-02T17:15:14.430888] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T17:15:14.673000] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-02T17:15:15.380220] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T17:15:15.473031] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-02T17:15:15.989893] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T17:15:16.273116] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-02T17:15:16.652717] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T17:15:17.073021] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-02T17:15:17.559578] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T17:15:17.872984] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-02T17:15:17.914982] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T17:15:18.673009] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-02T17:15:18.922408] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T17:15:19.472980] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-02T17:15:19.686106] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T17:15:20.273063] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-02T17:15:20.625530] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T17:15:21.073019] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-02T17:15:21.537419] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T17:15:21.873031] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-02T17:15:22.388004] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T17:15:22.632159] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T17:15:22.673014] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-02T17:15:23.473044] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-02T17:15:23.808595] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T17:15:24.273053] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-02T17:15:24.816849] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T17:15:25.073022] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-02T17:15:25.268424] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T17:15:25.873109] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-02T17:15:26.250071] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T17:15:26.402279] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T17:15:26.403440] [INFO ] [REMOTE ] ANRO: Full fetch complete (29217 records). [2025-10-02T17:15:26.403579] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-02T17:15:26.690491] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-02T17:15:26.835638] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-02T17:15:26.835776] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-02T17:15:26.836293] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-02T17:15:26.836366] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-02T17:15:26.837281] [DEBUG] [LOCAL ] ANRO: Trimmed 29217 records to 18833 (keeping 200 days of data) [2025-10-02T17:15:26.949605] [DEBUG] [LOCAL ] ANRO: Primary data saved (18833 records). [2025-10-02T17:15:26.949796] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-02T17:15:26.949887] [INFO ] [MAIN ] Update Progress: 119/2370 symbols completed. ANRO took 16.5s. Estimated remaining: 4h 51m 2s. Rate: 7.7 symbols/min [2025-10-02T17:15:27.795572] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T17:15:27.801717] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-02T17:15:28.688003] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T17:15:28.697425] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-02T17:15:29.531859] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T17:15:29.533210] [INFO ] [REMOTE ] ANVS: Full fetch complete (36357 records). [2025-10-02T17:15:29.533294] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-02T17:15:29.952923] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-02T17:15:29.953015] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-02T17:15:29.953590] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-02T17:15:29.953687] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-02T17:15:29.954678] [DEBUG] [LOCAL ] ANVS: Trimmed 36357 records to 23369 (keeping 200 days of data) [2025-10-02T17:15:30.097202] [DEBUG] [LOCAL ] ANVS: Primary data saved (23369 records). [2025-10-02T17:15:30.097363] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-02T17:15:30.097455] [INFO ] [MAIN ] Update Progress: 120/2370 symbols completed. ANVS took 18.2s. Estimated remaining: 4h 49m 28s. Rate: 7.8 symbols/min [2025-10-02T17:15:30.703370] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:30.906235] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:30.908141] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-02T17:15:30.935670] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-02T17:15:30.975087] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:30.975310] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-02T17:15:30.967610] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:30.975612] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-02T17:15:30.975978] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-02T17:15:30.976468] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-02T17:15:31.112891] [DEBUG] [LOCAL ] AOD: Loaded 30194 existing records from primary storage. [2025-10-02T17:15:31.131960] [INFO ] [MAIN ] AOD: Loaded 30194 existing records. [2025-10-02T17:15:31.132444] [DEBUG] [LOCAL ] AOMR: Loaded 16542 existing records from primary storage. [2025-10-02T17:15:31.176134] [INFO ] [MAIN ] AOMR: Loaded 16542 existing records. [2025-10-02T17:15:31.692589] [DEBUG] [LOCAL ] AON: Loaded 45428 existing records from primary storage. [2025-10-02T17:15:31.715430] [INFO ] [MAIN ] AON: Loaded 45428 existing records. [2025-10-02T17:15:31.740145] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:15:31.890252] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-02T17:15:31.912221] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:15:31.945073] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-02T17:15:31.927288] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-02T17:15:31.984722] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-02T17:15:31.998922] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:32.010520] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-02T17:15:32.017268] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-10-02T17:15:32.022095] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-02T17:15:32.010586] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-02T17:15:32.028479] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-02T17:15:32.298936] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:15:32.307629] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:15:32.333233] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-10-02T17:15:32.345788] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-02T17:15:32.356425] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-02T17:15:32.356522] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:15:32.398443] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-02T17:15:32.453068] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-02T17:15:32.495069] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:15:32.495330] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-02T17:15:32.498007] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-02T17:15:32.540243] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-02T17:15:32.580804] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-02T17:15:32.634338] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-02T17:15:32.761603] [INFO ] [MAIN ] Update Progress: 121/2370 symbols completed. AOMD took 2.7s. Estimated remaining: 4h 47m 46s. Rate: 7.8 symbols/min [2025-10-02T17:15:33.200225] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:33.284203] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-10-02T17:15:33.323941] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:33.374362] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-10-02T17:15:33.428260] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:33.453561] [DEBUG] [LOCAL ] AORT: No existing data file found in primary storage. [2025-10-02T17:15:33.453985] [WARN ] [MAIN ] AORT: No existing data found, performing full refresh instead. [2025-10-02T17:15:33.495751] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-02T17:15:33.501001] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-02T17:15:33.519365] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-02T17:15:33.535912] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-02T17:15:33.574809] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:33.612110] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-10-02T17:15:33.953381] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:33.953793] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-10-02T17:15:34.517283] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-02T17:15:34.520849] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-02T17:15:34.565139] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T17:15:34.571595] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-02T17:15:35.051424] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T17:15:35.056512] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-02T17:15:35.335731] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T17:15:35.473070] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-02T17:15:35.622036] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-02T17:15:35.869426] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T17:15:35.993577] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T17:15:36.273037] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-02T17:15:36.527148] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T17:15:37.072977] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-02T17:15:37.336745] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T17:15:37.873022] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-02T17:15:38.355123] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T17:15:38.672977] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-02T17:15:38.908876] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T17:15:39.473018] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-02T17:15:40.012716] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T17:15:40.273020] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-02T17:15:40.846408] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T17:15:41.073016] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-02T17:15:41.391781] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T17:15:41.873049] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-02T17:15:42.543465] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T17:15:42.673023] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-02T17:15:43.176571] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T17:15:43.472976] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-02T17:15:43.704312] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T17:15:44.272994] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-02T17:15:44.889048] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T17:15:45.073007] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-02T17:15:45.511040] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T17:15:45.873024] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-02T17:15:46.250619] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T17:15:46.673005] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-02T17:15:46.786142] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T17:15:47.472976] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-02T17:15:47.639394] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T17:15:48.273021] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-02T17:15:49.072999] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-02T17:15:49.237313] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T17:15:49.277083] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T17:15:49.873003] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-02T17:15:50.371349] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T17:15:50.673024] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-02T17:15:51.473014] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-02T17:15:51.669183] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T17:15:52.004491] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T17:15:52.273061] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-02T17:15:52.305185] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T17:15:53.073040] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-02T17:15:53.752527] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T17:15:53.872992] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-02T17:15:54.335855] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T17:15:54.673040] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-02T17:15:55.042465] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:15:55.473058] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-02T17:15:55.849744] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T17:15:56.273018] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-02T17:15:56.817404] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T17:15:57.073007] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-02T17:15:57.352939] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T17:15:57.354480] [INFO ] [REMOTE ] AORT: Full fetch complete (41759 records). [2025-10-02T17:15:57.354630] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-02T17:15:57.355414] [FATAL] [VALIDATOR ] AORT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:15:57.355540] [FATAL] [MAIN ] AORT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:15:57.355596] [WARN ] [MAIN ] AORT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:15:57.355700] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-02T17:15:57.355779] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-10-02T17:15:57.355857] [INFO ] [LOCAL ] AORT: Starting deletion of derivative data. [2025-10-02T17:15:57.355925] [DEBUG] [LOCAL ] AORT: No derivative data file found to delete. [2025-10-02T17:15:57.356044] [INFO ] [MAIN ] Update Progress: 122/2370 symbols completed. AORT took 24.5s. Estimated remaining: 4h 52m 50s. Rate: 7.7 symbols/min [2025-10-02T17:15:57.561196] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:15:57.612327] [DEBUG] [LOCAL ] AOS: Loaded 48840 existing records from primary storage. [2025-10-02T17:15:57.612721] [INFO ] [MAIN ] AOS: Loaded 48840 existing records. [2025-10-02T17:15:57.809364] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:15:57.809662] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-02T17:15:57.809732] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-02T17:15:57.811147] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-02T17:15:57.811210] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-02T17:15:57.882691] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-02T17:15:58.247190] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:15:58.469705] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:15:58.673014] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-10-02T17:15:59.379199] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T17:15:59.473031] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-02T17:16:00.273023] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-02T17:16:00.365322] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T17:16:00.413593] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-02T17:16:01.073030] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-02T17:16:01.873274] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-02T17:16:02.088146] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T17:16:02.089714] [INFO ] [REMOTE ] AOMR: Full fetch complete (23198 records). [2025-10-02T17:16:02.089839] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-02T17:16:02.251620] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T17:16:02.679712] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-02T17:16:02.708328] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-02T17:16:02.708453] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-02T17:16:02.709017] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-02T17:16:02.709099] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-02T17:16:02.710255] [DEBUG] [LOCAL ] AOMR: Trimmed 23198 records to 16644 (keeping 200 days of data) [2025-10-02T17:16:02.847295] [DEBUG] [LOCAL ] AOMR: Primary data saved (16644 records). [2025-10-02T17:16:02.847473] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-02T17:16:02.847570] [INFO ] [MAIN ] Update Progress: 123/2370 symbols completed. AOMR took 32.7s. Estimated remaining: 4h 51m 60s. Rate: 7.7 symbols/min [2025-10-02T17:16:03.067914] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:03.080163] [DEBUG] [LOCAL ] AP: Loaded 7180 existing records from primary storage. [2025-10-02T17:16:03.080617] [INFO ] [MAIN ] AP: Loaded 7180 existing records. [2025-10-02T17:16:03.304049] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:16:03.306519] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T17:16:03.306732] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-02T17:16:03.314346] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-02T17:16:03.314931] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-02T17:16:03.315006] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-02T17:16:03.480677] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-02T17:16:03.750004] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:04.272973] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-10-02T17:16:04.377508] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T17:16:04.838514] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T17:16:05.073001] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-02T17:16:05.120461] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T17:16:05.873000] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-02T17:16:06.283511] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T17:16:06.285075] [INFO ] [REMOTE ] AOD: Full fetch complete (44227 records). [2025-10-02T17:16:06.285216] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-02T17:16:06.618603] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T17:16:06.678112] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-02T17:16:06.761344] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-02T17:16:06.761435] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-02T17:16:06.761997] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-02T17:16:06.762097] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-02T17:16:06.763237] [DEBUG] [LOCAL ] AOD: Trimmed 44227 records to 30406 (keeping 200 days of data) [2025-10-02T17:16:06.971006] [DEBUG] [LOCAL ] AOD: Primary data saved (30406 records). [2025-10-02T17:16:06.971152] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-02T17:16:06.971281] [INFO ] [MAIN ] Update Progress: 124/2370 symbols completed. AOD took 36.9s. Estimated remaining: 4h 50m 46s. Rate: 7.7 symbols/min [2025-10-02T17:16:07.157734] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:07.157947] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-10-02T17:16:07.158004] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-10-02T17:16:07.158158] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-02T17:16:07.158202] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-02T17:16:07.158245] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-10-02T17:16:07.158302] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-02T17:16:07.478129] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-02T17:16:07.554351] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:08.273003] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-02T17:16:08.418377] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T17:16:08.664843] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-02T17:16:09.073012] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-02T17:16:09.222804] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T17:16:09.872999] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-02T17:16:10.337215] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-02T17:16:10.533178] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T17:16:10.672999] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-02T17:16:11.473013] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-02T17:16:12.273008] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-02T17:16:12.469164] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T17:16:12.767481] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-02T17:16:13.033444] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T17:16:13.035503] [INFO ] [REMOTE ] AON: Full fetch complete (64769 records). [2025-10-02T17:16:13.035677] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-02T17:16:13.078126] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-02T17:16:13.477837] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-02T17:16:13.477936] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-02T17:16:13.478716] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-02T17:16:13.478791] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-02T17:16:13.480261] [DEBUG] [LOCAL ] AON: Trimmed 64769 records to 45726 (keeping 200 days of data) [2025-10-02T17:16:13.830036] [DEBUG] [LOCAL ] AON: Primary data saved (45726 records). [2025-10-02T17:16:13.830218] [INFO ] [MAIN ] AON: Full history saved. [2025-10-02T17:16:13.831784] [INFO ] [MAIN ] Update Progress: 125/2370 symbols completed. AON took 43.7s. Estimated remaining: 4h 50m 22s. Rate: 7.7 symbols/min [2025-10-02T17:16:13.878939] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-02T17:16:14.057848] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:14.117285] [DEBUG] [LOCAL ] APD: Loaded 45389 existing records from primary storage. [2025-10-02T17:16:14.117711] [INFO ] [MAIN ] APD: Loaded 45389 existing records. [2025-10-02T17:16:14.339412] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:16:14.339765] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-02T17:16:14.339858] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-02T17:16:14.341370] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-02T17:16:14.341434] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-02T17:16:14.677275] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-10-02T17:16:14.770465] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:14.801605] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T17:16:14.820839] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T17:16:15.473034] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-02T17:16:15.785001] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T17:16:16.273023] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-10-02T17:16:16.495825] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T17:16:17.073010] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-02T17:16:17.765624] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T17:16:17.873007] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-02T17:16:18.383978] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T17:16:18.673043] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-02T17:16:19.402213] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T17:16:19.473014] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-02T17:16:19.543563] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T17:16:20.273007] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-02T17:16:20.883978] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T17:16:20.928454] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T17:16:21.072995] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-02T17:16:21.873032] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-02T17:16:22.673006] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-02T17:16:22.908367] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T17:16:23.310813] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T17:16:23.473053] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-02T17:16:23.807577] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-02T17:16:24.273022] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-02T17:16:25.044175] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T17:16:25.072975] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-02T17:16:25.097945] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-02T17:16:25.873012] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-02T17:16:26.641575] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T17:16:26.642882] [INFO ] [REMOTE ] AP: Full fetch complete (8945 records). [2025-10-02T17:16:26.642977] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-02T17:16:26.678162] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-02T17:16:27.057692] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-02T17:16:27.058087] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-02T17:16:27.058374] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-02T17:16:27.073423] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-02T17:16:27.086438] [DEBUG] [LOCAL ] AP: Trimmed 8945 records to 7211 (keeping 200 days of data) [2025-10-02T17:16:27.088423] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-02T17:16:27.141571] [DEBUG] [LOCAL ] AP: Primary data saved (7211 records). [2025-10-02T17:16:27.141751] [INFO ] [MAIN ] AP: Full history saved. [2025-10-02T17:16:27.141844] [INFO ] [MAIN ] Update Progress: 126/2370 symbols completed. AP took 24.3s. Estimated remaining: 4h 51m 53s. Rate: 7.7 symbols/min [2025-10-02T17:16:27.336136] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:27.336335] [DEBUG] [LOCAL ] APG: No existing data file found in primary storage. [2025-10-02T17:16:27.336379] [WARN ] [MAIN ] APG: No existing data found, performing full refresh instead. [2025-10-02T17:16:27.336500] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-02T17:16:27.336543] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-02T17:16:27.336585] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-10-02T17:16:27.336618] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-02T17:16:27.478166] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-02T17:16:27.739147] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:28.273055] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-10-02T17:16:28.503115] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T17:16:29.072997] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-02T17:16:29.279349] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T17:16:29.873008] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-02T17:16:30.190638] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T17:16:30.543111] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:16:30.673111] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-02T17:16:31.399996] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T17:16:31.473006] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-02T17:16:31.853724] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T17:16:32.273045] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-02T17:16:33.073063] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-02T17:16:33.140431] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T17:16:33.716247] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:16:33.873000] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-02T17:16:34.672976] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-02T17:16:34.763157] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T17:16:35.204539] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T17:16:35.473046] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-02T17:16:35.916229] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T17:16:35.919630] [INFO ] [REMOTE ] AOS: Full fetch complete (70654 records). [2025-10-02T17:16:35.919806] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-02T17:16:36.285716] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-02T17:16:36.349198] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-02T17:16:36.349292] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-02T17:16:36.350152] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-02T17:16:36.350226] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-02T17:16:36.351714] [DEBUG] [LOCAL ] AOS: Trimmed 70654 records to 49194 (keeping 200 days of data) [2025-10-02T17:16:36.697965] [DEBUG] [LOCAL ] AOS: Primary data saved (49194 records). [2025-10-02T17:16:36.698157] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-02T17:16:36.698258] [INFO ] [MAIN ] Update Progress: 127/2370 symbols completed. AOS took 39.3s. Estimated remaining: 4h 52m 16s. Rate: 7.7 symbols/min [2025-10-02T17:16:36.764113] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:16:36.902846] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:36.959290] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-02T17:16:36.959629] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-02T17:16:37.078362] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-02T17:16:37.167671] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:16:37.167885] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-02T17:16:37.167935] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-02T17:16:37.169814] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-02T17:16:37.169879] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-02T17:16:37.556539] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:37.873015] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-10-02T17:16:37.926694] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T17:16:38.474105] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T17:16:38.673035] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-02T17:16:39.473028] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-02T17:16:39.713239] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T17:16:40.273050] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-02T17:16:40.443763] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T17:16:40.669598] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T17:16:41.073015] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-02T17:16:41.873020] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-02T17:16:41.992068] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T17:16:42.673033] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-02T17:16:42.877075] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:16:43.473022] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-02T17:16:43.980601] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-02T17:16:44.272983] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-02T17:16:44.436538] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:16:44.562583] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T17:16:44.564260] [INFO ] [REMOTE ] APAM: Full fetch complete (51725 records). [2025-10-02T17:16:44.564373] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-02T17:16:45.000211] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-02T17:16:45.000331] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-02T17:16:45.001049] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-02T17:16:45.001117] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-02T17:16:45.002256] [DEBUG] [LOCAL ] APAM: Trimmed 51725 records to 36350 (keeping 200 days of data) [2025-10-02T17:16:45.091737] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-02T17:16:45.238127] [DEBUG] [LOCAL ] APAM: Primary data saved (36350 records). [2025-10-02T17:16:45.238279] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-02T17:16:45.238354] [INFO ] [MAIN ] Update Progress: 128/2370 symbols completed. APAM took 38.3s. Estimated remaining: 4h 52m 21s. Rate: 7.7 symbols/min [2025-10-02T17:16:45.436261] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:45.494225] [DEBUG] [LOCAL ] APLE: Loaded 51925 existing records from primary storage. [2025-10-02T17:16:45.494589] [INFO ] [MAIN ] APLE: Loaded 51925 existing records. [2025-10-02T17:16:45.697036] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:16:45.697499] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-02T17:16:45.697665] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-02T17:16:45.699258] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-02T17:16:45.699324] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-02T17:16:45.844749] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T17:16:45.876230] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-02T17:16:46.139062] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:46.672979] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-02T17:16:46.894371] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T17:16:47.473021] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-10-02T17:16:47.649490] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T17:16:48.145362] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T17:16:48.273009] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-02T17:16:49.073003] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-02T17:16:49.505896] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-02T17:16:49.683235] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:16:49.873000] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-02T17:16:50.672983] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-02T17:16:50.950891] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T17:16:51.050882] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T17:16:51.052848] [INFO ] [REMOTE ] APD: Full fetch complete (66796 records). [2025-10-02T17:16:51.052964] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-02T17:16:51.476671] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-02T17:16:51.476910] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-02T17:16:51.477814] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-02T17:16:51.478592] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-02T17:16:51.478785] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-02T17:16:51.480372] [DEBUG] [LOCAL ] APD: Trimmed 66796 records to 45731 (keeping 200 days of data) [2025-10-02T17:16:51.785498] [DEBUG] [LOCAL ] APD: Primary data saved (45731 records). [2025-10-02T17:16:51.785632] [INFO ] [MAIN ] APD: Full history saved. [2025-10-02T17:16:51.786631] [INFO ] [MAIN ] Update Progress: 129/2370 symbols completed. APD took 38.0s. Estimated remaining: 4h 51m 51s. Rate: 7.7 symbols/min [2025-10-02T17:16:51.974160] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:16:51.974363] [DEBUG] [LOCAL ] APO: No existing data file found in primary storage. [2025-10-02T17:16:51.974406] [WARN ] [MAIN ] APO: No existing data found, performing full refresh instead. [2025-10-02T17:16:51.974581] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-02T17:16:51.974636] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-02T17:16:51.974724] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-10-02T17:16:51.974764] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-02T17:16:52.278144] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-02T17:16:52.377028] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:16:52.565979] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T17:16:53.072974] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-02T17:16:53.177780] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T17:16:53.873005] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-10-02T17:16:54.603430] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-10-02T17:16:54.672983] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-02T17:16:54.731979] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T17:16:55.472998] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-02T17:16:56.015880] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-02T17:16:56.058807] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:16:56.273047] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-02T17:16:57.072999] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-02T17:16:57.172721] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:16:57.872986] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-02T17:16:57.982075] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T17:16:58.496921] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T17:16:58.673035] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-02T17:16:59.316237] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T17:16:59.318365] [INFO ] [REMOTE ] APG: Full fetch complete (71671 records). [2025-10-02T17:16:59.318482] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-02T17:16:59.478162] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-02T17:16:59.765217] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-02T17:16:59.765307] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-02T17:16:59.766099] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-02T17:16:59.766193] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-02T17:16:59.767701] [DEBUG] [LOCAL ] APG: Trimmed 71671 records to 50572 (keeping 200 days of data) [2025-10-02T17:17:00.081923] [DEBUG] [LOCAL ] APG: Primary data saved (50572 records). [2025-10-02T17:17:00.082073] [INFO ] [MAIN ] APG: Full history saved. [2025-10-02T17:17:00.082150] [INFO ] [MAIN ] Update Progress: 130/2370 symbols completed. APG took 32.9s. Estimated remaining: 4h 51m 51s. Rate: 7.7 symbols/min [2025-10-02T17:17:00.273325] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-02T17:17:00.278483] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:00.279882] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-10-02T17:17:00.280001] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-10-02T17:17:00.280166] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-02T17:17:00.280250] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-02T17:17:00.280488] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-02T17:17:00.280587] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-02T17:17:00.654504] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-02T17:17:00.722111] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:01.073154] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-10-02T17:17:01.783321] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-02T17:17:01.784447] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T17:17:01.872998] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-02T17:17:02.251301] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-02T17:17:02.553623] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T17:17:02.672991] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-02T17:17:03.378701] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-02T17:17:03.473013] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-02T17:17:04.273011] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-02T17:17:05.073004] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-02T17:17:05.731254] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-02T17:17:05.799406] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:17:05.879101] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-02T17:17:05.910124] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-10-02T17:17:06.672996] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-02T17:17:07.446846] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T17:17:07.473005] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-02T17:17:08.273001] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-02T17:17:08.692763] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T17:17:09.033576] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-02T17:17:09.073001] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-02T17:17:09.467454] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T17:17:09.806905] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T17:17:09.872995] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-02T17:17:10.673006] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-02T17:17:11.473020] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-02T17:17:11.904838] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T17:17:12.273058] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-02T17:17:12.811408] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-10-02T17:17:13.072967] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-02T17:17:13.297793] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T17:17:13.299921] [INFO ] [REMOTE ] APH: Full fetch complete (77689 records). [2025-10-02T17:17:13.300044] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-02T17:17:13.761127] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-02T17:17:13.761248] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-02T17:17:13.762143] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-02T17:17:13.762350] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-02T17:17:13.770869] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-02T17:17:13.774981] [DEBUG] [LOCAL ] APH: Trimmed 77689 records to 54081 (keeping 200 days of data) [2025-10-02T17:17:13.873442] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-02T17:17:14.138529] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T17:17:14.203316] [DEBUG] [LOCAL ] APH: Primary data saved (54081 records). [2025-10-02T17:17:14.203464] [INFO ] [MAIN ] APH: Full history saved. [2025-10-02T17:17:14.203555] [INFO ] [MAIN ] Update Progress: 131/2370 symbols completed. APH took 37.5s. Estimated remaining: 4h 53m 31s. Rate: 7.6 symbols/min [2025-10-02T17:17:14.392024] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:14.392199] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-10-02T17:17:14.392239] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-10-02T17:17:14.392379] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-02T17:17:14.392452] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-02T17:17:14.392515] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-10-02T17:17:14.392551] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-02T17:17:14.678229] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-02T17:17:14.801331] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:15.313630] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T17:17:15.470937] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T17:17:15.478499] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-10-02T17:17:16.273044] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-02T17:17:17.073036] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-02T17:17:17.323292] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T17:17:17.722815] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T17:17:17.872969] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-02T17:17:18.059749] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T17:17:18.673049] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-02T17:17:19.472976] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-02T17:17:19.680936] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-02T17:17:20.255229] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:17:20.272984] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-02T17:17:21.073013] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-02T17:17:21.185594] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T17:17:21.564394] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-02T17:17:21.872975] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-02T17:17:22.106464] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T17:17:22.673022] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-02T17:17:23.380386] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T17:17:23.473009] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-02T17:17:24.275254] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-02T17:17:24.275452] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T17:17:24.277199] [INFO ] [REMOTE ] APOS: Full fetch complete (10444 records). [2025-10-02T17:17:24.277319] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-02T17:17:24.277790] [FATAL] [VALIDATOR ] APOS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:17:24.277875] [FATAL] [MAIN ] APOS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:17:24.277942] [WARN ] [MAIN ] APOS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:17:24.278022] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-02T17:17:24.278141] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-10-02T17:17:24.278214] [INFO ] [LOCAL ] APOS: Starting deletion of derivative data. [2025-10-02T17:17:24.278307] [DEBUG] [LOCAL ] APOS: No derivative data file found to delete. [2025-10-02T17:17:24.278385] [INFO ] [MAIN ] Update Progress: 132/2370 symbols completed. APOS took 24.2s. Estimated remaining: 4h 54m 1s. Rate: 7.6 symbols/min [2025-10-02T17:17:24.485440] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:24.519871] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T17:17:24.582425] [DEBUG] [LOCAL ] AQN: Loaded 51909 existing records from primary storage. [2025-10-02T17:17:24.582794] [INFO ] [MAIN ] AQN: Loaded 51909 existing records. [2025-10-02T17:17:24.795915] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:17:24.796154] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-02T17:17:24.796210] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-02T17:17:24.797919] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-10-02T17:17:24.797984] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-02T17:17:25.078235] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-02T17:17:25.204112] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:25.754520] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T17:17:25.756186] [INFO ] [REMOTE ] APLE: Full fetch complete (73915 records). [2025-10-02T17:17:25.756343] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-02T17:17:25.757286] [FATAL] [VALIDATOR ] APLE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:17:25.757441] [FATAL] [MAIN ] APLE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:17:25.757510] [WARN ] [MAIN ] APLE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:17:25.757586] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-02T17:17:25.757678] [DEBUG] [LOCAL ] APLE: No primary data file found to delete. [2025-10-02T17:17:25.757736] [INFO ] [LOCAL ] APLE: Starting deletion of derivative data. [2025-10-02T17:17:25.758389] [DEBUG] [LOCAL ] APLE: Deleted derivative data file. [2025-10-02T17:17:25.758803] [INFO ] [MAIN ] Update Progress: 133/2370 symbols completed. APLE took 40.5s. Estimated remaining: 4h 52m 5s. Rate: 7.7 symbols/min [2025-10-02T17:17:25.873721] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-02T17:17:25.950332] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:25.958612] [DEBUG] [LOCAL ] AQNB: Loaded 4164 existing records from primary storage. [2025-10-02T17:17:25.958918] [INFO ] [MAIN ] AQNB: Loaded 4164 existing records. [2025-10-02T17:17:26.158706] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:17:26.158988] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-02T17:17:26.159049] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-02T17:17:26.159412] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-02T17:17:26.159475] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-02T17:17:26.582774] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:26.673053] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-10-02T17:17:26.993077] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T17:17:27.473018] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-02T17:17:27.561938] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T17:17:27.930959] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-02T17:17:28.273017] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-02T17:17:28.758383] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-02T17:17:29.057194] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T17:17:29.059541] [INFO ] [REMOTE ] APO: Full fetch complete (77291 records). [2025-10-02T17:17:29.059762] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-02T17:17:29.078133] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-10-02T17:17:29.536190] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-02T17:17:29.536283] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-02T17:17:29.537185] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-02T17:17:29.537259] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-02T17:17:29.539065] [DEBUG] [LOCAL ] APO: Trimmed 77291 records to 53773 (keeping 200 days of data) [2025-10-02T17:17:29.883133] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-02T17:17:29.910744] [DEBUG] [LOCAL ] APO: Primary data saved (53773 records). [2025-10-02T17:17:29.911336] [INFO ] [MAIN ] APO: Full history saved. [2025-10-02T17:17:29.911593] [INFO ] [MAIN ] Update Progress: 134/2370 symbols completed. APO took 38.1s. Estimated remaining: 4h 50m 56s. Rate: 7.7 symbols/min [2025-10-02T17:17:30.097678] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:30.153078] [DEBUG] [LOCAL ] AR: Loaded 53583 existing records from primary storage. [2025-10-02T17:17:30.153494] [INFO ] [MAIN ] AR: Loaded 53583 existing records. [2025-10-02T17:17:30.354181] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:17:30.354421] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-02T17:17:30.354471] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-02T17:17:30.356223] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-10-02T17:17:30.356289] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-02T17:17:30.678107] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-02T17:17:30.760620] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:31.049859] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-02T17:17:31.219720] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T17:17:31.473014] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-10-02T17:17:31.850515] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T17:17:32.273022] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-02T17:17:32.888683] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T17:17:33.073006] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-02T17:17:33.404805] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T17:17:33.872998] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-02T17:17:34.377566] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T17:17:34.469250] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T17:17:34.673009] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-02T17:17:35.161895] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T17:17:35.473012] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-02T17:17:36.273047] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-02T17:17:36.958516] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T17:17:37.073029] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-02T17:17:37.778560] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T17:17:37.851954] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:17:37.872957] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-02T17:17:38.673049] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-02T17:17:39.179610] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T17:17:39.473026] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-02T17:17:40.272994] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-02T17:17:40.325380] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T17:17:40.856378] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T17:17:41.073044] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-02T17:17:41.873000] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-02T17:17:42.027900] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T17:17:42.673046] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-02T17:17:43.088356] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-02T17:17:43.088204] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T17:17:43.473031] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-02T17:17:44.272980] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-02T17:17:44.414615] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T17:17:44.872385] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-02T17:17:44.911971] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T17:17:45.072999] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-02T17:17:45.665354] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T17:17:45.873008] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-02T17:17:46.673018] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-02T17:17:47.459971] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T17:17:47.460817] [INFO ] [REMOTE ] AQNB: Full fetch complete (5750 records). [2025-10-02T17:17:47.460892] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-02T17:17:47.482275] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-02T17:17:47.907120] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-02T17:17:47.907222] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-02T17:17:47.907794] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-02T17:17:47.907880] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-02T17:17:47.912322] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-02T17:17:47.913022] [DEBUG] [LOCAL ] AQNB: Trimmed 5750 records to 4183 (keeping 200 days of data) [2025-10-02T17:17:47.960001] [DEBUG] [LOCAL ] AQNB: Primary data saved (4183 records). [2025-10-02T17:17:47.960174] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-02T17:17:47.960267] [INFO ] [MAIN ] Update Progress: 135/2370 symbols completed. AQNB took 22.2s. Estimated remaining: 4h 53m 38s. Rate: 7.6 symbols/min [2025-10-02T17:17:48.149786] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:48.207849] [DEBUG] [LOCAL ] ARCO: Loaded 44450 existing records from primary storage. [2025-10-02T17:17:48.208210] [INFO ] [MAIN ] ARCO: Loaded 44450 existing records. [2025-10-02T17:17:48.278240] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-02T17:17:48.410824] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:17:48.411036] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-02T17:17:48.411084] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-02T17:17:48.412734] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-02T17:17:48.412799] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-02T17:17:48.803814] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:49.073015] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-02T17:17:49.393947] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T17:17:49.676237] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T17:17:49.873013] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-02T17:17:50.673043] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-10-02T17:17:50.762147] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T17:17:51.473001] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-02T17:17:51.806461] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T17:17:51.995888] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T17:17:52.273035] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-02T17:17:52.895505] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T17:17:52.898293] [INFO ] [REMOTE ] APTV: Full fetch complete (75922 records). [2025-10-02T17:17:52.898576] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-02T17:17:53.073109] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-02T17:17:53.365210] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-02T17:17:53.365316] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-02T17:17:53.366134] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-02T17:17:53.366202] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-02T17:17:53.367904] [DEBUG] [LOCAL ] APTV: Trimmed 75922 records to 52472 (keeping 200 days of data) [2025-10-02T17:17:53.702557] [DEBUG] [LOCAL ] APTV: Primary data saved (52472 records). [2025-10-02T17:17:53.702747] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-02T17:17:53.702841] [INFO ] [MAIN ] Update Progress: 136/2370 symbols completed. APTV took 39.5s. Estimated remaining: 4h 52m 54s. Rate: 7.6 symbols/min [2025-10-02T17:17:53.888070] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-02T17:17:53.891914] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:17:53.911702] [DEBUG] [LOCAL ] ARDC: Loaded 14775 existing records from primary storage. [2025-10-02T17:17:53.911977] [INFO ] [MAIN ] ARDC: Loaded 14775 existing records. [2025-10-02T17:17:54.112844] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:17:54.113225] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-02T17:17:54.113414] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-02T17:17:54.114056] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-02T17:17:54.114121] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-02T17:17:54.420585] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-10-02T17:17:54.654966] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:17:54.673022] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-10-02T17:17:54.811364] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T17:17:55.182461] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:17:55.383942] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T17:17:55.473072] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-02T17:17:56.273000] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-02T17:17:57.072965] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-02T17:17:57.381364] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T17:17:57.423885] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T17:17:57.873054] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-02T17:17:57.890029] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T17:17:58.673092] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-02T17:17:59.479383] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-02T17:17:59.480871] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T17:17:59.742935] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T17:18:00.273041] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-02T17:18:01.073039] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-02T17:18:01.454589] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T17:18:01.872981] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-02T17:18:01.976033] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T17:18:02.673042] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-02T17:18:02.926374] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T17:18:03.434245] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T17:18:03.473090] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-02T17:18:03.567246] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T17:18:04.273025] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-02T17:18:05.060522] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-02T17:18:05.063502] [INFO ] [REMOTE ] AQN: Full fetch complete (75303 records). [2025-10-02T17:18:05.063753] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-02T17:18:05.080063] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-02T17:18:05.487601] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-02T17:18:05.487784] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-02T17:18:05.488934] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-02T17:18:05.489043] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-02T17:18:05.491201] [DEBUG] [LOCAL ] AQN: Trimmed 75303 records to 52288 (keeping 200 days of data) [2025-10-02T17:18:05.847030] [DEBUG] [LOCAL ] AQN: Primary data saved (52288 records). [2025-10-02T17:18:05.847258] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-02T17:18:05.847368] [INFO ] [MAIN ] Update Progress: 137/2370 symbols completed. AQN took 41.6s. Estimated remaining: 4h 53m 56s. Rate: 7.6 symbols/min [2025-10-02T17:18:05.882343] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-02T17:18:06.042867] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:18:06.080861] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T17:18:06.117704] [DEBUG] [LOCAL ] ARDT: Loaded 27653 existing records from primary storage. [2025-10-02T17:18:06.118104] [INFO ] [MAIN ] ARDT: Loaded 27653 existing records. [2025-10-02T17:18:06.299244] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:18:06.299574] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-02T17:18:06.299701] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-02T17:18:06.300712] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-02T17:18:06.300778] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-02T17:18:06.673687] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-02T17:18:06.749534] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:18:06.790739] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T17:18:06.999981] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T17:18:07.473037] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-02T17:18:08.149122] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T17:18:08.152188] [INFO ] [REMOTE ] AR: Full fetch complete (77533 records). [2025-10-02T17:18:08.152470] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-02T17:18:08.278246] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-10-02T17:18:08.580232] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-10-02T17:18:08.580339] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-10-02T17:18:08.581276] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-10-02T17:18:08.581353] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-10-02T17:18:08.583213] [DEBUG] [LOCAL ] AR: Trimmed 77533 records to 53973 (keeping 200 days of data) [2025-10-02T17:18:08.946765] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:18:08.982492] [DEBUG] [LOCAL ] AR: Primary data saved (53973 records). [2025-10-02T17:18:08.982692] [INFO ] [MAIN ] AR: Full history saved. [2025-10-02T17:18:08.983775] [INFO ] [MAIN ] Update Progress: 138/2370 symbols completed. AR took 39.1s. Estimated remaining: 4h 52m 31s. Rate: 7.6 symbols/min [2025-10-02T17:18:09.078104] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-02T17:18:09.181487] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:18:09.242090] [DEBUG] [LOCAL ] ARE: Loaded 50634 existing records from primary storage. [2025-10-02T17:18:09.242444] [INFO ] [MAIN ] ARE: Loaded 50634 existing records. [2025-10-02T17:18:09.444713] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:18:09.445066] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-02T17:18:09.445251] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-02T17:18:09.447560] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-10-02T17:18:09.447629] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-02T17:18:09.638258] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T17:18:09.870629] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:18:09.872975] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-10-02T17:18:10.648021] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T17:18:10.672983] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-02T17:18:11.473031] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-02T17:18:11.873663] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-02T17:18:12.203262] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T17:18:12.273039] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-02T17:18:12.407149] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T17:18:13.073000] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-02T17:18:13.460020] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T17:18:13.637456] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-02T17:18:13.873067] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-02T17:18:14.673004] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-02T17:18:15.370504] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:18:15.472993] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-02T17:18:15.822036] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T17:18:16.273043] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-02T17:18:16.818983] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T17:18:17.072981] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-02T17:18:17.486551] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T17:18:17.873032] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-02T17:18:18.523739] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T17:18:18.672980] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-02T17:18:18.820632] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-02T17:18:19.473014] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-02T17:18:20.272964] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-02T17:18:20.650618] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-02T17:18:20.969684] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T17:18:21.072969] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-02T17:18:21.872232] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:18:21.875771] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-02T17:18:21.932030] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T17:18:22.673043] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-02T17:18:22.714820] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T17:18:23.473036] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-02T17:18:23.798926] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:18:24.273074] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-02T17:18:25.072971] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-02T17:18:25.289473] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:18:25.866819] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T17:18:25.875669] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-02T17:18:25.892287] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T17:18:26.673044] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-02T17:18:26.692487] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T17:18:26.693948] [INFO ] [REMOTE ] ARDC: Full fetch complete (20672 records). [2025-10-02T17:18:26.694042] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-02T17:18:27.148147] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-02T17:18:27.148386] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-02T17:18:27.148802] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-02T17:18:27.148865] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-02T17:18:27.149823] [DEBUG] [LOCAL ] ARDC: Trimmed 20672 records to 14882 (keeping 200 days of data) [2025-10-02T17:18:27.249392] [DEBUG] [LOCAL ] ARDC: Primary data saved (14882 records). [2025-10-02T17:18:27.249546] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-02T17:18:27.249696] [INFO ] [MAIN ] Update Progress: 139/2370 symbols completed. ARDC took 33.5s. Estimated remaining: 4h 55m 11s. Rate: 7.6 symbols/min [2025-10-02T17:18:27.443384] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:18:27.443622] [DEBUG] [LOCAL ] ARES: No existing data file found in primary storage. [2025-10-02T17:18:27.443700] [WARN ] [MAIN ] ARES: No existing data found, performing full refresh instead. [2025-10-02T17:18:27.443878] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-02T17:18:27.443932] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-02T17:18:27.443976] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-10-02T17:18:27.444009] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-02T17:18:27.479210] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-02T17:18:27.858809] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:18:28.273000] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-10-02T17:18:28.481225] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T17:18:28.849779] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T17:18:28.851734] [INFO ] [REMOTE ] ARCO: Full fetch complete (65498 records). [2025-10-02T17:18:28.851865] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-02T17:18:29.079338] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-02T17:18:29.287188] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-02T17:18:29.287286] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-02T17:18:29.288168] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-02T17:18:29.288246] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-02T17:18:29.289820] [DEBUG] [LOCAL ] ARCO: Trimmed 65498 records to 44724 (keeping 200 days of data) [2025-10-02T17:18:29.572845] [DEBUG] [LOCAL ] ARCO: Primary data saved (44724 records). [2025-10-02T17:18:29.572980] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-02T17:18:29.574860] [INFO ] [MAIN ] Update Progress: 140/2370 symbols completed. ARCO took 41.6s. Estimated remaining: 4h 53m 33s. Rate: 7.6 symbols/min [2025-10-02T17:18:29.770199] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:18:29.800703] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T17:18:29.850355] [DEBUG] [LOCAL ] ARI: Loaded 43522 existing records from primary storage. [2025-10-02T17:18:29.850773] [INFO ] [MAIN ] ARI: Loaded 43522 existing records. [2025-10-02T17:18:29.882875] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-02T17:18:30.044581] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:18:30.044870] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-02T17:18:30.044922] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-02T17:18:30.046223] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-02T17:18:30.046287] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-02T17:18:30.444159] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:18:30.616035] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T17:18:30.673048] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-10-02T17:18:31.225888] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T17:18:31.473042] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-02T17:18:32.175730] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T17:18:32.273004] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-02T17:18:32.904293] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T17:18:33.073012] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-02T17:18:33.872982] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-02T17:18:33.913577] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T17:18:34.587545] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T17:18:34.672999] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-02T17:18:35.472994] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-02T17:18:35.579164] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T17:18:36.222516] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T17:18:36.272968] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-02T17:18:37.073094] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-02T17:18:37.154456] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T17:18:37.873003] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-02T17:18:37.910763] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T17:18:38.174336] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T17:18:38.673003] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-02T17:18:39.472972] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-02T17:18:39.629175] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T17:18:39.631038] [INFO ] [REMOTE ] ARDT: Full fetch complete (41228 records). [2025-10-02T17:18:39.631270] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-02T17:18:39.841451] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-02T17:18:40.082675] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-10-02T17:18:40.082768] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-10-02T17:18:40.083280] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-10-02T17:18:40.083322] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-10-02T17:18:40.084289] [DEBUG] [LOCAL ] ARDT: Trimmed 41228 records to 27847 (keeping 200 days of data) [2025-10-02T17:18:40.252053] [DEBUG] [LOCAL ] ARDT: Primary data saved (27847 records). [2025-10-02T17:18:40.252192] [INFO ] [MAIN ] ARDT: Full history saved. [2025-10-02T17:18:40.252377] [INFO ] [MAIN ] Update Progress: 141/2370 symbols completed. ARDT took 34.4s. Estimated remaining: 4h 54m 9s. Rate: 7.6 symbols/min [2025-10-02T17:18:40.278139] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-02T17:18:40.446923] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:18:40.491229] [DEBUG] [LOCAL ] ARIS: Loaded 42157 existing records from primary storage. [2025-10-02T17:18:40.491551] [INFO ] [MAIN ] ARIS: Loaded 42157 existing records. [2025-10-02T17:18:40.683013] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:18:40.683239] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-10-02T17:18:40.683289] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-02T17:18:40.684802] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-10-02T17:18:40.684865] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-10-02T17:18:41.076217] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-02T17:18:41.076122] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:18:41.466921] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T17:18:41.872997] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-10-02T17:18:42.673011] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-02T17:18:42.802214] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-02T17:18:42.879624] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:18:42.912357] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T17:18:43.473040] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-02T17:18:44.157108] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T17:18:44.273026] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-02T17:18:44.924807] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T17:18:44.928762] [INFO ] [REMOTE ] ARE: Full fetch complete (72644 records). [2025-10-02T17:18:44.928964] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-02T17:18:45.078118] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-02T17:18:45.376434] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-10-02T17:18:45.376529] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-10-02T17:18:45.377370] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-10-02T17:18:45.377464] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-10-02T17:18:45.379416] [DEBUG] [LOCAL ] ARE: Trimmed 72644 records to 51001 (keeping 200 days of data) [2025-10-02T17:18:45.732096] [DEBUG] [LOCAL ] ARE: Primary data saved (51001 records). [2025-10-02T17:18:45.732390] [INFO ] [MAIN ] ARE: Full history saved. [2025-10-02T17:18:45.734744] [INFO ] [MAIN ] Update Progress: 142/2370 symbols completed. ARE took 36.8s. Estimated remaining: 4h 53m 23s. Rate: 7.6 symbols/min [2025-10-02T17:18:45.874057] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-10-02T17:18:45.927850] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:18:45.961353] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T17:18:46.019026] [DEBUG] [LOCAL ] ARLO: Loaded 43792 existing records from primary storage. [2025-10-02T17:18:46.019367] [INFO ] [MAIN ] ARLO: Loaded 43792 existing records. [2025-10-02T17:18:46.216292] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:18:46.216559] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-02T17:18:46.216623] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-02T17:18:46.218070] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-10-02T17:18:46.218145] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-02T17:18:46.690744] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:18:46.679576] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-02T17:18:46.704974] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T17:18:47.473054] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-02T17:18:47.596885] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T17:18:48.273020] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-10-02T17:18:48.480164] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:18:48.775640] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T17:18:49.073007] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-10-02T17:18:49.788826] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T17:18:49.873005] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-02T17:18:50.509173] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T17:18:50.672998] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-02T17:18:51.386823] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T17:18:51.473009] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-10-02T17:18:52.173165] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:18:52.273007] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-02T17:18:53.041883] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T17:18:53.073004] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-02T17:18:53.546757] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T17:18:53.873019] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-10-02T17:18:54.664043] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T17:18:54.674714] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-02T17:18:55.473066] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-02T17:18:55.511929] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T17:18:55.707558] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T17:18:56.273010] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-10-02T17:18:56.658960] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T17:18:57.073006] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-02T17:18:57.872948] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T17:18:57.873091] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-02T17:18:58.672977] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-10-02T17:18:58.707202] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T17:18:59.421606] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T17:18:59.424023] [INFO ] [REMOTE ] ARES: Full fetch complete (70745 records). [2025-10-02T17:18:59.424139] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-02T17:18:59.484469] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-02T17:18:59.870627] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-02T17:18:59.870851] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-02T17:18:59.871712] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-02T17:18:59.871823] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-02T17:18:59.873483] [DEBUG] [LOCAL ] ARES: Trimmed 70745 records to 49934 (keeping 200 days of data) [2025-10-02T17:19:00.128540] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T17:19:00.274298] [DEBUG] [LOCAL ] ARES: Primary data saved (49934 records). [2025-10-02T17:19:00.274389] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-10-02T17:19:00.274730] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-02T17:19:00.275904] [INFO ] [MAIN ] Update Progress: 143/2370 symbols completed. ARES took 33.0s. Estimated remaining: 4h 54m 59s. Rate: 7.5 symbols/min [2025-10-02T17:19:00.480888] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:00.529899] [DEBUG] [LOCAL ] ARMK: Loaded 50366 existing records from primary storage. [2025-10-02T17:19:00.530289] [INFO ] [MAIN ] ARMK: Loaded 50366 existing records. [2025-10-02T17:19:00.722163] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:00.722392] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-02T17:19:00.722461] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-02T17:19:00.723905] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-02T17:19:00.723978] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-02T17:19:01.087630] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-02T17:19:01.141738] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:01.171923] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T17:19:01.873000] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-10-02T17:19:02.302664] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T17:19:02.381761] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T17:19:02.672990] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-10-02T17:19:03.236965] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T17:19:03.472969] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-02T17:19:04.272994] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-02T17:19:04.353520] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T17:19:05.078159] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-10-02T17:19:05.101357] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:19:05.380082] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T17:19:05.382007] [INFO ] [REMOTE ] ARI: Full fetch complete (62856 records). [2025-10-02T17:19:05.382119] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-02T17:19:05.821248] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-02T17:19:05.821337] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-02T17:19:05.822068] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-02T17:19:05.822138] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-02T17:19:05.823457] [DEBUG] [LOCAL ] ARI: Trimmed 62856 records to 43834 (keeping 200 days of data) [2025-10-02T17:19:05.888981] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-02T17:19:06.135862] [DEBUG] [LOCAL ] ARI: Primary data saved (43834 records). [2025-10-02T17:19:06.136004] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-02T17:19:06.136918] [INFO ] [MAIN ] Update Progress: 144/2370 symbols completed. ARI took 36.6s. Estimated remaining: 4h 54m 18s. Rate: 7.6 symbols/min [2025-10-02T17:19:06.339800] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:06.401404] [DEBUG] [LOCAL ] AROC: Loaded 48961 existing records from primary storage. [2025-10-02T17:19:06.401774] [INFO ] [MAIN ] AROC: Loaded 48961 existing records. [2025-10-02T17:19:06.612267] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:06.612808] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-02T17:19:06.612898] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-02T17:19:06.614493] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-02T17:19:06.614559] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-02T17:19:06.692012] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-02T17:19:06.931172] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T17:19:07.073079] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:07.472974] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-10. [2025-10-02T17:19:07.641629] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T17:19:08.210757] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T17:19:08.272982] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-02T17:19:08.740738] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T17:19:08.742493] [INFO ] [REMOTE ] ARIS: Full fetch complete (60223 records). [2025-10-02T17:19:08.742608] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-10-02T17:19:08.743347] [FATAL] [VALIDATOR ] ARIS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:19:08.743441] [FATAL] [MAIN ] ARIS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:19:08.743486] [WARN ] [MAIN ] ARIS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:19:08.743557] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-10-02T17:19:08.743628] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-10-02T17:19:08.743710] [INFO ] [LOCAL ] ARIS: Starting deletion of derivative data. [2025-10-02T17:19:08.744414] [DEBUG] [LOCAL ] ARIS: Deleted derivative data file. [2025-10-02T17:19:08.744555] [INFO ] [MAIN ] Update Progress: 145/2370 symbols completed. ARIS took 28.5s. Estimated remaining: 4h 52m 49s. Rate: 7.6 symbols/min [2025-10-02T17:19:08.926491] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:08.926694] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-02T17:19:08.926749] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-02T17:19:08.926863] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-02T17:19:08.926906] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-02T17:19:08.926950] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-02T17:19:08.926983] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-02T17:19:09.080325] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-10-02T17:19:09.322877] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:09.872978] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-10-02T17:19:10.056734] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T17:19:10.673002] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-02T17:19:10.749826] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:19:11.473049] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-02T17:19:12.012630] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T17:19:12.094090] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-02T17:19:12.272998] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-02T17:19:13.073011] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-02T17:19:13.227739] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T17:19:13.873014] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-02T17:19:14.084847] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-02T17:19:14.439412] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T17:19:14.673023] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-02T17:19:15.129133] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T17:19:15.473063] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-02T17:19:16.198984] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:19:16.273016] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-02T17:19:16.879419] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T17:19:17.073023] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-02T17:19:17.652752] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T17:19:17.873014] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-02T17:19:18.673011] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-02T17:19:19.057440] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T17:19:19.472978] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-02T17:19:19.650165] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T17:19:20.273018] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-02T17:19:20.664213] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T17:19:21.073019] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-02T17:19:21.535684] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-02T17:19:21.873013] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-02T17:19:22.238488] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T17:19:22.673024] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-02T17:19:22.819143] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T17:19:23.472980] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-02T17:19:23.670260] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T17:19:24.029020] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T17:19:24.272997] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-02T17:19:24.896160] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T17:19:24.899110] [INFO ] [REMOTE ] ARLO: Full fetch complete (62819 records). [2025-10-02T17:19:24.899330] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-02T17:19:25.086272] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-02T17:19:25.337787] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-02T17:19:25.337907] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-02T17:19:25.338682] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-02T17:19:25.338750] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-02T17:19:25.340303] [DEBUG] [LOCAL ] ARLO: Trimmed 62819 records to 44159 (keeping 200 days of data) [2025-10-02T17:19:25.612733] [DEBUG] [LOCAL ] ARLO: Primary data saved (44159 records). [2025-10-02T17:19:25.612876] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-02T17:19:25.613962] [INFO ] [MAIN ] Update Progress: 146/2370 symbols completed. ARLO took 39.9s. Estimated remaining: 4h 54m 58s. Rate: 7.5 symbols/min [2025-10-02T17:19:25.808609] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:25.850027] [DEBUG] [LOCAL ] ARW: Loaded 33095 existing records from primary storage. [2025-10-02T17:19:25.850413] [INFO ] [MAIN ] ARW: Loaded 33095 existing records. [2025-10-02T17:19:25.878143] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-02T17:19:26.089258] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:26.090055] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-02T17:19:26.090117] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-02T17:19:26.091607] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T17:19:26.103163] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-10-02T17:19:26.103252] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-02T17:19:26.492757] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:26.672967] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-02T17:19:26.780130] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T17:19:27.472981] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-10-02T17:19:27.811827] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-02T17:19:28.272970] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-02T17:19:28.378857] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T17:19:28.735475] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T17:19:29.073030] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-02T17:19:29.864126] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T17:19:29.875366] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-02T17:19:30.673000] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-02T17:19:30.711727] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:19:31.473017] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-02T17:19:31.618959] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T17:19:31.686863] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T17:19:32.273044] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-02T17:19:33.072984] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-02T17:19:33.259114] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T17:19:33.872998] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-02T17:19:34.274660] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T17:19:34.489101] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T17:19:34.673017] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-02T17:19:35.473029] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-02T17:19:35.582058] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T17:19:36.057996] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T17:19:36.060096] [INFO ] [REMOTE ] ARMK: Full fetch complete (72568 records). [2025-10-02T17:19:36.060219] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-02T17:19:36.278198] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-02T17:19:36.510313] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-02T17:19:36.510405] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-02T17:19:36.511207] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-02T17:19:36.511283] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-02T17:19:36.513071] [DEBUG] [LOCAL ] ARMK: Trimmed 72568 records to 50699 (keeping 200 days of data) [2025-10-02T17:19:36.844825] [DEBUG] [LOCAL ] ARMK: Primary data saved (50699 records). [2025-10-02T17:19:36.845012] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-02T17:19:36.845140] [INFO ] [MAIN ] Update Progress: 147/2370 symbols completed. ARMK took 36.6s. Estimated remaining: 4h 55m 39s. Rate: 7.5 symbols/min [2025-10-02T17:19:37.056760] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:37.056959] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-02T17:19:37.057003] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-02T17:19:37.057133] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-02T17:19:37.057177] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-02T17:19:37.057219] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-02T17:19:37.057251] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-02T17:19:37.092014] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-02T17:19:37.488244] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:37.521883] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-02T17:19:37.659701] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T17:19:37.873001] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-02T17:19:38.673001] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-02T17:19:38.951923] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T17:19:39.473040] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-02T17:19:39.734825] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-02T17:19:39.737825] [INFO ] [REMOTE ] ARR: Full fetch complete (75228 records). [2025-10-02T17:19:39.737986] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-02T17:19:40.194155] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-10-02T17:19:40.194254] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-10-02T17:19:40.195205] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-10-02T17:19:40.195273] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-10-02T17:19:40.196979] [DEBUG] [LOCAL ] ARR: Trimmed 75228 records to 52419 (keeping 200 days of data) [2025-10-02T17:19:40.299432] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-10-02T17:19:40.354812] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T17:19:40.542360] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:19:40.564214] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-10-02T17:19:40.565498] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:19:40.565862] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-02T17:19:40.567464] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:19:40.568104] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-02T17:19:40.569921] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-02T17:19:40.571958] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-02T17:19:40.573548] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-02T17:19:40.574572] [INFO ] [MAIN ] Update Progress: 148/2370 symbols completed. ARX took 3.7s. Estimated remaining: 4h 54m 27s. Rate: 7.5 symbols/min [2025-10-02T17:19:40.680323] [DEBUG] [LOCAL ] ARR: Primary data saved (52419 records). [2025-10-02T17:19:40.696784] [INFO ] [MAIN ] ARR: Full history saved. [2025-10-02T17:19:40.701263] [INFO ] [MAIN ] Update Progress: 149/2370 symbols completed. ARR took 32.0s. Estimated remaining: 4h 52m 23s. Rate: 7.6 symbols/min [2025-10-02T17:19:40.867954] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:40.973515] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T17:19:40.977877] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:40.980716] [INFO ] [REMOTE ] AROC: Full fetch complete (70806 records). [2025-10-02T17:19:40.980889] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-02T17:19:41.073505] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-02T17:19:41.105669] [DEBUG] [LOCAL ] ASA: Loaded 14164 existing records from primary storage. [2025-10-02T17:19:41.162962] [INFO ] [MAIN ] ASA: Loaded 14164 existing records. [2025-10-02T17:19:41.363248] [DEBUG] [LOCAL ] AS: Loaded 53087 existing records from primary storage. [2025-10-02T17:19:41.454074] [INFO ] [MAIN ] AS: Loaded 53087 existing records. [2025-10-02T17:19:41.684585] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:41.745961] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-02T17:19:41.774007] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-02T17:19:41.808376] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-02T17:19:41.824257] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-10-02T17:19:41.849334] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-02T17:19:41.849438] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-02T17:19:41.897366] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:41.942449] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-02T17:19:41.970398] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-02T17:19:41.990398] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-02T17:19:41.990528] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-02T17:19:42.012703] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-02T17:19:42.019325] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-02T17:19:42.109917] [DEBUG] [LOCAL ] AROC: Trimmed 70806 records to 49327 (keeping 200 days of data) [2025-10-02T17:19:42.779917] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:42.813368] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-10-02T17:19:42.969598] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T17:19:42.983780] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:43.014905] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-10-02T17:19:43.118239] [DEBUG] [LOCAL ] AROC: Primary data saved (49327 records). [2025-10-02T17:19:43.118385] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-02T17:19:43.118470] [INFO ] [MAIN ] Update Progress: 150/2370 symbols completed. AROC took 37.0s. Estimated remaining: 4h 50m 54s. Rate: 7.6 symbols/min [2025-10-02T17:19:43.304015] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:43.369194] [DEBUG] [LOCAL ] ASAN: Loaded 52722 existing records from primary storage. [2025-10-02T17:19:43.369603] [INFO ] [MAIN ] ASAN: Loaded 52722 existing records. [2025-10-02T17:19:43.478294] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-02T17:19:43.597951] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:43.598244] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-02T17:19:43.598300] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-02T17:19:43.599363] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-10-02T17:19:43.599423] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-02T17:19:43.878493] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T17:19:43.992786] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:44.273005] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-02T17:19:44.617079] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T17:19:44.814121] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T17:19:45.076541] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-02T17:19:45.079623] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T17:19:45.873030] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-02T17:19:46.161898] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T17:19:46.673014] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-10-02T17:19:47.473013] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-02T17:19:47.512267] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T17:19:48.273034] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-02T17:19:48.489370] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T17:19:48.940229] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T17:19:49.073005] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-02T17:19:49.880883] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-02T17:19:49.905281] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T17:19:50.476940] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:19:50.673016] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-02T17:19:50.690320] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T17:19:51.473009] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-02T17:19:52.176792] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T17:19:52.197757] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T17:19:52.273002] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-02T17:19:53.073026] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-02T17:19:53.709265] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T17:19:53.873018] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-02T17:19:54.246379] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T17:19:54.672999] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-02T17:19:55.472995] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-02T17:19:55.588558] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T17:19:55.866255] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T17:19:55.868481] [INFO ] [REMOTE ] ARW: Full fetch complete (47988 records). [2025-10-02T17:19:55.868702] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-02T17:19:56.301208] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-02T17:19:56.320225] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-02T17:19:56.320345] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-02T17:19:56.321200] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-02T17:19:56.321285] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-02T17:19:56.333108] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T17:19:56.333220] [DEBUG] [LOCAL ] ARW: Trimmed 47988 records to 33339 (keeping 200 days of data) [2025-10-02T17:19:56.555144] [DEBUG] [LOCAL ] ARW: Primary data saved (33339 records). [2025-10-02T17:19:56.555290] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-02T17:19:56.556441] [INFO ] [MAIN ] Update Progress: 151/2370 symbols completed. ARW took 30.9s. Estimated remaining: 4h 52m 8s. Rate: 7.6 symbols/min [2025-10-02T17:19:56.744595] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:19:56.798895] [DEBUG] [LOCAL ] ASB: Loaded 49511 existing records from primary storage. [2025-10-02T17:19:56.799308] [INFO ] [MAIN ] ASB: Loaded 49511 existing records. [2025-10-02T17:19:56.990088] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:19:56.990354] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-02T17:19:56.990404] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-02T17:19:56.991550] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-10-02T17:19:56.991612] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-02T17:19:57.078262] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-02T17:19:57.387616] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:19:57.872999] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-02T17:19:58.326585] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T17:19:58.676436] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-02T17:19:58.685180] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T17:19:58.707430] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T17:19:59.473035] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-02T17:20:00.262215] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T17:20:00.272976] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-02T17:20:01.073059] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-10-02T17:20:01.243940] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T17:20:01.376383] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T17:20:01.873004] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-02T17:20:02.672999] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-02T17:20:02.943000] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T17:20:03.472967] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-02T17:20:03.697030] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T17:20:03.746191] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T17:20:04.273008] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-02T17:20:05.072989] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-02T17:20:05.194989] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T17:20:05.289266] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T17:20:05.873013] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-02T17:20:06.673031] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-02T17:20:06.949032] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T17:20:07.102365] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-02T17:20:07.473043] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-02T17:20:08.286179] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-02T17:20:08.292926] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T17:20:09.072965] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-02T17:20:09.346887] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-02T17:20:09.671257] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:20:09.873034] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-02T17:20:10.673029] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-02T17:20:10.853244] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T17:20:10.870272] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T17:20:10.871708] [INFO ] [REMOTE ] ASA: Full fetch complete (18960 records). [2025-10-02T17:20:10.871846] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-02T17:20:11.345810] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-02T17:20:11.345893] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-02T17:20:11.346231] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-02T17:20:11.346279] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-02T17:20:11.346975] [DEBUG] [LOCAL ] ASA: Trimmed 18960 records to 14321 (keeping 200 days of data) [2025-10-02T17:20:11.437062] [DEBUG] [LOCAL ] ASA: Primary data saved (14321 records). [2025-10-02T17:20:11.437254] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-02T17:20:11.437357] [INFO ] [MAIN ] Update Progress: 152/2370 symbols completed. ASA took 30.7s. Estimated remaining: 4h 53m 42s. Rate: 7.6 symbols/min [2025-10-02T17:20:11.478161] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-02T17:20:11.653239] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:20:11.653435] [DEBUG] [LOCAL ] ASBA: No existing data file found in primary storage. [2025-10-02T17:20:11.653475] [WARN ] [MAIN ] ASBA: No existing data found, performing full refresh instead. [2025-10-02T17:20:11.653617] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-02T17:20:11.653707] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-02T17:20:11.653764] [DEBUG] [LOCAL ] ASBA: No primary data file found to delete. [2025-10-02T17:20:11.653800] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-02T17:20:12.061627] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:20:12.272962] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-02T17:20:12.761108] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T17:20:13.073008] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-02T17:20:13.873067] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-10-02T17:20:14.276252] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-02T17:20:14.278709] [INFO ] [REMOTE ] AS: Full fetch complete (76550 records). [2025-10-02T17:20:14.278858] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-02T17:20:14.521763] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T17:20:14.681975] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-02T17:20:14.735249] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-02T17:20:14.735351] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-02T17:20:14.736174] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-02T17:20:14.736398] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-02T17:20:14.738524] [DEBUG] [LOCAL ] AS: Trimmed 76550 records to 53472 (keeping 200 days of data) [2025-10-02T17:20:14.866787] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T17:20:15.115850] [DEBUG] [LOCAL ] AS: Primary data saved (53472 records). [2025-10-02T17:20:15.115997] [INFO ] [MAIN ] AS: Full history saved. [2025-10-02T17:20:15.116085] [INFO ] [MAIN ] Update Progress: 153/2370 symbols completed. AS took 34.5s. Estimated remaining: 4h 52m 32s. Rate: 7.6 symbols/min [2025-10-02T17:20:15.310395] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:20:15.349848] [DEBUG] [LOCAL ] ASC: Loaded 37387 existing records from primary storage. [2025-10-02T17:20:15.350150] [INFO ] [MAIN ] ASC: Loaded 37387 existing records. [2025-10-02T17:20:15.474985] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-02T17:20:15.477048] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T17:20:15.598762] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:20:15.599087] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-02T17:20:15.601404] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (4.12 seconds). [2025-10-02T17:20:15.599874] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-02T17:20:15.612011] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-10-02T17:20:15.612595] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-02T17:20:16.015831] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:20:16.273010] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-02T17:20:17.073016] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-02T17:20:17.159036] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T17:20:17.332986] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T17:20:17.873044] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-02T17:20:18.495906] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T17:20:18.673005] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-10-02T17:20:18.811469] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T17:20:19.473053] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-02T17:20:20.278424] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-02T17:20:20.290985] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T17:20:21.073002] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-02T17:20:21.177728] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T17:20:21.210962] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T17:20:21.873002] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-02T17:20:22.455155] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T17:20:22.672970] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-02T17:20:22.911629] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-02T17:20:22.913851] [INFO ] [REMOTE ] ASAN: Full fetch complete (76529 records). [2025-10-02T17:20:22.913979] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-02T17:20:23.354045] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-02T17:20:23.354143] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-02T17:20:23.354946] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-02T17:20:23.355023] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-02T17:20:23.356525] [DEBUG] [LOCAL ] ASAN: Trimmed 76529 records to 53110 (keeping 200 days of data) [2025-10-02T17:20:23.474754] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-02T17:20:23.700009] [DEBUG] [LOCAL ] ASAN: Primary data saved (53110 records). [2025-10-02T17:20:23.700188] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-02T17:20:23.701420] [INFO ] [MAIN ] Update Progress: 154/2370 symbols completed. ASAN took 40.6s. Estimated remaining: 4h 52m 34s. Rate: 7.6 symbols/min [2025-10-02T17:20:23.894303] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:20:23.916149] [DEBUG] [LOCAL ] ASG: Loaded 19882 existing records from primary storage. [2025-10-02T17:20:23.916425] [INFO ] [MAIN ] ASG: Loaded 19882 existing records. [2025-10-02T17:20:24.122092] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:20:24.122474] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-02T17:20:24.122572] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-02T17:20:24.123217] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-02T17:20:24.123288] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-02T17:20:24.281851] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-02T17:20:24.322069] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T17:20:24.561683] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:20:25.072959] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-02T17:20:25.173584] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T17:20:25.263037] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T17:20:25.873013] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-02T17:20:26.525594] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-02T17:20:26.672980] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-10-02T17:20:26.962537] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T17:20:27.473010] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-02T17:20:27.877427] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-02T17:20:28.273025] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-02T17:20:28.749923] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T17:20:29.073030] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-02T17:20:29.474482] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T17:20:29.494056] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-02T17:20:29.873036] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-02T17:20:30.422819] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T17:20:30.673038] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-02T17:20:31.131821] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T17:20:31.132639] [INFO ] [REMOTE ] ASBA: Full fetch complete (5268 records). [2025-10-02T17:20:31.132769] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-02T17:20:31.481251] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-02T17:20:31.519175] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-02T17:20:31.519269] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-02T17:20:31.519560] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-02T17:20:31.519603] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-02T17:20:31.520045] [DEBUG] [LOCAL ] ASBA: Trimmed 5268 records to 3476 (keeping 200 days of data) [2025-10-02T17:20:31.542584] [DEBUG] [LOCAL ] ASBA: Primary data saved (3476 records). [2025-10-02T17:20:31.543202] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-02T17:20:31.543483] [INFO ] [MAIN ] Update Progress: 155/2370 symbols completed. ASBA took 20.1s. Estimated remaining: 4h 52m 25s. Rate: 7.6 symbols/min [2025-10-02T17:20:31.716511] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:20:31.742292] [DEBUG] [LOCAL ] ASGI: Loaded 22690 existing records from primary storage. [2025-10-02T17:20:31.742736] [INFO ] [MAIN ] ASGI: Loaded 22690 existing records. [2025-10-02T17:20:31.936765] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:20:31.937016] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-02T17:20:31.937068] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-02T17:20:31.937706] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-10-02T17:20:31.937769] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-02T17:20:32.278171] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-02T17:20:32.353688] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:20:32.649670] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T17:20:33.072995] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-02T17:20:33.731537] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T17:20:33.872995] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-02T17:20:34.358808] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T17:20:34.673036] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-02T17:20:35.382817] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:20:35.473013] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-02T17:20:36.272979] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-02T17:20:36.472906] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:20:36.584376] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T17:20:37.073056] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-02T17:20:37.553615] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T17:20:37.873003] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-02T17:20:38.550563] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T17:20:38.552634] [INFO ] [REMOTE ] ASB: Full fetch complete (71657 records). [2025-10-02T17:20:38.552803] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-02T17:20:38.678113] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-10-02T17:20:39.018563] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-02T17:20:39.018721] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-02T17:20:39.019495] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-02T17:20:39.019672] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-02T17:20:39.021152] [DEBUG] [LOCAL ] ASB: Trimmed 71657 records to 49883 (keeping 200 days of data) [2025-10-02T17:20:39.149962] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T17:20:39.361161] [DEBUG] [LOCAL ] ASB: Primary data saved (49883 records). [2025-10-02T17:20:39.361313] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-02T17:20:39.362279] [INFO ] [MAIN ] Update Progress: 156/2370 symbols completed. ASB took 42.8s. Estimated remaining: 4h 52m 15s. Rate: 7.6 symbols/min [2025-10-02T17:20:39.475822] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-02T17:20:39.558819] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:20:39.603563] [DEBUG] [LOCAL ] ASGN: Loaded 36096 existing records from primary storage. [2025-10-02T17:20:39.603893] [INFO ] [MAIN ] ASGN: Loaded 36096 existing records. [2025-10-02T17:20:39.810154] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:20:39.810381] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-02T17:20:39.810433] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-02T17:20:39.811562] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-02T17:20:39.811628] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-02T17:20:40.127476] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T17:20:40.245476] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:20:40.272962] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-10-02T17:20:40.398925] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T17:20:41.073010] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-02T17:20:41.873021] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-02T17:20:41.994504] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T17:20:42.651879] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:20:42.672965] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-02T17:20:42.712547] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T17:20:43.473004] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-02T17:20:44.272973] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-02T17:20:44.358529] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T17:20:44.482797] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T17:20:45.073005] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-02T17:20:45.622100] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T17:20:45.872971] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-02T17:20:46.180286] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T17:20:46.672995] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-02T17:20:47.349334] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T17:20:47.472967] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-02T17:20:47.928879] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T17:20:48.272994] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-02T17:20:49.018075] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T17:20:49.073019] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-02T17:20:49.778734] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:20:49.872992] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-02T17:20:49.930476] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T17:20:49.931557] [INFO ] [REMOTE ] ASG: Full fetch complete (31233 records). [2025-10-02T17:20:49.931634] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-02T17:20:50.350767] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-02T17:20:50.350877] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-02T17:20:50.351384] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-02T17:20:50.351452] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-02T17:20:50.352488] [DEBUG] [LOCAL ] ASG: Trimmed 31233 records to 19972 (keeping 200 days of data) [2025-10-02T17:20:50.471673] [DEBUG] [LOCAL ] ASG: Primary data saved (19972 records). [2025-10-02T17:20:50.471828] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-02T17:20:50.471914] [INFO ] [MAIN ] Update Progress: 157/2370 symbols completed. ASG took 26.8s. Estimated remaining: 4h 52m 52s. Rate: 7.6 symbols/min [2025-10-02T17:20:50.673010] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-02T17:20:51.139494] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-02T17:20:51.473029] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-02T17:20:51.842718] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:20:52.273003] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-02T17:20:52.626001] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T17:20:53.073034] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-02T17:20:53.390736] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T17:20:53.872996] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-02T17:20:54.335766] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T17:20:54.673002] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-02T17:20:55.295774] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T17:20:55.473000] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-02T17:20:56.010232] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:20:56.012127] [INFO ] [REMOTE ] ASC: Full fetch complete (56604 records). [2025-10-02T17:20:56.012224] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-02T17:20:56.282096] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-02T17:20:56.435971] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-02T17:20:56.436100] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-02T17:20:56.436894] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-02T17:20:56.436963] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-02T17:20:56.438548] [DEBUG] [LOCAL ] ASC: Trimmed 56604 records to 37698 (keeping 200 days of data) [2025-10-02T17:20:56.673250] [DEBUG] [LOCAL ] ASC: Primary data saved (37698 records). [2025-10-02T17:20:56.673408] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-02T17:20:56.673532] [INFO ] [MAIN ] Update Progress: 158/2370 symbols completed. ASC took 41.6s. Estimated remaining: 4h 52m 20s. Rate: 7.6 symbols/min [2025-10-02T17:20:56.981067] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T17:20:57.073066] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-02T17:20:57.157989] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T17:20:57.873118] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-02T17:20:58.495101] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T17:20:58.673063] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-02T17:20:58.995801] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T17:20:59.473032] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-02T17:20:59.902094] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T17:21:00.272982] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-02T17:21:00.472361] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T17:21:01.073034] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-02T17:21:01.334461] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T17:21:01.335941] [INFO ] [REMOTE ] ASGN: Full fetch complete (52069 records). [2025-10-02T17:21:01.336031] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-02T17:21:01.336636] [FATAL] [VALIDATOR ] ASGN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:21:01.336750] [FATAL] [MAIN ] ASGN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:21:01.336794] [WARN ] [MAIN ] ASGN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:21:01.336860] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-02T17:21:01.336915] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-10-02T17:21:01.336952] [INFO ] [LOCAL ] ASGN: Starting deletion of derivative data. [2025-10-02T17:21:01.337632] [DEBUG] [LOCAL ] ASGN: Deleted derivative data file. [2025-10-02T17:21:01.340623] [INFO ] [MAIN ] Update Progress: 159/2370 symbols completed. ASGN took 22.0s. Estimated remaining: 4h 51m 27s. Rate: 7.6 symbols/min [2025-10-02T17:21:05.788793] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (4.72 seconds). [2025-10-02T17:21:05.794060] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-02T17:21:06.865407] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T17:21:06.871613] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-02T17:21:07.992011] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T17:21:07.997422] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-02T17:21:08.844758] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T17:21:08.851099] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-02T17:21:09.755215] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T17:21:09.756602] [INFO ] [REMOTE ] ASGI: Full fetch complete (33630 records). [2025-10-02T17:21:09.756763] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-02T17:21:10.171882] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-02T17:21:10.171969] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-02T17:21:10.172442] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-02T17:21:10.172494] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-02T17:21:10.173544] [DEBUG] [LOCAL ] ASGI: Trimmed 33630 records to 22922 (keeping 200 days of data) [2025-10-02T17:21:10.315841] [DEBUG] [LOCAL ] ASGI: Primary data saved (22922 records). [2025-10-02T17:21:10.315993] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-02T17:21:10.316080] [INFO ] [MAIN ] Update Progress: 160/2370 symbols completed. ASGI took 38.8s. Estimated remaining: 4h 51m 34s. Rate: 7.6 symbols/min [2025-10-02T17:21:11.002772] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:11.050026] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:11.117431] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:11.131119] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:11.144012] [DEBUG] [LOCAL ] ASR: Loaded 9345 existing records from primary storage. [2025-10-02T17:21:11.144502] [INFO ] [MAIN ] ASR: Loaded 9345 existing records. [2025-10-02T17:21:11.299063] [DEBUG] [LOCAL ] ASIX: Loaded 22665 existing records from primary storage. [2025-10-02T17:21:11.311123] [INFO ] [MAIN ] ASIX: Loaded 22665 existing records. [2025-10-02T17:21:11.410266] [DEBUG] [LOCAL ] ASH: Loaded 37770 existing records from primary storage. [2025-10-02T17:21:11.458682] [DEBUG] [LOCAL ] ASPN: Loaded 49592 existing records from primary storage. [2025-10-02T17:21:11.464183] [INFO ] [MAIN ] ASH: Loaded 37770 existing records. [2025-10-02T17:21:11.510336] [INFO ] [MAIN ] ASPN: Loaded 49592 existing records. [2025-10-02T17:21:11.499145] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:11.558121] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-02T17:21:11.598777] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-02T17:21:11.755265] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-02T17:21:11.820354] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-02T17:21:12.067433] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:12.064309] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:12.125787] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-02T17:21:12.125518] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-02T17:21:12.136432] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-02T17:21:12.166047] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-02T17:21:12.154532] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-02T17:21:12.170281] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:12.196969] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-02T17:21:12.197138] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-02T17:21:12.191682] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-02T17:21:12.196892] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-02T17:21:12.230304] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-02T17:21:12.299181] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-02T17:21:12.358188] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-02T17:21:13.308631] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:13.427169] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-10-02T17:21:13.686506] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:13.758519] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:13.764217] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-10-02T17:21:13.785525] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-10-02T17:21:13.881834] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:13.882204] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-10-02T17:21:14.573837] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T17:21:14.576562] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-02T17:21:14.866824] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T17:21:14.870749] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-02T17:21:14.987343] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T17:21:14.994768] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-02T17:21:15.107732] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-02T17:21:15.109972] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-02T17:21:15.526986] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-02T17:21:15.534355] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-02T17:21:15.786212] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T17:21:15.796994] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-02T17:21:15.892608] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T17:21:15.895092] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-02T17:21:16.273542] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T17:21:16.278438] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-02T17:21:16.374481] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T17:21:16.383044] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-02T17:21:16.390038] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-02T17:21:16.392513] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-02T17:21:17.170906] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T17:21:17.181348] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-02T17:21:17.315034] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T17:21:17.318377] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-02T17:21:17.377741] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T17:21:17.539188] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T17:21:17.873023] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-02T17:21:17.930205] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T17:21:18.482210] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T17:21:18.673083] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-02T17:21:18.817188] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-02T17:21:19.181299] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T17:21:19.473003] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-02T17:21:20.270797] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-02T17:21:20.273028] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-02T17:21:21.073028] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-02T17:21:21.190186] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T17:21:21.873007] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-02T17:21:22.428838] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:21:22.673026] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-02T17:21:23.473039] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-02T17:21:23.587781] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T17:21:24.102021] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T17:21:24.273015] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-02T17:21:24.309457] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T17:21:25.072998] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-02T17:21:25.873041] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-02T17:21:25.950937] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T17:21:26.008541] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T17:21:26.673032] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-02T17:21:27.473006] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-02T17:21:27.576854] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T17:21:27.657954] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T17:21:28.273008] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-02T17:21:28.351300] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T17:21:28.925477] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T17:21:28.926354] [INFO ] [REMOTE ] ASR: Full fetch complete (12506 records). [2025-10-02T17:21:28.926481] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-02T17:21:29.078170] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-02T17:21:29.360462] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-10-02T17:21:29.360540] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-10-02T17:21:29.360837] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-10-02T17:21:29.360925] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-10-02T17:21:29.361464] [DEBUG] [LOCAL ] ASR: Trimmed 12506 records to 9377 (keeping 200 days of data) [2025-10-02T17:21:29.425025] [DEBUG] [LOCAL ] ASR: Primary data saved (9377 records). [2025-10-02T17:21:29.425345] [INFO ] [MAIN ] ASR: Full history saved. [2025-10-02T17:21:29.425461] [INFO ] [MAIN ] Update Progress: 161/2370 symbols completed. ASR took 19.1s. Estimated remaining: 4h 53m 59s. Rate: 7.5 symbols/min [2025-10-02T17:21:29.607801] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:29.674710] [DEBUG] [LOCAL ] ASX: Loaded 52844 existing records from primary storage. [2025-10-02T17:21:29.675025] [INFO ] [MAIN ] ASX: Loaded 52844 existing records. [2025-10-02T17:21:29.871844] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:29.872090] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-02T17:21:29.872140] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-02T17:21:29.873001] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-02T17:21:29.874187] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-02T17:21:29.874306] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-02T17:21:30.278170] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:30.515769] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T17:21:30.673019] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-02T17:21:31.472997] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-02T17:21:31.667232] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T17:21:31.758985] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T17:21:32.273008] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-02T17:21:32.781683] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T17:21:33.072997] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-10-02T17:21:33.608120] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T17:21:33.873009] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-02T17:21:34.672995] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-02T17:21:34.849075] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T17:21:34.962741] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T17:21:35.473037] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-02T17:21:36.236227] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T17:21:36.273042] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-02T17:21:36.607393] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T17:21:36.608903] [INFO ] [REMOTE ] ASIX: Full fetch complete (30192 records). [2025-10-02T17:21:36.608986] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-02T17:21:37.009702] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-02T17:21:37.009808] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-02T17:21:37.010246] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-02T17:21:37.010298] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-02T17:21:37.011334] [DEBUG] [LOCAL ] ASIX: Trimmed 30192 records to 22820 (keeping 200 days of data) [2025-10-02T17:21:37.076686] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-02T17:21:37.158751] [DEBUG] [LOCAL ] ASIX: Primary data saved (22820 records). [2025-10-02T17:21:37.158894] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-02T17:21:37.158980] [INFO ] [MAIN ] Update Progress: 162/2370 symbols completed. ASIX took 26.8s. Estimated remaining: 4h 53m 48s. Rate: 7.5 symbols/min [2025-10-02T17:21:37.343163] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:37.390040] [DEBUG] [LOCAL ] ATEN: Loaded 39400 existing records from primary storage. [2025-10-02T17:21:37.390387] [INFO ] [MAIN ] ATEN: Loaded 39400 existing records. [2025-10-02T17:21:37.595921] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:37.596205] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-02T17:21:37.596297] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-02T17:21:37.599399] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-02T17:21:37.599485] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-02T17:21:37.879619] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-02T17:21:37.947796] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T17:21:38.039479] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:38.673022] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-02T17:21:39.473001] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-10-02T17:21:39.544704] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-02T17:21:39.587399] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T17:21:39.870957] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T17:21:39.872629] [INFO ] [REMOTE ] ASH: Full fetch complete (55115 records). [2025-10-02T17:21:39.872748] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-02T17:21:40.283683] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-02T17:21:40.304912] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-02T17:21:40.305070] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-02T17:21:40.305694] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-02T17:21:40.305761] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-02T17:21:40.307128] [DEBUG] [LOCAL ] ASH: Trimmed 55115 records to 38041 (keeping 200 days of data) [2025-10-02T17:21:40.566909] [DEBUG] [LOCAL ] ASH: Primary data saved (38041 records). [2025-10-02T17:21:40.567082] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-02T17:21:40.567206] [INFO ] [MAIN ] Update Progress: 163/2370 symbols completed. ASH took 30.3s. Estimated remaining: 4h 52m 38s. Rate: 7.5 symbols/min [2025-10-02T17:21:40.751702] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:40.792517] [DEBUG] [LOCAL ] ATGE: Loaded 31426 existing records from primary storage. [2025-10-02T17:21:40.792917] [INFO ] [MAIN ] ATGE: Loaded 31426 existing records. [2025-10-02T17:21:40.996310] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:40.996774] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-02T17:21:40.997060] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-02T17:21:40.998085] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-02T17:21:40.998153] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-02T17:21:41.073880] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-02T17:21:41.206749] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T17:21:41.455186] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:41.885098] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-02T17:21:41.891444] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T17:21:42.673001] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-10-02T17:21:42.897923] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T17:21:43.285477] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:21:43.473031] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-02T17:21:44.094469] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:21:44.272996] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-02T17:21:45.073016] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-02T17:21:45.396706] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T17:21:45.696982] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T17:21:45.872998] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-02T17:21:46.046457] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T17:21:46.673000] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-02T17:21:47.453526] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T17:21:47.472960] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-02T17:21:48.222162] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T17:21:48.272982] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-02T17:21:48.827167] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T17:21:49.072994] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-02T17:21:49.532763] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T17:21:49.537732] [INFO ] [REMOTE ] ASPN: Full fetch complete (72296 records). [2025-10-02T17:21:49.537866] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-02T17:21:49.878107] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-02T17:21:49.977535] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-02T17:21:49.977632] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-02T17:21:49.978590] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-02T17:21:49.978687] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-02T17:21:49.980475] [DEBUG] [LOCAL ] ASPN: Trimmed 72296 records to 49942 (keeping 200 days of data) [2025-10-02T17:21:50.287881] [DEBUG] [LOCAL ] ASPN: Primary data saved (49942 records). [2025-10-02T17:21:50.288147] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-02T17:21:50.288256] [INFO ] [MAIN ] Update Progress: 164/2370 symbols completed. ASPN took 40.0s. Estimated remaining: 4h 52m 54s. Rate: 7.5 symbols/min [2025-10-02T17:21:50.428684] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T17:21:50.530177] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:21:50.568054] [DEBUG] [LOCAL ] ATHM: Loaded 32173 existing records from primary storage. [2025-10-02T17:21:50.568665] [INFO ] [MAIN ] ATHM: Loaded 32173 existing records. [2025-10-02T17:21:50.678219] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-02T17:21:50.819116] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:21:50.819393] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-02T17:21:50.819463] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-02T17:21:50.820371] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-10-02T17:21:50.820437] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-02T17:21:51.435919] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:21:51.464072] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T17:21:51.480718] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-02T17:21:52.148910] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T17:21:52.273035] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-02T17:21:53.078131] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-10-02T17:21:53.097453] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T17:21:53.286520] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T17:21:53.873014] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-02T17:21:54.489571] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T17:21:54.673075] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-02T17:21:55.373499] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T17:21:55.473009] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-02T17:21:56.272973] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-02T17:21:56.472724] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:21:57.072971] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-02T17:21:57.104876] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:21:57.475968] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T17:21:57.873053] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-02T17:21:58.673013] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-02T17:21:58.888455] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T17:21:59.321487] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:21:59.473063] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-02T17:22:00.197635] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T17:22:00.272994] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-02T17:22:00.876296] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T17:22:01.073018] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-02T17:22:01.593204] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T17:22:01.873068] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-02T17:22:02.395404] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T17:22:02.673122] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-02T17:22:03.210343] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:22:03.212263] [INFO ] [REMOTE ] ASX: Full fetch complete (76208 records). [2025-10-02T17:22:03.212389] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-02T17:22:03.213450] [FATAL] [VALIDATOR ] ASX: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:22:03.213546] [FATAL] [MAIN ] ASX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:22:03.213591] [WARN ] [MAIN ] ASX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:22:03.213634] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-02T17:22:03.213734] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-10-02T17:22:03.213779] [INFO ] [LOCAL ] ASX: Starting deletion of derivative data. [2025-10-02T17:22:03.214505] [DEBUG] [LOCAL ] ASX: Deleted derivative data file. [2025-10-02T17:22:03.214607] [INFO ] [MAIN ] Update Progress: 165/2370 symbols completed. ASX took 33.8s. Estimated remaining: 4h 53m 52s. Rate: 7.5 symbols/min [2025-10-02T17:22:03.404342] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:03.413382] [DEBUG] [LOCAL ] ATHS: Loaded 6972 existing records from primary storage. [2025-10-02T17:22:03.413605] [INFO ] [MAIN ] ATHS: Loaded 6972 existing records. [2025-10-02T17:22:03.483844] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-02T17:22:03.621135] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:22:03.621432] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-02T17:22:03.621505] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-02T17:22:03.621828] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-10-02T17:22:03.621891] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-02T17:22:04.019421] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:04.144747] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T17:22:04.273053] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-02T17:22:05.072962] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-02T17:22:05.278775] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T17:22:05.423833] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T17:22:05.873010] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-10-02T17:22:06.599259] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T17:22:06.673065] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-02T17:22:06.708390] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T17:22:07.473042] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-02T17:22:08.093675] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T17:22:08.140728] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T17:22:08.273003] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-02T17:22:08.738677] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-02T17:22:09.073038] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-02T17:22:09.873009] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-02T17:22:10.292520] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-02T17:22:10.673044] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-02T17:22:10.947164] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T17:22:11.473000] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-02T17:22:11.744704] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T17:22:11.746470] [INFO ] [REMOTE ] ATGE: Full fetch complete (46308 records). [2025-10-02T17:22:11.746594] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-02T17:22:12.205907] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-02T17:22:12.206004] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-02T17:22:12.206592] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-02T17:22:12.206679] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-02T17:22:12.207956] [DEBUG] [LOCAL ] ATGE: Trimmed 46308 records to 31630 (keeping 200 days of data) [2025-10-02T17:22:12.298103] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-02T17:22:12.415521] [DEBUG] [LOCAL ] ATGE: Primary data saved (31630 records). [2025-10-02T17:22:12.415703] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-02T17:22:12.415827] [INFO ] [MAIN ] Update Progress: 166/2370 symbols completed. ATGE took 31.8s. Estimated remaining: 4h 53m 60s. Rate: 7.5 symbols/min [2025-10-02T17:22:12.615955] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:12.676216] [DEBUG] [LOCAL ] ATI: Loaded 51502 existing records from primary storage. [2025-10-02T17:22:12.676592] [INFO ] [MAIN ] ATI: Loaded 51502 existing records. [2025-10-02T17:22:12.907698] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:22:12.916399] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T17:22:12.916580] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-02T17:22:12.919813] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-02T17:22:12.921000] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-02T17:22:12.921071] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-02T17:22:13.076721] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-02T17:22:13.374934] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T17:22:13.405275] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:13.854914] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T17:22:13.873019] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-10-02T17:22:14.673051] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-02T17:22:15.473022] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-02T17:22:15.660013] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T17:22:16.068299] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T17:22:16.273013] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-02T17:22:17.073027] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-02T17:22:17.116725] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:22:17.763096] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T17:22:17.873056] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-02T17:22:18.299847] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T17:22:18.302115] [INFO ] [REMOTE ] ATEN: Full fetch complete (57402 records). [2025-10-02T17:22:18.302251] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-02T17:22:18.684054] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-02T17:22:18.755220] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-02T17:22:18.755407] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-02T17:22:18.756157] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-02T17:22:18.756285] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-02T17:22:18.759730] [DEBUG] [LOCAL ] ATEN: Trimmed 57402 records to 39637 (keeping 200 days of data) [2025-10-02T17:22:19.026534] [DEBUG] [LOCAL ] ATEN: Primary data saved (39637 records). [2025-10-02T17:22:19.026716] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-02T17:22:19.029032] [INFO ] [MAIN ] Update Progress: 167/2370 symbols completed. ATEN took 41.9s. Estimated remaining: 4h 53m 34s. Rate: 7.5 symbols/min [2025-10-02T17:22:19.196954] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T17:22:19.261560] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:19.302977] [DEBUG] [LOCAL ] ATKR: Loaded 35682 existing records from primary storage. [2025-10-02T17:22:19.303312] [INFO ] [MAIN ] ATKR: Loaded 35682 existing records. [2025-10-02T17:22:19.478105] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-02T17:22:19.508632] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:22:19.509895] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-02T17:22:19.509958] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-02T17:22:19.511090] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-02T17:22:19.511151] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-02T17:22:19.904485] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:20.272968] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-10-02T17:22:20.337293] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T17:22:20.559843] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T17:22:21.073012] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-02T17:22:21.671132] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T17:22:21.769527] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-02T17:22:21.873008] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-02T17:22:22.566411] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T17:22:22.673070] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-02T17:22:23.216180] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-02T17:22:23.473079] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-02T17:22:24.273017] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-02T17:22:24.895446] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T17:22:25.073013] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-02T17:22:25.586164] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T17:22:25.873016] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-02T17:22:26.673027] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-02T17:22:27.034291] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T17:22:27.109342] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T17:22:27.473030] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-02T17:22:28.066988] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:22:28.273028] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-02T17:22:28.609947] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-02T17:22:28.901917] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T17:22:29.073010] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-02T17:22:29.872997] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-02T17:22:30.433632] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-02T17:22:30.673009] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-02T17:22:31.165371] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T17:22:31.166399] [INFO ] [REMOTE ] ATHS: Full fetch complete (9983 records). [2025-10-02T17:22:31.166490] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-02T17:22:31.477940] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-02T17:22:31.611995] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-02T17:22:31.612129] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-02T17:22:31.612592] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-02T17:22:31.612706] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-02T17:22:31.613545] [DEBUG] [LOCAL ] ATHS: Trimmed 9983 records to 6987 (keeping 200 days of data) [2025-10-02T17:22:31.671442] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T17:22:31.694473] [DEBUG] [LOCAL ] ATHS: Primary data saved (6987 records). [2025-10-02T17:22:31.694622] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-02T17:22:31.694747] [INFO ] [MAIN ] Update Progress: 168/2370 symbols completed. ATHS took 28.5s. Estimated remaining: 4h 54m 27s. Rate: 7.5 symbols/min [2025-10-02T17:22:31.888138] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:31.930130] [DEBUG] [LOCAL ] ATMU: Loaded 39344 existing records from primary storage. [2025-10-02T17:22:31.930436] [INFO ] [MAIN ] ATMU: Loaded 39344 existing records. [2025-10-02T17:22:32.129393] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:22:32.129717] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-02T17:22:32.129791] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-02T17:22:32.130763] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-02T17:22:32.130824] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-02T17:22:32.286220] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-02T17:22:32.542203] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:32.546482] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T17:22:32.547969] [INFO ] [REMOTE ] ATHM: Full fetch complete (51071 records). [2025-10-02T17:22:32.548108] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-02T17:22:32.966607] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-02T17:22:32.966726] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-02T17:22:32.967356] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-02T17:22:32.967423] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-02T17:22:32.968732] [DEBUG] [LOCAL ] ATHM: Trimmed 51071 records to 32341 (keeping 200 days of data) [2025-10-02T17:22:33.073084] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-02T17:22:33.170882] [DEBUG] [LOCAL ] ATHM: Primary data saved (32341 records). [2025-10-02T17:22:33.171060] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-02T17:22:33.171149] [INFO ] [MAIN ] Update Progress: 169/2370 symbols completed. ATHM took 42.9s. Estimated remaining: 4h 52m 54s. Rate: 7.5 symbols/min [2025-10-02T17:22:33.361057] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:33.361278] [DEBUG] [LOCAL ] ATO: No existing data file found in primary storage. [2025-10-02T17:22:33.361328] [WARN ] [MAIN ] ATO: No existing data found, performing full refresh instead. [2025-10-02T17:22:33.361444] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-02T17:22:33.361488] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-02T17:22:33.361533] [DEBUG] [LOCAL ] ATO: No primary data file found to delete. [2025-10-02T17:22:33.361567] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-02T17:22:33.765581] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:33.873006] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-10-02T17:22:34.272007] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T17:22:34.672988] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-02T17:22:34.862403] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T17:22:35.174172] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T17:22:35.473001] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-10-02T17:22:35.667287] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T17:22:36.273020] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-02T17:22:37.073007] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-02T17:22:37.270150] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T17:22:37.576246] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T17:22:37.873017] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-02T17:22:38.672975] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-02T17:22:38.931613] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T17:22:38.969140] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T17:22:39.473055] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-02T17:22:40.069295] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:22:40.272997] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-02T17:22:41.073025] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-02T17:22:41.222353] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T17:22:41.873016] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-02T17:22:41.941962] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T17:22:42.498966] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T17:22:42.672998] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-02T17:22:43.009404] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T17:22:43.473058] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-02T17:22:44.093450] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T17:22:44.273016] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-02T17:22:45.064852] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T17:22:45.074613] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-02T17:22:45.872984] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-02T17:22:45.960615] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T17:22:46.320347] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T17:22:46.673006] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-02T17:22:46.884012] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T17:22:46.885818] [INFO ] [REMOTE ] ATKR: Full fetch complete (53806 records). [2025-10-02T17:22:46.885913] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-02T17:22:47.320728] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-02T17:22:47.320823] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-02T17:22:47.321458] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-02T17:22:47.321526] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-02T17:22:47.322852] [DEBUG] [LOCAL ] ATKR: Trimmed 53806 records to 35963 (keeping 200 days of data) [2025-10-02T17:22:47.506602] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-02T17:22:47.571406] [DEBUG] [LOCAL ] ATKR: Primary data saved (35963 records). [2025-10-02T17:22:47.571536] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-02T17:22:47.572474] [INFO ] [MAIN ] Update Progress: 170/2370 symbols completed. ATKR took 28.5s. Estimated remaining: 4h 54m 9s. Rate: 7.5 symbols/min [2025-10-02T17:22:47.771320] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:47.807138] [DEBUG] [LOCAL ] ATR: Loaded 30432 existing records from primary storage. [2025-10-02T17:22:47.807481] [INFO ] [MAIN ] ATR: Loaded 30432 existing records. [2025-10-02T17:22:48.024796] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:22:48.025391] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-02T17:22:48.025482] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-02T17:22:48.035629] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-02T17:22:48.040884] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-02T17:22:48.130866] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:22:48.283238] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-02T17:22:48.476768] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:48.929067] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T17:22:48.932019] [INFO ] [REMOTE ] ATI: Full fetch complete (73969 records). [2025-10-02T17:22:48.932202] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-02T17:22:49.073457] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-10-02T17:22:49.420805] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-02T17:22:49.420973] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-02T17:22:49.421842] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-02T17:22:49.421913] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-02T17:22:49.423667] [DEBUG] [LOCAL ] ATI: Trimmed 73969 records to 51863 (keeping 200 days of data) [2025-10-02T17:22:49.768834] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T17:22:49.793215] [DEBUG] [LOCAL ] ATI: Primary data saved (51863 records). [2025-10-02T17:22:49.793518] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-02T17:22:49.794919] [INFO ] [MAIN ] Update Progress: 171/2370 symbols completed. ATI took 37.4s. Estimated remaining: 4h 52m 46s. Rate: 7.5 symbols/min [2025-10-02T17:22:49.878112] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-02T17:22:50.000340] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:22:50.021398] [DEBUG] [LOCAL ] ATS: Loaded 17831 existing records from primary storage. [2025-10-02T17:22:50.021706] [INFO ] [MAIN ] ATS: Loaded 17831 existing records. [2025-10-02T17:22:50.222762] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:22:50.223048] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-02T17:22:50.223338] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-02T17:22:50.223982] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-02T17:22:50.224044] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-02T17:22:50.648095] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:22:50.650827] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T17:22:50.672985] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-10-02T17:22:50.966094] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T17:22:51.473047] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-02T17:22:51.652286] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T17:22:52.273039] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-02T17:22:52.385032] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T17:22:53.073004] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-02T17:22:53.873050] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-02T17:22:54.673016] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-02T17:23:04.950287] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (11.08 seconds). [2025-10-02T17:23:04.954998] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-02T17:23:05.104289] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (12.03 seconds). [2025-10-02T17:23:05.114621] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-02T17:23:05.131822] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (12.86 seconds). [2025-10-02T17:23:05.138482] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-02T17:23:05.999332] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T17:23:06.004674] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-02T17:23:06.115014] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T17:23:06.125350] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-02T17:23:06.505061] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T17:23:06.513503] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-02T17:23:06.937888] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T17:23:06.942577] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-02T17:23:07.315132] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T17:23:07.317291] [INFO ] [REMOTE ] ATMU: Full fetch complete (56720 records). [2025-10-02T17:23:07.317427] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-02T17:23:07.796607] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-02T17:23:07.823829] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T17:23:07.825730] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (13.15 seconds). [2025-10-02T17:23:07.840075] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-02T17:23:07.841762] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-02T17:23:07.840840] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-02T17:23:07.843662] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-02T17:23:07.843518] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-02T17:23:07.852708] [DEBUG] [LOCAL ] ATMU: Trimmed 56720 records to 39581 (keeping 200 days of data) [2025-10-02T17:23:07.864996] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T17:23:07.927802] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-02T17:23:08.123733] [DEBUG] [LOCAL ] ATMU: Primary data saved (39581 records). [2025-10-02T17:23:08.123886] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-02T17:23:08.123973] [INFO ] [MAIN ] Update Progress: 172/2370 symbols completed. ATMU took 36.4s. Estimated remaining: 4h 54m 50s. Rate: 7.5 symbols/min [2025-10-02T17:23:08.306820] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:08.354217] [DEBUG] [LOCAL ] ATUS: Loaded 49261 existing records from primary storage. [2025-10-02T17:23:08.354554] [INFO ] [MAIN ] ATUS: Loaded 49261 existing records. [2025-10-02T17:23:08.567098] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:23:08.567358] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-02T17:23:08.567429] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-02T17:23:08.568296] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-02T17:23:08.568360] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-02T17:23:08.966080] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:23:09.006557] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-02T17:23:09.028826] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:23:09.030034] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-10-02T17:23:09.181793] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T17:23:09.188293] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-02T17:23:09.645710] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T17:23:09.655772] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-02T17:23:09.808574] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T17:23:09.814472] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-02T17:23:10.309345] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T17:23:10.316535] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-02T17:23:10.764326] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T17:23:10.774478] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-02T17:23:11.456457] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T17:23:11.467182] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-02T17:23:11.529786] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T17:23:11.536893] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-02T17:23:12.409194] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:23:12.419458] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-02T17:23:12.825916] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:23:12.832632] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-02T17:23:12.875731] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:23:12.884470] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-02T17:23:13.733273] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T17:23:13.743169] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-02T17:23:14.010814] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T17:23:14.019551] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-02T17:23:14.232820] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T17:23:14.673038] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-02T17:23:15.232831] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T17:23:15.473049] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-02T17:23:15.685086] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T17:23:16.112915] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:23:16.273014] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-02T17:23:16.665569] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T17:23:17.073016] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-02T17:23:17.101058] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (7.29 seconds). [2025-10-02T17:23:17.849164] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T17:23:17.872980] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-02T17:23:18.446960] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T17:23:18.672997] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-02T17:23:19.055501] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T17:23:19.057532] [INFO ] [REMOTE ] ATO: Full fetch complete (60526 records). [2025-10-02T17:23:19.057623] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-02T17:23:19.486971] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-02T17:23:19.483785] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-02T17:23:19.488127] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-02T17:23:19.489018] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-02T17:23:19.489306] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-02T17:23:19.491071] [DEBUG] [LOCAL ] ATO: Trimmed 60526 records to 42177 (keeping 200 days of data) [2025-10-02T17:23:19.708667] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T17:23:19.792512] [DEBUG] [LOCAL ] ATO: Primary data saved (42177 records). [2025-10-02T17:23:19.792673] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-02T17:23:19.792775] [INFO ] [MAIN ] Update Progress: 173/2370 symbols completed. ATO took 46.6s. Estimated remaining: 4h 55m 28s. Rate: 7.4 symbols/min [2025-10-02T17:23:19.981170] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:20.052187] [DEBUG] [LOCAL ] AU: Loaded 52993 existing records from primary storage. [2025-10-02T17:23:20.052707] [INFO ] [MAIN ] AU: Loaded 52993 existing records. [2025-10-02T17:23:20.279534] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-02T17:23:20.286425] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:23:20.287666] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-02T17:23:20.287778] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-02T17:23:20.288876] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-02T17:23:20.288941] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-02T17:23:20.607918] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T17:23:20.641564] [INFO ] [REMOTE ] ATR: Full fetch complete (43539 records). [2025-10-02T17:23:20.657408] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-02T17:23:20.822203] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:23:21.078117] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-10-02T17:23:21.166787] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-02T17:23:21.166870] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-02T17:23:21.167364] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-02T17:23:21.167407] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-02T17:23:21.168704] [DEBUG] [LOCAL ] ATR: Trimmed 43539 records to 30648 (keeping 200 days of data) [2025-10-02T17:23:21.380087] [DEBUG] [LOCAL ] ATR: Primary data saved (30648 records). [2025-10-02T17:23:21.380247] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-02T17:23:21.380336] [INFO ] [MAIN ] Update Progress: 174/2370 symbols completed. ATR took 33.8s. Estimated remaining: 4h 53m 58s. Rate: 7.5 symbols/min [2025-10-02T17:23:21.578440] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:21.627463] [DEBUG] [LOCAL ] AUB: Loaded 46326 existing records from primary storage. [2025-10-02T17:23:21.627938] [INFO ] [MAIN ] AUB: Loaded 46326 existing records. [2025-10-02T17:23:21.849718] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:23:21.850285] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-02T17:23:21.850350] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-02T17:23:21.851343] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-02T17:23:21.851410] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-02T17:23:21.876578] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-02T17:23:22.084968] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T17:23:22.350553] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:23:22.673018] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-10-02T17:23:22.823753] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T17:23:23.237148] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-02T17:23:23.473011] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-02T17:23:23.864254] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T17:23:24.273019] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-02T17:23:25.072973] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-02T17:23:25.107369] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T17:23:25.873015] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-02T17:23:26.076756] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T17:23:26.511695] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T17:23:26.672636] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T17:23:26.673761] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-02T17:23:26.674930] [INFO ] [REMOTE ] ATS: Full fetch complete (25680 records). [2025-10-02T17:23:26.675030] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-02T17:23:27.081615] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-02T17:23:27.081738] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-02T17:23:27.082137] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-02T17:23:27.082180] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-02T17:23:27.083074] [DEBUG] [LOCAL ] ATS: Trimmed 25680 records to 17921 (keeping 200 days of data) [2025-10-02T17:23:27.191197] [DEBUG] [LOCAL ] ATS: Primary data saved (17921 records). [2025-10-02T17:23:27.191344] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-02T17:23:27.191427] [INFO ] [MAIN ] Update Progress: 175/2370 symbols completed. ATS took 37.4s. Estimated remaining: 4h 53m 22s. Rate: 7.5 symbols/min [2025-10-02T17:23:27.379609] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:27.387192] [DEBUG] [LOCAL ] AUNA: Loaded 4886 existing records from primary storage. [2025-10-02T17:23:27.387422] [INFO ] [MAIN ] AUNA: Loaded 4886 existing records. [2025-10-02T17:23:27.480272] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-02T17:23:27.604102] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:23:27.604419] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-02T17:23:27.604490] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-02T17:23:27.604948] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-10-02T17:23:27.605028] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-02T17:23:27.985497] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:23:28.272983] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-10-02T17:23:28.396488] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T17:23:28.592560] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T17:23:28.768501] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-10-02T17:23:29.073028] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-02T17:23:29.873033] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-02T17:23:30.673020] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-02T17:23:30.852254] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T17:23:31.320335] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T17:23:31.346634] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T17:23:31.473030] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-02T17:23:32.272999] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-02T17:23:32.587383] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T17:23:32.589455] [INFO ] [REMOTE ] ATUS: Full fetch complete (71001 records). [2025-10-02T17:23:32.589565] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-02T17:23:32.939924] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-02T17:23:33.075091] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-02T17:23:33.076346] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-02T17:23:33.076455] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-02T17:23:33.077513] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-02T17:23:33.077714] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-02T17:23:33.079577] [DEBUG] [LOCAL ] ATUS: Trimmed 71001 records to 49646 (keeping 200 days of data) [2025-10-02T17:23:33.373926] [DEBUG] [LOCAL ] ATUS: Primary data saved (49646 records). [2025-10-02T17:23:33.374083] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-02T17:23:33.374178] [INFO ] [MAIN ] Update Progress: 176/2370 symbols completed. ATUS took 25.3s. Estimated remaining: 4h 52m 51s. Rate: 7.5 symbols/min [2025-10-02T17:23:33.573819] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:33.618603] [DEBUG] [LOCAL ] AVA: Loaded 39411 existing records from primary storage. [2025-10-02T17:23:33.618979] [INFO ] [MAIN ] AVA: Loaded 39411 existing records. [2025-10-02T17:23:33.748951] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T17:23:33.854598] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:23:33.854854] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-02T17:23:33.854911] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-02T17:23:33.855782] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-02T17:23:33.855845] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-02T17:23:33.881459] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-02T17:23:34.248863] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:23:34.672997] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-02T17:23:35.473033] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-10-02T17:23:36.152277] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-02T17:23:36.282892] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-02T17:23:36.294799] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T17:23:36.659865] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T17:23:37.073019] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-02T17:23:37.872982] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-02T17:23:38.111997] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T17:23:38.197224] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T17:23:38.673032] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-02T17:23:39.466078] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T17:23:39.476942] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-02T17:23:40.273031] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-02T17:23:40.663692] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T17:23:40.819551] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T17:23:40.836783] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T17:23:41.073015] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-02T17:23:41.873010] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-02T17:23:42.432299] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T17:23:42.673051] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-02T17:23:42.829309] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T17:23:43.473041] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-02T17:23:43.949676] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T17:23:44.273021] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-02T17:23:44.655700] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T17:23:45.073045] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-02T17:23:45.102676] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T17:23:45.873050] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-02T17:23:46.673027] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-02T17:23:47.312089] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-02T17:23:47.351318] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-02T17:23:47.473025] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-02T17:23:47.761716] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-02T17:23:48.273057] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-02T17:23:49.065192] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T17:23:49.073621] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-02T17:23:49.872999] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-02T17:23:49.916632] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T17:23:50.673059] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-02T17:23:51.049256] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T17:23:51.120059] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T17:23:51.473071] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-02T17:23:52.224829] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T17:23:52.273009] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-02T17:23:53.072980] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-02T17:23:53.176243] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:23:53.309794] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T17:23:53.873026] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-02T17:23:54.485230] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:23:54.542543] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T17:23:54.673065] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-02T17:23:55.473014] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-02T17:23:56.273006] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-02T17:23:56.306155] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-02T17:23:56.308441] [INFO ] [REMOTE ] AU: Full fetch complete (76279 records). [2025-10-02T17:23:56.308572] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-02T17:23:56.763351] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T17:23:56.809180] [INFO ] [REMOTE ] AUB: Full fetch complete (65723 records). [2025-10-02T17:23:56.809393] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-02T17:23:56.809512] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-02T17:23:56.810028] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-02T17:23:56.810955] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-02T17:23:56.811137] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-02T17:23:56.933186] [DEBUG] [LOCAL ] AU: Trimmed 76279 records to 53383 (keeping 200 days of data) [2025-10-02T17:23:57.087359] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-02T17:23:57.518202] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-02T17:23:57.519294] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-02T17:23:57.530024] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-02T17:23:57.531456] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-02T17:23:57.554903] [DEBUG] [LOCAL ] AUB: Trimmed 65723 records to 46648 (keeping 200 days of data) [2025-10-02T17:23:57.707358] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T17:23:57.708898] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T17:23:57.881991] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-02T17:23:57.972284] [DEBUG] [LOCAL ] AU: Primary data saved (53383 records). [2025-10-02T17:23:57.973247] [INFO ] [MAIN ] AU: Full history saved. [2025-10-02T17:23:57.974411] [INFO ] [MAIN ] Update Progress: 177/2370 symbols completed. AU took 38.2s. Estimated remaining: 4h 56m 9s. Rate: 7.4 symbols/min [2025-10-02T17:23:58.222074] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:58.222775] [DEBUG] [LOCAL ] AVAL: No existing data file found in primary storage. [2025-10-02T17:23:58.222854] [WARN ] [MAIN ] AVAL: No existing data found, performing full refresh instead. [2025-10-02T17:23:58.225677] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-02T17:23:58.228753] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-02T17:23:58.229852] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-10-02T17:23:58.232123] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-02T17:23:58.272681] [DEBUG] [LOCAL ] AUB: Primary data saved (46648 records). [2025-10-02T17:23:58.314328] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-02T17:23:58.326190] [INFO ] [MAIN ] Update Progress: 178/2370 symbols completed. AUB took 36.9s. Estimated remaining: 4h 54m 25s. Rate: 7.4 symbols/min [2025-10-02T17:23:58.563304] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T17:23:58.617494] [INFO ] [REMOTE ] AUNA: Full fetch complete (7767 records). [2025-10-02T17:23:58.696880] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-02T17:23:58.674021] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-02T17:23:58.760890] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:23:59.182770] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:23:59.273811] [DEBUG] [LOCAL ] AVB: Loaded 41937 existing records from primary storage. [2025-10-02T17:23:59.274135] [INFO ] [MAIN ] AVB: Loaded 41937 existing records. [2025-10-02T17:23:59.474836] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-10-02T17:23:59.494470] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-10-02T17:23:59.504921] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-10-02T17:23:59.506054] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-10-02T17:23:59.511264] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-10-02T17:23:59.517308] [DEBUG] [LOCAL ] AUNA: Trimmed 7767 records to 4958 (keeping 200 days of data) [2025-10-02T17:23:59.579900] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:23:59.580420] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-02T17:23:59.580482] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-02T17:23:59.591107] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-02T17:23:59.593849] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-02T17:23:59.802829] [DEBUG] [LOCAL ] AUNA: Primary data saved (4958 records). [2025-10-02T17:23:59.804943] [INFO ] [MAIN ] AUNA: Full history saved. [2025-10-02T17:23:59.805058] [INFO ] [MAIN ] Update Progress: 179/2370 symbols completed. AUNA took 32.6s. Estimated remaining: 4h 52m 57s. Rate: 7.5 symbols/min [2025-10-02T17:24:00.161672] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:00.184905] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-02T17:24:00.197959] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-02T17:24:00.236229] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-02T17:24:00.236054] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:00.236769] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-02T17:24:00.241933] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-02T17:24:00.242488] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-02T17:24:00.242901] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T17:24:00.278160] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-10-02T17:24:00.680153] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:00.682519] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-02T17:24:01.073071] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-02T17:24:01.878120] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-02T17:24:01.898782] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T17:24:01.938827] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T17:24:02.673037] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-02T17:24:03.271954] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T17:24:03.472993] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-02T17:24:03.631947] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T17:24:04.273038] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-10-02T17:24:04.450493] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T17:24:04.452420] [INFO ] [REMOTE ] AVA: Full fetch complete (55788 records). [2025-10-02T17:24:04.452535] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-02T17:24:04.503369] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:24:04.546350] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-10-02T17:24:04.569888] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:24:04.573492] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-02T17:24:04.573913] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:24:04.584480] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-02T17:24:04.594809] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-02T17:24:04.600010] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-02T17:24:04.621978] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-02T17:24:04.640574] [INFO ] [MAIN ] Update Progress: 180/2370 symbols completed. AVBC took 4.8s. Estimated remaining: 4h 52m 10s. Rate: 7.5 symbols/min [2025-10-02T17:24:05.077798] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-02T17:24:05.100626] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:05.102407] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-02T17:24:05.102521] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-02T17:24:05.103316] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-02T17:24:05.103681] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-02T17:24:05.105193] [DEBUG] [LOCAL ] AVA: Trimmed 55788 records to 39686 (keeping 200 days of data) [2025-10-02T17:24:05.240111] [DEBUG] [LOCAL ] AVD: Loaded 22593 existing records from primary storage. [2025-10-02T17:24:05.248318] [INFO ] [MAIN ] AVD: Loaded 22593 existing records. [2025-10-02T17:24:05.556239] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:24:05.561266] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-02T17:24:05.562697] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-02T17:24:05.564924] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-02T17:24:05.566231] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-02T17:24:05.752008] [DEBUG] [LOCAL ] AVA: Primary data saved (39686 records). [2025-10-02T17:24:05.769496] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-02T17:24:05.770698] [INFO ] [MAIN ] Update Progress: 181/2370 symbols completed. AVA took 32.4s. Estimated remaining: 4h 50m 39s. Rate: 7.5 symbols/min [2025-10-02T17:24:05.876374] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-02T17:24:06.148149] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:06.188331] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:06.208310] [DEBUG] [LOCAL ] AVK: Loaded 17956 existing records from primary storage. [2025-10-02T17:24:06.208774] [INFO ] [MAIN ] AVK: Loaded 17956 existing records. [2025-10-02T17:24:06.433534] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:24:06.433864] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-02T17:24:06.433943] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-02T17:24:06.441851] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-02T17:24:06.455487] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-02T17:24:06.462664] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T17:24:06.674694] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-02T17:24:06.881935] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:06.894194] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T17:24:07.473038] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-10-02T17:24:07.854948] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T17:24:08.273026] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-02T17:24:08.750235] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T17:24:08.867960] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-02T17:24:09.073053] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-10-02T17:24:09.873059] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-02T17:24:10.405136] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T17:24:10.443195] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T17:24:10.673025] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-02T17:24:11.473052] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-02T17:24:11.856394] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T17:24:12.243992] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T17:24:12.273011] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-02T17:24:13.073015] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-02T17:24:13.871143] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-02T17:24:13.875060] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-02T17:24:13.966286] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T17:24:14.673005] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-02T17:24:14.830109] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T17:24:15.473056] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-02T17:24:15.995478] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-02T17:24:16.273002] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-02T17:24:16.992640] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T17:24:17.072970] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-02T17:24:17.144939] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T17:24:17.873013] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-02T17:24:18.087920] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T17:24:18.672982] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-02T17:24:18.797583] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T17:24:19.473022] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-02T17:24:19.908696] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T17:24:20.273045] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-02T17:24:20.685582] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T17:24:21.073015] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-02T17:24:21.822633] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T17:24:21.872988] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-02T17:24:22.261422] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-02T17:24:22.673030] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-02T17:24:22.805600] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T17:24:23.473071] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-02T17:24:23.774444] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T17:24:24.273009] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-02T17:24:24.840312] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T17:24:25.078404] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-02T17:24:25.090489] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T17:24:25.873007] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-02T17:24:26.184409] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T17:24:26.672972] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-02T17:24:26.899698] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:24:27.473006] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-02T17:24:28.121025] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T17:24:28.122446] [INFO ] [REMOTE ] AVD: Full fetch complete (33661 records). [2025-10-02T17:24:28.122616] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-02T17:24:28.276115] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-02T17:24:28.514444] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T17:24:28.628490] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-02T17:24:28.628586] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-02T17:24:28.629023] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-02T17:24:28.629088] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-02T17:24:28.630158] [DEBUG] [LOCAL ] AVD: Trimmed 33661 records to 22716 (keeping 200 days of data) [2025-10-02T17:24:28.773291] [DEBUG] [LOCAL ] AVD: Primary data saved (22716 records). [2025-10-02T17:24:28.773923] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-02T17:24:28.774137] [INFO ] [MAIN ] Update Progress: 182/2370 symbols completed. AVD took 24.1s. Estimated remaining: 4h 53m 32s. Rate: 7.5 symbols/min [2025-10-02T17:24:28.986226] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:29.026934] [DEBUG] [LOCAL ] AVNS: Loaded 33718 existing records from primary storage. [2025-10-02T17:24:29.027248] [INFO ] [MAIN ] AVNS: Loaded 33718 existing records. [2025-10-02T17:24:29.075715] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-02T17:24:29.249397] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:24:29.249704] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-02T17:24:29.249835] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-02T17:24:29.251150] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-02T17:24:29.251214] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-02T17:24:29.619006] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T17:24:29.712124] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:29.872997] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-02T17:24:30.672989] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-10-02T17:24:30.746707] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T17:24:30.776099] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-02T17:24:31.473019] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-02T17:24:32.026621] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T17:24:32.272989] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-02T17:24:32.508288] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T17:24:32.892013] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T17:24:33.072997] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-02T17:24:33.872998] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-02T17:24:34.362776] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T17:24:34.665501] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T17:24:34.672960] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-02T17:24:35.473020] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-02T17:24:35.821162] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T17:24:36.273057] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-02T17:24:36.802455] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T17:24:37.072994] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-02T17:24:37.445623] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T17:24:37.447608] [INFO ] [REMOTE ] AVB: Full fetch complete (58642 records). [2025-10-02T17:24:37.447760] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-02T17:24:37.883306] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-02T17:24:37.948314] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-02T17:24:37.948417] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-02T17:24:37.949141] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-02T17:24:37.949209] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-02T17:24:37.950584] [DEBUG] [LOCAL ] AVB: Trimmed 58642 records to 42269 (keeping 200 days of data) [2025-10-02T17:24:38.059100] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-02T17:24:38.062961] [INFO ] [REMOTE ] AVK: Full fetch complete (26735 records). [2025-10-02T17:24:38.063905] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-02T17:24:38.525933] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-02T17:24:38.530881] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-02T17:24:38.538633] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-02T17:24:38.538836] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-02T17:24:38.613134] [DEBUG] [LOCAL ] AVK: Trimmed 26735 records to 18153 (keeping 200 days of data) [2025-10-02T17:24:38.710454] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-02T17:24:38.862626] [DEBUG] [LOCAL ] AVK: Primary data saved (18153 records). [2025-10-02T17:24:38.863365] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-02T17:24:38.864024] [INFO ] [MAIN ] Update Progress: 183/2370 symbols completed. AVK took 33.1s. Estimated remaining: 4h 53m 48s. Rate: 7.4 symbols/min [2025-10-02T17:24:38.913006] [DEBUG] [LOCAL ] AVB: Primary data saved (42269 records). [2025-10-02T17:24:38.935903] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-02T17:24:38.936060] [INFO ] [MAIN ] Update Progress: 184/2370 symbols completed. AVB took 40.6s. Estimated remaining: 4h 52m 5s. Rate: 7.5 symbols/min [2025-10-02T17:24:39.206201] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:39.287236] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:39.287615] [DEBUG] [LOCAL ] AVTR: No existing data file found in primary storage. [2025-10-02T17:24:39.287836] [WARN ] [MAIN ] AVTR: No existing data found, performing full refresh instead. [2025-10-02T17:24:39.288207] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-02T17:24:39.288344] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-02T17:24:39.305747] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-10-02T17:24:39.305928] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-02T17:24:39.322730] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T17:24:39.329577] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T17:24:39.356879] [INFO ] [REMOTE ] AVAL: Full fetch complete (14673 records). [2025-10-02T17:24:39.391897] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-02T17:24:39.474857] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-02T17:24:39.699869] [DEBUG] [LOCAL ] AVNT: Loaded 39175 existing records from primary storage. [2025-10-02T17:24:39.739105] [INFO ] [MAIN ] AVNT: Loaded 39175 existing records. [2025-10-02T17:24:40.240517] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:40.291733] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-10-02T17:24:40.396507] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:24:40.433994] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-02T17:24:40.433780] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-02T17:24:40.434207] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-02T17:24:40.434741] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-02T17:24:40.434816] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-02T17:24:40.434891] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-02T17:24:40.435574] [DEBUG] [LOCAL ] AVAL: Trimmed 14673 records to 8795 (keeping 200 days of data) [2025-10-02T17:24:40.436204] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-02T17:24:40.436475] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-02T17:24:40.820988] [DEBUG] [LOCAL ] AVAL: Primary data saved (8795 records). [2025-10-02T17:24:40.839419] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-02T17:24:40.859731] [INFO ] [MAIN ] Update Progress: 185/2370 symbols completed. AVAL took 42.9s. Estimated remaining: 4h 50m 45s. Rate: 7.5 symbols/min [2025-10-02T17:24:40.891767] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T17:24:41.089133] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-02T17:24:41.099519] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:41.178827] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:24:41.226334] [DEBUG] [LOCAL ] AVY: Loaded 37474 existing records from primary storage. [2025-10-02T17:24:41.226637] [INFO ] [MAIN ] AVY: Loaded 37474 existing records. [2025-10-02T17:24:41.430455] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:24:41.430919] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-02T17:24:41.430975] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-02T17:24:41.432120] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-02T17:24:41.432183] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-02T17:24:41.833048] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:24:41.872984] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-10-02T17:24:42.354830] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-02T17:24:42.673033] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-10-02T17:24:42.718032] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:24:43.388034] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T17:24:43.473009] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-02T17:24:43.841054] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T17:24:44.273008] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-02T17:24:45.072992] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-02T17:24:45.127233] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T17:24:45.244811] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T17:24:45.873060] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-02T17:24:46.664107] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:24:46.673438] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-02T17:24:47.472973] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-02T17:24:47.517394] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T17:24:47.968567] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T17:24:48.273099] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-02T17:24:49.072858] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T17:24:49.073012] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-02T17:24:49.511292] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T17:24:49.873000] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-02T17:24:50.527108] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T17:24:50.673007] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-02T17:24:51.038366] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T17:24:51.473001] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-02T17:24:51.958266] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:24:52.273011] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-02T17:24:52.812247] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T17:24:53.073013] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-02T17:24:53.872983] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-02T17:24:54.112257] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T17:24:54.673962] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-02T17:24:54.677556] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:24:55.243248] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T17:24:55.473025] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-02T17:24:56.267554] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T17:24:56.278111] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-02T17:24:57.033343] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T17:24:57.073004] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-02T17:24:57.272008] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T17:24:57.873046] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-02T17:24:58.640012] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T17:24:58.672980] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-02T17:24:59.260899] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T17:24:59.473081] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-02T17:25:00.273156] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-02T17:25:00.584593] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T17:25:00.938207] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T17:25:01.073011] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-02T17:25:01.688387] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T17:25:01.873028] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-02T17:25:02.662245] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T17:25:02.672970] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-02T17:25:03.473055] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-02T17:25:03.763482] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T17:25:04.174426] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T17:25:04.273038] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-02T17:25:05.073016] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-02T17:25:05.131202] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T17:25:05.873028] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-02T17:25:06.214234] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T17:25:06.232393] [INFO ] [REMOTE ] AVNS: Full fetch complete (48295 records). [2025-10-02T17:25:06.247564] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-02T17:25:06.253595] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-02T17:25:06.675146] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-02T17:25:06.692218] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-02T17:25:06.692303] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-02T17:25:06.692872] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-02T17:25:06.692935] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-02T17:25:06.694153] [DEBUG] [LOCAL ] AVNS: Trimmed 48295 records to 33967 (keeping 200 days of data) [2025-10-02T17:25:06.916556] [DEBUG] [LOCAL ] AVNS: Primary data saved (33967 records). [2025-10-02T17:25:06.916735] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-02T17:25:06.916888] [INFO ] [MAIN ] Update Progress: 186/2370 symbols completed. AVNS took 38.1s. Estimated remaining: 4h 54m 9s. Rate: 7.4 symbols/min [2025-10-02T17:25:07.107987] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:07.135565] [DEBUG] [LOCAL ] AWF: Loaded 24390 existing records from primary storage. [2025-10-02T17:25:07.135892] [INFO ] [MAIN ] AWF: Loaded 24390 existing records. [2025-10-02T17:25:07.342881] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:07.343164] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-02T17:25:07.343228] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-02T17:25:07.344085] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-02T17:25:07.344160] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-02T17:25:07.475049] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-02T17:25:07.711738] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T17:25:07.830286] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:08.190491] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T17:25:08.192564] [INFO ] [REMOTE ] AVTR: Full fetch complete (77439 records). [2025-10-02T17:25:08.192734] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-02T17:25:08.278200] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-02T17:25:08.626296] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-10-02T17:25:08.626381] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-10-02T17:25:08.627163] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-10-02T17:25:08.627227] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-10-02T17:25:08.629003] [DEBUG] [LOCAL ] AVTR: Trimmed 77439 records to 53952 (keeping 200 days of data) [2025-10-02T17:25:08.999132] [DEBUG] [LOCAL ] AVTR: Primary data saved (53952 records). [2025-10-02T17:25:08.999299] [INFO ] [MAIN ] AVTR: Full history saved. [2025-10-02T17:25:08.999502] [INFO ] [MAIN ] Update Progress: 187/2370 symbols completed. AVTR took 30.0s. Estimated remaining: 4h 52m 51s. Rate: 7.5 symbols/min [2025-10-02T17:25:09.080810] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-10-02T17:25:09.224153] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:09.253176] [DEBUG] [LOCAL ] AWI: Loaded 25337 existing records from primary storage. [2025-10-02T17:25:09.253573] [INFO ] [MAIN ] AWI: Loaded 25337 existing records. [2025-10-02T17:25:09.398042] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-02T17:25:09.493702] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:09.493936] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-02T17:25:09.494024] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-02T17:25:09.494766] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-02T17:25:09.494828] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-02T17:25:09.837525] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T17:25:09.856482] [INFO ] [REMOTE ] AVY: Full fetch complete (56304 records). [2025-10-02T17:25:09.883179] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-02T17:25:09.867025] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-02T17:25:09.977485] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:10.370632] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T17:25:10.399306] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-10-02T17:25:10.399395] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-10-02T17:25:10.400099] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-10-02T17:25:10.400171] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-10-02T17:25:10.401369] [DEBUG] [LOCAL ] AVY: Trimmed 56304 records to 37777 (keeping 200 days of data) [2025-10-02T17:25:10.662831] [DEBUG] [LOCAL ] AVY: Primary data saved (37777 records). [2025-10-02T17:25:10.662983] [INFO ] [MAIN ] AVY: Full history saved. [2025-10-02T17:25:10.665126] [INFO ] [MAIN ] Update Progress: 188/2370 symbols completed. AVY took 29.8s. Estimated remaining: 4h 51m 29s. Rate: 7.5 symbols/min [2025-10-02T17:25:10.678185] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-10-02T17:25:10.872913] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:10.933474] [DEBUG] [LOCAL ] AWK: Loaded 48703 existing records from primary storage. [2025-10-02T17:25:10.933937] [INFO ] [MAIN ] AWK: Loaded 48703 existing records. [2025-10-02T17:25:11.147827] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:11.148294] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-02T17:25:11.148353] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-02T17:25:11.150546] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-02T17:25:11.150620] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-02T17:25:11.479363] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-02T17:25:11.555892] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:11.590786] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T17:25:11.607250] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T17:25:12.273040] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-02T17:25:12.642529] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T17:25:13.073010] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-02T17:25:13.287945] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T17:25:13.872991] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-02T17:25:14.150256] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T17:25:14.673021] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-02T17:25:15.045841] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T17:25:15.473028] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-10-02T17:25:15.930312] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T17:25:16.273052] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-02T17:25:16.992035] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T17:25:17.072996] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-02T17:25:17.424035] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T17:25:17.873010] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-02T17:25:18.475030] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:25:18.673021] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-02T17:25:19.021250] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T17:25:19.473001] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-02T17:25:20.272968] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-02T17:25:20.475319] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T17:25:20.582782] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T17:25:21.073006] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-02T17:25:21.379401] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T17:25:21.381223] [INFO ] [REMOTE ] AVNT: Full fetch complete (56422 records). [2025-10-02T17:25:21.381319] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-02T17:25:21.830133] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-02T17:25:21.830464] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-02T17:25:21.831202] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-02T17:25:21.831390] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-02T17:25:21.833102] [DEBUG] [LOCAL ] AVNT: Trimmed 56422 records to 39453 (keeping 200 days of data) [2025-10-02T17:25:21.900468] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-02T17:25:21.994550] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T17:25:22.122897] [DEBUG] [LOCAL ] AVNT: Primary data saved (39453 records). [2025-10-02T17:25:22.123057] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-02T17:25:22.123156] [INFO ] [MAIN ] Update Progress: 189/2370 symbols completed. AVNT took 43.3s. Estimated remaining: 4h 52m 1s. Rate: 7.5 symbols/min [2025-10-02T17:25:22.299085] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:22.322016] [DEBUG] [LOCAL ] AWP: Loaded 21493 existing records from primary storage. [2025-10-02T17:25:22.322306] [INFO ] [MAIN ] AWP: Loaded 21493 existing records. [2025-10-02T17:25:22.521761] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:22.522046] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-02T17:25:22.522095] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-02T17:25:22.522931] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-10-02T17:25:22.522992] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-02T17:25:22.679262] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-02T17:25:22.885510] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T17:25:22.950961] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:23.473022] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-10-02T17:25:24.272995] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-02T17:25:24.522482] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T17:25:24.557637] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T17:25:25.072984] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-02T17:25:25.450842] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:25:25.873004] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-02T17:25:26.197528] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T17:25:26.673023] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-02T17:25:27.092776] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-02T17:25:27.473012] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-02T17:25:28.273004] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-02T17:25:28.509836] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T17:25:28.643398] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T17:25:29.072966] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-02T17:25:29.468739] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-02T17:25:29.873004] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-02T17:25:30.058060] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T17:25:30.672990] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-02T17:25:31.063427] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T17:25:31.065170] [INFO ] [REMOTE ] AWF: Full fetch complete (36117 records). [2025-10-02T17:25:31.065267] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-02T17:25:31.471889] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-02T17:25:31.472075] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-02T17:25:31.472857] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-02T17:25:31.472943] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-02T17:25:31.473105] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-02T17:25:31.475587] [DEBUG] [LOCAL ] AWF: Trimmed 36117 records to 24560 (keeping 200 days of data) [2025-10-02T17:25:31.583497] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T17:25:31.658145] [DEBUG] [LOCAL ] AWF: Primary data saved (24560 records). [2025-10-02T17:25:31.658327] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-02T17:25:31.658445] [INFO ] [MAIN ] Update Progress: 190/2370 symbols completed. AWF took 24.7s. Estimated remaining: 4h 52m 10s. Rate: 7.5 symbols/min [2025-10-02T17:25:31.867222] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:31.890602] [DEBUG] [LOCAL ] AWR: Loaded 22600 existing records from primary storage. [2025-10-02T17:25:31.890950] [INFO ] [MAIN ] AWR: Loaded 22600 existing records. [2025-10-02T17:25:32.097003] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:32.097264] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-02T17:25:32.097316] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-02T17:25:32.098038] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-02T17:25:32.098102] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-02T17:25:32.285337] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-02T17:25:32.488287] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:33.007681] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T17:25:33.073018] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-10-02T17:25:33.872972] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-02T17:25:34.013284] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-02T17:25:34.155918] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T17:25:34.673032] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-02T17:25:34.955964] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T17:25:35.473024] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-02T17:25:36.273031] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-02T17:25:36.376069] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T17:25:36.586473] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:25:37.019746] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-02T17:25:37.073055] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-02T17:25:37.873068] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-02T17:25:38.288733] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T17:25:38.585579] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-02T17:25:38.673048] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-02T17:25:39.473012] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-02T17:25:40.116710] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T17:25:40.273010] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-02T17:25:40.640708] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T17:25:41.073033] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-02T17:25:41.873014] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-02T17:25:41.963361] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T17:25:41.988777] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T17:25:42.673017] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-02T17:25:43.108525] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T17:25:43.472974] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-02T17:25:43.631070] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-02T17:25:44.273015] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-02T17:25:45.072985] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-02T17:25:45.231532] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T17:25:45.362832] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T17:25:45.873068] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-02T17:25:46.244872] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:25:46.673050] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-02T17:25:47.093188] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T17:25:47.352211] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-02T17:25:47.473004] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-02T17:25:48.273022] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-02T17:25:48.295067] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T17:25:48.296427] [INFO ] [REMOTE ] AWI: Full fetch complete (35354 records). [2025-10-02T17:25:48.296524] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-02T17:25:48.297148] [FATAL] [VALIDATOR ] AWI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:25:48.297237] [FATAL] [MAIN ] AWI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:25:48.297281] [WARN ] [MAIN ] AWI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:25:48.297326] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-02T17:25:48.297389] [DEBUG] [LOCAL ] AWI: No primary data file found to delete. [2025-10-02T17:25:48.297425] [INFO ] [LOCAL ] AWI: Starting deletion of derivative data. [2025-10-02T17:25:48.298268] [DEBUG] [LOCAL ] AWI: Deleted derivative data file. [2025-10-02T17:25:48.298375] [INFO ] [MAIN ] Update Progress: 191/2370 symbols completed. AWI took 39.3s. Estimated remaining: 4h 53m 40s. Rate: 7.4 symbols/min [2025-10-02T17:25:48.487608] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:48.520739] [DEBUG] [LOCAL ] AX: Loaded 28317 existing records from primary storage. [2025-10-02T17:25:48.521051] [INFO ] [MAIN ] AX: Loaded 28317 existing records. [2025-10-02T17:25:48.755368] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:48.755608] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-02T17:25:48.755715] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-02T17:25:48.756609] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-02T17:25:48.756706] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-02T17:25:49.078207] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-02T17:25:49.197461] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:49.676133] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:25:49.873009] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-02T17:25:50.331514] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T17:25:50.673026] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-10-02T17:25:51.379584] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T17:25:51.381758] [INFO ] [REMOTE ] AWK: Full fetch complete (70638 records). [2025-10-02T17:25:51.381867] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-02T17:25:51.478103] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-02T17:25:51.814961] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-02T17:25:51.815135] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-02T17:25:51.815988] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-02T17:25:51.816054] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-02T17:25:51.817727] [DEBUG] [LOCAL ] AWK: Trimmed 70638 records to 49037 (keeping 200 days of data) [2025-10-02T17:25:52.122701] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T17:25:52.197242] [DEBUG] [LOCAL ] AWK: Primary data saved (49037 records). [2025-10-02T17:25:52.197407] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-02T17:25:52.198710] [INFO ] [MAIN ] Update Progress: 192/2370 symbols completed. AWK took 41.5s. Estimated remaining: 4h 52m 44s. Rate: 7.4 symbols/min [2025-10-02T17:25:52.281478] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-02T17:25:52.440511] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:52.502136] [DEBUG] [LOCAL ] AXL: Loaded 50496 existing records from primary storage. [2025-10-02T17:25:52.502477] [INFO ] [MAIN ] AXL: Loaded 50496 existing records. [2025-10-02T17:25:52.720346] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:52.720872] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-02T17:25:52.720955] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-02T17:25:52.727451] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-02T17:25:52.736232] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-02T17:25:52.801805] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T17:25:53.078200] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-02T17:25:53.212217] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:53.652603] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T17:25:53.872971] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-02T17:25:53.964133] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-02T17:25:54.672995] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-02T17:25:55.002429] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T17:25:55.472977] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-02T17:25:55.586415] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T17:25:56.272982] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-02T17:25:56.868043] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T17:25:57.073003] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-02T17:25:57.127160] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T17:25:57.129048] [INFO ] [REMOTE ] AWR: Full fetch complete (32125 records). [2025-10-02T17:25:57.129139] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-02T17:25:57.555928] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-02T17:25:57.556046] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-02T17:25:57.556466] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-02T17:25:57.556511] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-02T17:25:57.557398] [DEBUG] [LOCAL ] AWR: Trimmed 32125 records to 22776 (keeping 200 days of data) [2025-10-02T17:25:57.702396] [DEBUG] [LOCAL ] AWR: Primary data saved (22776 records). [2025-10-02T17:25:57.702534] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-02T17:25:57.702623] [INFO ] [MAIN ] Update Progress: 193/2370 symbols completed. AWR took 26.0s. Estimated remaining: 4h 52m 8s. Rate: 7.5 symbols/min [2025-10-02T17:25:57.886855] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:25:57.882244] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-02T17:25:57.946599] [DEBUG] [LOCAL ] AXP: Loaded 53197 existing records from primary storage. [2025-10-02T17:25:57.946952] [INFO ] [MAIN ] AXP: Loaded 53197 existing records. [2025-10-02T17:25:58.147595] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:25:58.147938] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-02T17:25:58.148054] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-02T17:25:58.150043] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-02T17:25:58.150205] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-02T17:25:58.491191] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T17:25:58.581920] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:25:58.672994] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-10-02T17:25:59.059376] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:25:59.473068] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-10-02T17:26:00.273056] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-02T17:26:01.072991] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-02T17:26:01.204750] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-02T17:26:01.264847] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T17:26:01.292252] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-02T17:26:01.873043] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-02T17:26:02.129375] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T17:26:02.672998] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-02T17:26:03.112776] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T17:26:03.473041] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-02T17:26:04.273012] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-02T17:26:04.577021] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T17:26:04.998509] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:26:05.073003] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-02T17:26:05.592393] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T17:26:05.873007] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-02T17:26:06.550157] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T17:26:06.551471] [INFO ] [REMOTE ] AWP: Full fetch complete (32235 records). [2025-10-02T17:26:06.551547] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-02T17:26:06.675685] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-02T17:26:06.965223] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-02T17:26:06.965499] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-02T17:26:06.966190] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-02T17:26:06.966278] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-02T17:26:06.967593] [DEBUG] [LOCAL ] AWP: Trimmed 32235 records to 21611 (keeping 200 days of data) [2025-10-02T17:26:07.085239] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-02T17:26:07.139938] [DEBUG] [LOCAL ] AWP: Primary data saved (21611 records). [2025-10-02T17:26:07.140074] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-02T17:26:07.140161] [INFO ] [MAIN ] Update Progress: 194/2370 symbols completed. AWP took 45.0s. Estimated remaining: 4h 52m 15s. Rate: 7.4 symbols/min [2025-10-02T17:26:07.329122] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:07.333943] [DEBUG] [LOCAL ] AXR: Loaded 3037 existing records from primary storage. [2025-10-02T17:26:07.334109] [INFO ] [MAIN ] AXR: Loaded 3037 existing records. [2025-10-02T17:26:07.484210] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-02T17:26:07.530969] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:26:07.531238] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-02T17:26:07.531334] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-02T17:26:07.531623] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-02T17:26:07.531722] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-02T17:26:07.967311] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:08.273027] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-02T17:26:08.427429] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T17:26:08.801862] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T17:26:09.073017] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-02T17:26:09.872968] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-02T17:26:09.980139] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T17:26:10.217753] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-02T17:26:10.673038] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-10-02T17:26:11.473060] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T17:26:11.473175] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-02T17:26:11.746516] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-02T17:26:12.273005] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-02T17:26:12.608052] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T17:26:13.073070] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-02T17:26:13.873011] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-02T17:26:14.049369] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T17:26:14.673007] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-02T17:26:14.748127] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:26:14.749765] [INFO ] [REMOTE ] AX: Full fetch complete (42672 records). [2025-10-02T17:26:14.749872] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-02T17:26:15.180367] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-02T17:26:15.180448] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-02T17:26:15.180969] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-02T17:26:15.181033] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-02T17:26:15.182036] [DEBUG] [LOCAL ] AX: Trimmed 42672 records to 28542 (keeping 200 days of data) [2025-10-02T17:26:15.363629] [DEBUG] [LOCAL ] AX: Primary data saved (28542 records). [2025-10-02T17:26:15.363918] [INFO ] [MAIN ] AX: Full history saved. [2025-10-02T17:26:15.364083] [INFO ] [MAIN ] Update Progress: 195/2370 symbols completed. AX took 27.1s. Estimated remaining: 4h 52m 9s. Rate: 7.4 symbols/min [2025-10-02T17:26:15.478094] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-02T17:26:15.586377] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:15.631207] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-10-02T17:26:15.684144] [DEBUG] [LOCAL ] AXS: Loaded 38383 existing records from primary storage. [2025-10-02T17:26:15.684502] [INFO ] [MAIN ] AXS: Loaded 38383 existing records. [2025-10-02T17:26:15.886910] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:26:15.887127] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-02T17:26:15.887187] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-02T17:26:15.888682] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-02T17:26:15.888746] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-02T17:26:16.298452] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:16.292008] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-02T17:26:16.311839] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T17:26:16.345859] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T17:26:17.073015] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-10-02T17:26:17.873014] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-02T17:26:18.366795] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-02T17:26:18.623513] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T17:26:18.652626] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T17:26:18.672965] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-02T17:26:19.473028] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-02T17:26:20.105709] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T17:26:20.273005] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-02T17:26:21.072999] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-02T17:26:21.549998] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-02T17:26:21.692533] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T17:26:21.873024] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-02T17:26:22.358602] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-02T17:26:22.673000] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-02T17:26:22.803625] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T17:26:23.290040] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-02T17:26:23.473004] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-02T17:26:24.273000] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-02T17:26:25.073007] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-02T17:26:25.107403] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T17:26:25.873004] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-02T17:26:26.343599] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-02T17:26:26.504016] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-02T17:26:26.673001] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-02T17:26:26.722715] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T17:26:27.043408] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-02T17:26:27.473003] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-02T17:26:28.273004] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-02T17:26:28.936401] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:26:29.072991] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-02T17:26:29.372012] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T17:26:29.873056] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-02T17:26:30.233734] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T17:26:30.411755] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-02T17:26:30.673044] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-02T17:26:31.472999] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-02T17:26:32.086110] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T17:26:32.113339] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T17:26:32.273015] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-02T17:26:33.053924] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T17:26:33.072990] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-02T17:26:33.510562] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T17:26:33.511425] [INFO ] [REMOTE ] AXR: Full fetch complete (4834 records). [2025-10-02T17:26:33.511511] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-02T17:26:33.512023] [FATAL] [VALIDATOR ] AXR: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:26:33.512124] [FATAL] [MAIN ] AXR: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:26:33.512176] [WARN ] [MAIN ] AXR: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:26:33.512225] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-02T17:26:33.512332] [DEBUG] [LOCAL ] AXR: No primary data file found to delete. [2025-10-02T17:26:33.512396] [INFO ] [LOCAL ] AXR: Starting deletion of derivative data. [2025-10-02T17:26:33.512933] [DEBUG] [LOCAL ] AXR: Deleted derivative data file. [2025-10-02T17:26:33.513054] [INFO ] [MAIN ] Update Progress: 196/2370 symbols completed. AXR took 26.4s. Estimated remaining: 4h 53m 53s. Rate: 7.4 symbols/min [2025-10-02T17:26:33.720095] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:33.781413] [DEBUG] [LOCAL ] AXTA: Loaded 52067 existing records from primary storage. [2025-10-02T17:26:33.781772] [INFO ] [MAIN ] AXTA: Loaded 52067 existing records. [2025-10-02T17:26:33.878102] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-02T17:26:33.984794] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:26:33.984997] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-02T17:26:33.985047] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-02T17:26:33.986667] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-02T17:26:33.986731] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-02T17:26:34.396376] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:34.673030] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-02T17:26:35.472987] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-10-02T17:26:35.733963] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T17:26:35.794494] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T17:26:36.273011] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-02T17:26:37.073051] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-02T17:26:37.166976] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T17:26:37.690807] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T17:26:37.693010] [INFO ] [REMOTE ] AXL: Full fetch complete (72677 records). [2025-10-02T17:26:37.693144] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-02T17:26:37.879196] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-02T17:26:38.123685] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-02T17:26:38.123793] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-02T17:26:38.124585] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-02T17:26:38.124632] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-02T17:26:38.126251] [DEBUG] [LOCAL ] AXL: Trimmed 72677 records to 50866 (keeping 200 days of data) [2025-10-02T17:26:38.447755] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T17:26:38.463758] [DEBUG] [LOCAL ] AXL: Primary data saved (50866 records). [2025-10-02T17:26:38.463882] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-02T17:26:38.465317] [INFO ] [MAIN ] Update Progress: 197/2370 symbols completed. AXL took 46.3s. Estimated remaining: 4h 53m 10s. Rate: 7.4 symbols/min [2025-10-02T17:26:38.673060] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-02T17:26:39.473103] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-02T17:26:40.025736] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-02T17:26:40.075735] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:26:40.273056] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-02T17:26:40.708390] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T17:26:41.073008] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-02T17:26:41.873030] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-02T17:26:42.065115] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-02T17:26:42.068208] [INFO ] [REMOTE ] AXP: Full fetch complete (76913 records). [2025-10-02T17:26:42.068467] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-02T17:26:42.497143] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-02T17:26:42.497388] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-02T17:26:42.498543] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-02T17:26:42.498631] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-02T17:26:42.500722] [DEBUG] [LOCAL ] AXP: Trimmed 76913 records to 53579 (keeping 200 days of data) [2025-10-02T17:26:42.800540] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T17:26:42.812732] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-02T17:26:42.909596] [DEBUG] [LOCAL ] AXP: Primary data saved (53579 records). [2025-10-02T17:26:42.909769] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-02T17:26:42.912326] [INFO ] [MAIN ] Update Progress: 198/2370 symbols completed. AXP took 45.2s. Estimated remaining: 4h 52m 22s. Rate: 7.4 symbols/min [2025-10-02T17:26:42.970089] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T17:26:42.971969] [INFO ] [REMOTE ] AXS: Full fetch complete (55720 records). [2025-10-02T17:26:42.972107] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-02T17:26:43.392114] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-02T17:26:43.392213] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-02T17:26:43.393001] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-02T17:26:43.393082] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-02T17:26:43.394527] [DEBUG] [LOCAL ] AXS: Trimmed 55720 records to 38703 (keeping 200 days of data) [2025-10-02T17:26:43.667016] [DEBUG] [LOCAL ] AXS: Primary data saved (38703 records). [2025-10-02T17:26:43.667188] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-02T17:26:43.667287] [INFO ] [MAIN ] Update Progress: 199/2370 symbols completed. AXS took 28.3s. Estimated remaining: 4h 50m 54s. Rate: 7.5 symbols/min [2025-10-02T17:26:44.065613] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T17:26:44.077044] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-02T17:26:45.855029] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T17:26:45.866879] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-02T17:26:47.696800] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T17:26:47.708770] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-02T17:26:49.169198] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T17:26:49.181260] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-02T17:26:50.835094] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T17:26:50.846726] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-02T17:26:52.300569] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T17:26:52.312305] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-02T17:26:53.531847] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-02T17:26:53.544242] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-02T17:26:54.819149] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T17:26:54.821282] [INFO ] [REMOTE ] AXTA: Full fetch complete (75088 records). [2025-10-02T17:26:54.821416] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-02T17:26:55.261423] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-02T17:26:55.261561] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-02T17:26:55.262391] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-02T17:26:55.262460] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-02T17:26:55.264144] [DEBUG] [LOCAL ] AXTA: Trimmed 75088 records to 52453 (keeping 200 days of data) [2025-10-02T17:26:55.585934] [DEBUG] [LOCAL ] AXTA: Primary data saved (52453 records). [2025-10-02T17:26:55.586085] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-02T17:26:55.586174] [INFO ] [MAIN ] Update Progress: 200/2370 symbols completed. AXTA took 22.1s. Estimated remaining: 4h 51m 28s. Rate: 7.4 symbols/min [2025-10-02T17:26:56.151504] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:56.346132] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:56.377111] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:56.405688] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:26:56.406180] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-02T17:26:56.406485] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-02T17:26:56.406883] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-02T17:26:56.407016] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-02T17:26:56.407109] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-02T17:26:56.407573] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-02T17:26:56.500932] [DEBUG] [LOCAL ] AYI: Loaded 25181 existing records from primary storage. [2025-10-02T17:26:56.517008] [INFO ] [MAIN ] AYI: Loaded 25181 existing records. [2025-10-02T17:26:56.539816] [DEBUG] [LOCAL ] AZO: Loaded 11278 existing records from primary storage. [2025-10-02T17:26:56.574296] [INFO ] [MAIN ] AZO: Loaded 11278 existing records. [2025-10-02T17:26:56.651958] [DEBUG] [LOCAL ] AZZ: Loaded 21975 existing records from primary storage. [2025-10-02T17:26:56.782373] [INFO ] [MAIN ] AZZ: Loaded 21975 existing records. [2025-10-02T17:26:57.171624] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:26:57.201071] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-02T17:26:57.237333] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-02T17:26:57.332404] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-02T17:26:57.333457] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-02T17:26:57.385821] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:26:57.431950] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:57.442490] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-02T17:26:57.464923] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-02T17:26:57.490515] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-10-02T17:26:57.546735] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-02T17:26:57.574572] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-02T17:26:57.587123] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:26:57.656215] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-02T17:26:57.678476] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-02T17:26:57.745843] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-02T17:26:57.792004] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-02T17:26:58.475822] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:58.530770] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-10-02T17:26:58.736371] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:58.765297] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-10-02T17:26:58.849802] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:26:58.850300] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-10-02T17:26:58.989151] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T17:26:58.996415] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-02T17:26:59.749431] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T17:26:59.753303] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-02T17:26:59.809348] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T17:26:59.814052] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-02T17:26:59.864125] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T17:26:59.869893] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-02T17:26:59.908884] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T17:26:59.915610] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-02T17:27:00.132357] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:27:00.133293] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-02T17:27:00.133401] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:27:00.133719] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-02T17:27:00.133794] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:27:00.133903] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-02T17:27:00.134001] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-02T17:27:00.134092] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-02T17:27:00.134193] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-02T17:27:00.134302] [INFO ] [MAIN ] Update Progress: 201/2370 symbols completed. B took 4.5s. Estimated remaining: 4h 50m 42s. Rate: 7.5 symbols/min [2025-10-02T17:27:00.322235] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:27:00.348493] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T17:27:00.351554] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-02T17:27:00.398601] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-02T17:27:00.398999] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-02T17:27:00.599399] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:27:00.599669] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-02T17:27:00.599734] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-02T17:27:00.601758] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-02T17:27:00.601830] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-02T17:27:01.054676] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:27:01.060477] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-10-02T17:27:01.068952] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T17:27:01.076761] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-02T17:27:01.084920] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T17:27:01.087798] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-02T17:27:01.398509] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T17:27:01.405163] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-02T17:27:01.982973] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T17:27:01.988360] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-02T17:27:02.072511] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-02T17:27:02.078065] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-02T17:27:02.532510] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T17:27:02.539901] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-02T17:27:02.684145] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T17:27:02.687714] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-02T17:27:02.871804] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T17:27:03.350362] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T17:27:03.472985] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-02T17:27:03.506111] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T17:27:03.702102] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-10-02T17:27:04.273020] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-02T17:27:04.689042] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T17:27:05.073037] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-02T17:27:05.754311] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T17:27:05.873037] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-02T17:27:06.672995] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-02T17:27:06.985360] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T17:27:07.299442] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-02T17:27:07.473026] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-02T17:27:07.504672] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T17:27:08.273006] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-02T17:27:08.391577] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T17:27:09.073006] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-02T17:27:09.301019] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:27:09.873019] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-02T17:27:10.673033] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-02T17:27:10.985474] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T17:27:11.140756] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-02T17:27:11.473002] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-02T17:27:11.627151] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T17:27:12.273006] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-02T17:27:13.072988] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-02T17:27:13.213933] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T17:27:13.645273] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T17:27:13.750761] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-02T17:27:13.873000] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-02T17:27:14.672968] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-02T17:27:14.945260] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T17:27:15.473007] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-02T17:27:16.021989] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T17:27:16.273017] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-02T17:27:17.073004] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-02T17:27:17.453867] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-02T17:27:17.873012] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-02T17:27:17.936291] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-02T17:27:18.070561] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-02T17:27:18.576852] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T17:27:18.578554] [INFO ] [REMOTE ] AYI: Full fetch complete (37106 records). [2025-10-02T17:27:18.578684] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-02T17:27:18.678120] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-02T17:27:18.991450] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-02T17:27:18.991531] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-02T17:27:18.992097] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-02T17:27:18.992181] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-02T17:27:18.993317] [DEBUG] [LOCAL ] AYI: Trimmed 37106 records to 25458 (keeping 200 days of data) [2025-10-02T17:27:19.162678] [DEBUG] [LOCAL ] AYI: Primary data saved (25458 records). [2025-10-02T17:27:19.162814] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-02T17:27:19.162957] [INFO ] [MAIN ] Update Progress: 202/2370 symbols completed. AYI took 23.6s. Estimated remaining: 4h 52m 32s. Rate: 7.4 symbols/min [2025-10-02T17:27:19.349426] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:27:19.415458] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-10-02T17:27:19.415876] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-10-02T17:27:19.478245] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-02T17:27:19.510866] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T17:27:19.554693] [INFO ] [REMOTE ] AZO: Full fetch complete (16177 records). [2025-10-02T17:27:19.563466] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-02T17:27:19.795073] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:27:19.830873] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-02T17:27:19.849331] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-02T17:27:19.876408] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-10-02T17:27:19.942682] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-02T17:27:20.241068] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-02T17:27:20.251529] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-02T17:27:20.253036] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-02T17:27:20.260428] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-02T17:27:20.281798] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-02T17:27:20.340843] [DEBUG] [LOCAL ] AZO: Trimmed 16177 records to 11370 (keeping 200 days of data) [2025-10-02T17:27:20.559133] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:27:20.574361] [DEBUG] [LOCAL ] AZO: Primary data saved (11370 records). [2025-10-02T17:27:20.574524] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-02T17:27:20.574670] [INFO ] [MAIN ] Update Progress: 203/2370 symbols completed. AZO took 25.0s. Estimated remaining: 4h 51m 12s. Rate: 7.4 symbols/min [2025-10-02T17:27:20.783043] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:27:20.853595] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-02T17:27:20.853965] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-02T17:27:21.064779] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:27:21.065021] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-02T17:27:21.065088] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-02T17:27:21.066924] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-02T17:27:21.066989] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-02T17:27:21.100927] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-10-02T17:27:21.495989] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:27:21.511105] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T17:27:21.763091] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-02T17:27:21.873014] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-02T17:27:22.673037] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-10-02T17:27:22.921881] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T17:27:23.472994] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-02T17:27:24.163564] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (3.06 seconds). [2025-10-02T17:27:24.273000] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-02T17:27:24.280586] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T17:27:24.281947] [INFO ] [REMOTE ] AZZ: Full fetch complete (30916 records). [2025-10-02T17:27:24.282079] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-02T17:27:24.701141] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-02T17:27:24.701277] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-02T17:27:24.701841] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-02T17:27:24.701905] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-02T17:27:24.702777] [DEBUG] [LOCAL ] AZZ: Trimmed 30916 records to 22158 (keeping 200 days of data) [2025-10-02T17:27:24.847417] [DEBUG] [LOCAL ] AZZ: Primary data saved (22158 records). [2025-10-02T17:27:24.847620] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-02T17:27:24.847930] [INFO ] [MAIN ] Update Progress: 204/2370 symbols completed. AZZ took 29.3s. Estimated remaining: 4h 50m 24s. Rate: 7.5 symbols/min [2025-10-02T17:27:25.031147] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:27:25.066368] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-10-02T17:27:25.077781] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-02T17:27:25.139086] [DEBUG] [LOCAL ] BAH: Loaded 51669 existing records from primary storage. [2025-10-02T17:27:25.139485] [INFO ] [MAIN ] BAH: Loaded 51669 existing records. [2025-10-02T17:27:25.349296] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:27:25.349553] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-02T17:27:25.349607] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-02T17:27:25.351667] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-02T17:27:25.351736] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-02T17:27:25.782735] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:27:25.873040] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-02T17:27:26.466753] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-02T17:27:26.673069] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-10-02T17:27:27.106948] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-02T17:27:27.473043] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-02T17:27:28.272995] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-02T17:27:28.312599] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-02T17:27:28.631617] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T17:27:29.073039] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-02T17:27:29.301080] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-02T17:27:29.873002] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-02T17:27:30.406042] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T17:27:30.673004] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-02T17:27:30.766407] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-10-02T17:27:31.473034] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-02T17:27:32.272978] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-02T17:27:32.608220] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-02T17:27:32.656178] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-02T17:27:33.073045] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-02T17:27:33.803710] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-10-02T17:27:33.873004] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-02T17:27:34.039037] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T17:27:34.673066] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-02T17:27:35.458305] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-02T17:27:35.472959] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-02T17:27:36.272994] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-02T17:27:36.541145] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T17:27:36.559146] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-02T17:27:37.073066] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-02T17:27:37.524261] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-02T17:27:37.872985] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-02T17:27:38.202593] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T17:27:38.673011] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-02T17:27:39.472980] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-02T17:27:39.642120] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-10-02T17:27:39.769078] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T17:27:40.273831] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-02T17:27:40.279879] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T17:27:41.072993] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-02T17:27:41.714980] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-02T17:27:41.717186] [INFO ] [REMOTE ] BA: Full fetch complete (77924 records). [2025-10-02T17:27:41.717349] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-02T17:27:41.878163] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-02T17:27:42.170067] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-02T17:27:42.170294] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-02T17:27:42.171219] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-02T17:27:42.171337] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-02T17:27:42.173352] [DEBUG] [LOCAL ] BA: Trimmed 77924 records to 54180 (keeping 200 days of data) [2025-10-02T17:27:42.451639] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-02T17:27:42.585281] [DEBUG] [LOCAL ] BA: Primary data saved (54180 records). [2025-10-02T17:27:42.585451] [INFO ] [MAIN ] BA: Full history saved. [2025-10-02T17:27:42.585571] [INFO ] [MAIN ] Update Progress: 205/2370 symbols completed. BA took 42.5s. Estimated remaining: 4h 51m 58s. Rate: 7.4 symbols/min [2025-10-02T17:27:42.686098] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-02T17:27:42.773103] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:27:42.812824] [DEBUG] [LOCAL ] BAK: Loaded 39146 existing records from primary storage. [2025-10-02T17:27:42.813150] [INFO ] [MAIN ] BAK: Loaded 39146 existing records. [2025-10-02T17:27:43.003935] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:27:43.004300] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-02T17:27:43.004379] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-02T17:27:43.006264] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-02T17:27:43.006343] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-02T17:27:43.440303] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:27:43.482395] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-10-02T17:27:43.516859] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T17:27:43.585794] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-02T17:27:44.272998] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-02T17:27:44.939548] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T17:27:45.035285] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-10-02T17:27:45.073027] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-02T17:27:45.641589] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T17:27:45.873012] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-02T17:27:46.673051] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-02T17:27:47.174839] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T17:27:47.331414] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-02T17:27:47.473020] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-02T17:27:48.075030] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:27:48.273042] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-02T17:27:48.876212] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T17:27:49.073025] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-02T17:27:49.872993] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-02T17:27:50.157396] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-02T17:27:50.673021] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-02T17:27:51.344841] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T17:27:51.472963] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-02T17:27:51.956379] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-10-02T17:27:52.273002] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-02T17:27:52.435086] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T17:27:52.825536] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T17:27:53.073008] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-02T17:27:53.700183] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T17:27:53.872991] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-02T17:27:54.066382] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T17:27:54.673005] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-02T17:27:55.473020] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-02T17:27:55.707417] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-02T17:27:55.709666] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-10-02T17:27:55.709795] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-02T17:27:56.139263] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-02T17:27:56.139372] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-02T17:27:56.140187] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-02T17:27:56.140263] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-02T17:27:56.141822] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 54198 (keeping 200 days of data) [2025-10-02T17:27:56.273834] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-02T17:27:56.282111] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T17:27:56.515313] [DEBUG] [LOCAL ] BAC: Primary data saved (54198 records). [2025-10-02T17:27:56.515447] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-02T17:27:56.517574] [INFO ] [MAIN ] Update Progress: 206/2370 symbols completed. BAC took 35.9s. Estimated remaining: 4h 52m 51s. Rate: 7.4 symbols/min [2025-10-02T17:27:56.709707] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:27:56.770988] [DEBUG] [LOCAL ] BALL: Loaded 51797 existing records from primary storage. [2025-10-02T17:27:56.771340] [INFO ] [MAIN ] BALL: Loaded 51797 existing records. [2025-10-02T17:27:56.975612] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:27:56.976028] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-02T17:27:56.976092] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-02T17:27:56.977958] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-02T17:27:56.978058] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-02T17:27:57.075278] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-02T17:27:57.404246] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:27:57.450296] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-02T17:27:57.873043] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-10-02T17:27:58.383413] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T17:27:58.634886] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T17:27:58.672988] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-02T17:27:59.473007] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-02T17:27:59.771302] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T17:27:59.939865] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T17:28:00.273052] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-02T17:28:00.941139] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T17:28:00.945139] [INFO ] [REMOTE ] BAH: Full fetch complete (74803 records). [2025-10-02T17:28:00.945285] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-02T17:28:01.078201] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-02T17:28:01.389804] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-02T17:28:01.389898] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-02T17:28:01.390704] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-02T17:28:01.390776] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-02T17:28:01.392336] [DEBUG] [LOCAL ] BAH: Trimmed 74803 records to 52055 (keeping 200 days of data) [2025-10-02T17:28:01.776795] [DEBUG] [LOCAL ] BAH: Primary data saved (52055 records). [2025-10-02T17:28:01.776959] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-02T17:28:01.778582] [INFO ] [MAIN ] Update Progress: 207/2370 symbols completed. BAH took 36.9s. Estimated remaining: 4h 52m 14s. Rate: 7.4 symbols/min [2025-10-02T17:28:01.888466] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-02T17:28:01.973840] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:01.974403] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-02T17:28:01.974489] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-02T17:28:01.974819] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-02T17:28:01.974879] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-02T17:28:01.983137] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-02T17:28:01.989808] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-02T17:28:02.060064] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T17:28:02.402140] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:02.497107] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T17:28:02.673042] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-02T17:28:03.473013] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-10-02T17:28:04.026712] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-02T17:28:04.029011] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-10-02T17:28:04.029161] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-02T17:28:04.278601] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-02T17:28:04.503934] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-02T17:28:04.518925] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-02T17:28:04.523250] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T17:28:04.520851] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-02T17:28:04.534405] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-02T17:28:04.536482] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 54210 (keeping 200 days of data) [2025-10-02T17:28:04.784494] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T17:28:04.915542] [DEBUG] [LOCAL ] BABA: Primary data saved (54210 records). [2025-10-02T17:28:04.915723] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-02T17:28:04.915820] [INFO ] [MAIN ] Update Progress: 208/2370 symbols completed. BABA took 45.8s. Estimated remaining: 4h 51m 14s. Rate: 7.4 symbols/min [2025-10-02T17:28:05.076202] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-02T17:28:05.104935] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:05.158968] [DEBUG] [LOCAL ] BAM: Loaded 51995 existing records from primary storage. [2025-10-02T17:28:05.159357] [INFO ] [MAIN ] BAM: Loaded 51995 existing records. [2025-10-02T17:28:05.378899] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:05.379564] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-02T17:28:05.379745] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-02T17:28:05.381512] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-02T17:28:05.381662] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-02T17:28:05.509913] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T17:28:05.523026] [INFO ] [REMOTE ] BAK: Full fetch complete (57198 records). [2025-10-02T17:28:05.554530] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-02T17:28:05.874598] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-02T17:28:06.050174] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:06.253521] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-02T17:28:06.254139] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-02T17:28:06.255576] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T17:28:06.254807] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-02T17:28:06.261592] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-02T17:28:06.263403] [DEBUG] [LOCAL ] BAK: Trimmed 57198 records to 39471 (keeping 200 days of data) [2025-10-02T17:28:06.482228] [DEBUG] [LOCAL ] BAK: Primary data saved (39471 records). [2025-10-02T17:28:06.482373] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-02T17:28:06.482456] [INFO ] [MAIN ] Update Progress: 209/2370 symbols completed. BAK took 23.9s. Estimated remaining: 4h 49m 58s. Rate: 7.5 symbols/min [2025-10-02T17:28:06.663698] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:06.673014] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-10-02T17:28:06.724356] [DEBUG] [LOCAL ] BANC: Loaded 51240 existing records from primary storage. [2025-10-02T17:28:06.724751] [INFO ] [MAIN ] BANC: Loaded 51240 existing records. [2025-10-02T17:28:06.921824] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:06.922057] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-02T17:28:06.922107] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-02T17:28:06.923445] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-02T17:28:06.923509] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-02T17:28:07.309479] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:07.472978] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-02T17:28:07.777154] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T17:28:07.916086] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-02T17:28:08.272992] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-10-02T17:28:08.347234] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:28:09.073008] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-02T17:28:09.798665] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T17:28:09.875161] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-02T17:28:09.876798] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-02T17:28:10.673000] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-02T17:28:11.473015] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-02T17:28:11.679011] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T17:28:12.257225] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T17:28:12.266177] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:28:12.276006] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-02T17:28:13.073020] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-02T17:28:13.694975] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T17:28:13.873015] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-02T17:28:14.517498] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T17:28:14.673051] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-02T17:28:15.333845] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-02T17:28:15.472971] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-02T17:28:15.603980] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:28:16.273017] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-02T17:28:17.041822] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T17:28:17.072983] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-02T17:28:17.864527] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T17:28:17.874628] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-02T17:28:18.674839] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-02T17:28:18.681783] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T17:28:18.734206] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-02T17:28:19.473001] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-02T17:28:20.272997] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-02T17:28:20.306589] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T17:28:20.500403] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T17:28:21.073003] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-02T17:28:21.872979] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-02T17:28:22.033365] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:28:22.672968] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-02T17:28:22.780605] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T17:28:23.364809] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T17:28:23.473020] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-02T17:28:23.703407] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T17:28:24.272981] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-02T17:28:25.072977] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-02T17:28:25.200025] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T17:28:25.872992] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-02T17:28:25.926272] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T17:28:25.975575] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T17:28:26.673041] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-02T17:28:27.264236] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T17:28:27.265259] [INFO ] [REMOTE ] BALY: Full fetch complete (16884 records). [2025-10-02T17:28:27.265333] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-02T17:28:27.475315] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-02T17:28:27.483325] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T17:28:27.484422] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:28:27.485820] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:28:27.485944] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-02T17:28:27.486062] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-02T17:28:27.486118] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-02T17:28:27.486326] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-02T17:28:27.486491] [INFO ] [MAIN ] Update Progress: 210/2370 symbols completed. BALY took 25.7s. Estimated remaining: 4h 52m 3s. Rate: 7.4 symbols/min [2025-10-02T17:28:27.737770] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:27.755555] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T17:28:27.793300] [DEBUG] [LOCAL ] BAP: Loaded 26187 existing records from primary storage. [2025-10-02T17:28:27.793578] [INFO ] [MAIN ] BAP: Loaded 26187 existing records. [2025-10-02T17:28:27.981230] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:27.981451] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-02T17:28:27.981503] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-02T17:28:27.982398] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-02T17:28:27.982462] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-02T17:28:28.281301] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-02T17:28:28.372356] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:28.919347] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T17:28:29.073051] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-10-02T17:28:29.873000] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-02T17:28:30.058198] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T17:28:30.373719] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T17:28:30.672995] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-02T17:28:31.473052] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-02T17:28:31.620612] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T17:28:31.853540] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T17:28:32.272981] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-02T17:28:32.877511] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T17:28:33.073020] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-02T17:28:33.351564] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T17:28:33.873023] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-02T17:28:34.566380] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T17:28:34.673036] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-02T17:28:35.278872] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T17:28:35.473050] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-02T17:28:36.272993] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-02T17:28:36.488276] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T17:28:36.490618] [INFO ] [REMOTE ] BALL: Full fetch complete (75359 records). [2025-10-02T17:28:36.490783] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-02T17:28:36.926524] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-02T17:28:36.926695] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-02T17:28:36.927546] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-02T17:28:36.927595] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-02T17:28:36.929106] [DEBUG] [LOCAL ] BALL: Trimmed 75359 records to 52177 (keeping 200 days of data) [2025-10-02T17:28:37.068936] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:28:37.079689] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-02T17:28:37.313992] [DEBUG] [LOCAL ] BALL: Primary data saved (52177 records). [2025-10-02T17:28:37.314135] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-02T17:28:37.314763] [INFO ] [MAIN ] Update Progress: 211/2370 symbols completed. BALL took 40.8s. Estimated remaining: 4h 52m 13s. Rate: 7.4 symbols/min [2025-10-02T17:28:37.502150] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:37.544308] [DEBUG] [LOCAL ] BARK: Loaded 38105 existing records from primary storage. [2025-10-02T17:28:37.544637] [INFO ] [MAIN ] BARK: Loaded 38105 existing records. [2025-10-02T17:28:37.781144] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:37.783835] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T17:28:37.781967] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-02T17:28:37.795251] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-02T17:28:37.796823] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-02T17:28:37.796896] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-02T17:28:37.882761] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-02T17:28:38.227013] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:38.422685] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T17:28:38.673007] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-02T17:28:39.281232] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T17:28:39.473037] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-02T17:28:40.035132] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T17:28:40.273011] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-02T17:28:40.923495] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T17:28:40.925565] [INFO ] [REMOTE ] BANC: Full fetch complete (74266 records). [2025-10-02T17:28:40.925710] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-02T17:28:41.086000] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-02T17:28:41.376459] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-02T17:28:41.376564] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-02T17:28:41.377381] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-02T17:28:41.377454] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-02T17:28:41.379093] [DEBUG] [LOCAL ] BANC: Trimmed 74266 records to 51623 (keeping 200 days of data) [2025-10-02T17:28:41.713560] [DEBUG] [LOCAL ] BANC: Primary data saved (51623 records). [2025-10-02T17:28:41.713736] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-02T17:28:41.713863] [INFO ] [MAIN ] Update Progress: 212/2370 symbols completed. BANC took 35.2s. Estimated remaining: 4h 51m 27s. Rate: 7.4 symbols/min [2025-10-02T17:28:41.838290] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T17:28:41.858026] [INFO ] [REMOTE ] BAM: Full fetch complete (74336 records). [2025-10-02T17:28:41.868514] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-02T17:28:41.893855] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-10-02T17:28:41.946889] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:42.399066] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-10-02T17:28:42.400823] [DEBUG] [LOCAL ] BAX: Loaded 53493 existing records from primary storage. [2025-10-02T17:28:42.401255] [INFO ] [MAIN ] BAX: Loaded 53493 existing records. [2025-10-02T17:28:42.401085] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-10-02T17:28:42.424222] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-10-02T17:28:42.488671] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-10-02T17:28:42.542863] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T17:28:42.592748] [DEBUG] [LOCAL ] BAM: Trimmed 74336 records to 52385 (keeping 200 days of data) [2025-10-02T17:28:42.633080] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:42.634399] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-02T17:28:42.634455] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-02T17:28:42.636211] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-10-02T17:28:42.636282] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-02T17:28:42.744635] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-02T17:28:43.162026] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:43.386453] [DEBUG] [LOCAL ] BAM: Primary data saved (52385 records). [2025-10-02T17:28:43.386595] [INFO ] [MAIN ] BAM: Full history saved. [2025-10-02T17:28:43.387597] [INFO ] [MAIN ] Update Progress: 213/2370 symbols completed. BAM took 38.5s. Estimated remaining: 4h 50m 14s. Rate: 7.4 symbols/min [2025-10-02T17:28:43.478271] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-10-02T17:28:43.580118] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:43.626126] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T17:28:43.682852] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T17:28:43.707235] [DEBUG] [LOCAL ] BB: Loaded 52930 existing records from primary storage. [2025-10-02T17:28:43.707601] [INFO ] [MAIN ] BB: Loaded 52930 existing records. [2025-10-02T17:28:43.898267] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:43.898499] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-02T17:28:43.898547] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-02T17:28:43.899954] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-02T17:28:43.900020] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-02T17:28:44.275868] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-02T17:28:44.281433] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:45.078093] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-02T17:28:45.101069] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T17:28:45.803911] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T17:28:45.873046] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-10-02T17:28:45.993027] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T17:28:46.673015] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-02T17:28:47.473031] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-02T17:28:47.847668] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-02T17:28:48.050553] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T17:28:48.273044] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-02T17:28:48.663801] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T17:28:49.073012] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-02T17:28:49.788587] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T17:28:49.873011] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-02T17:28:50.300094] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T17:28:50.673047] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-02T17:28:51.358058] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T17:28:51.473043] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-02T17:28:51.966895] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T17:28:51.968593] [INFO ] [REMOTE ] BAP: Full fetch complete (37613 records). [2025-10-02T17:28:51.968731] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-02T17:28:52.278182] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-02T17:28:52.400384] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-02T17:28:52.400463] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-02T17:28:52.400957] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-02T17:28:52.401019] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-02T17:28:52.401865] [DEBUG] [LOCAL ] BAP: Trimmed 37613 records to 26325 (keeping 200 days of data) [2025-10-02T17:28:52.569166] [DEBUG] [LOCAL ] BAP: Primary data saved (26325 records). [2025-10-02T17:28:52.569304] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-02T17:28:52.569402] [INFO ] [MAIN ] Update Progress: 214/2370 symbols completed. BAP took 25.1s. Estimated remaining: 4h 50m 17s. Rate: 7.4 symbols/min [2025-10-02T17:28:52.762205] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:28:52.820794] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-02T17:28:52.821155] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-02T17:28:53.011033] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T17:28:53.053187] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:28:53.053789] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-02T17:28:53.053842] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-02T17:28:53.055241] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-02T17:28:53.055305] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-02T17:28:53.078112] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-02T17:28:53.450777] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:28:53.732618] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T17:28:53.873016] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-10-02T17:28:54.678102] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-02T17:28:54.703418] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:28:55.473060] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-02T17:28:56.145911] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:28:56.273054] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-02T17:28:56.779202] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-10-02T17:28:57.072999] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-02T17:28:57.503949] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-02T17:28:57.873008] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-02T17:28:57.998280] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:28:58.672984] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-02T17:28:59.033875] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T17:28:59.472977] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-02T17:28:59.644133] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T17:29:00.142595] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T17:29:00.273055] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-02T17:29:01.073035] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-02T17:29:01.571405] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T17:29:01.625333] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-02T17:29:01.873013] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-02T17:29:02.672996] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-02T17:29:03.003710] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T17:29:03.114827] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-02T17:29:03.473005] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-02T17:29:04.115924] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T17:29:04.273046] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-02T17:29:05.073009] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-02T17:29:05.635529] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-02T17:29:05.865002] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-02T17:29:05.875601] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-02T17:29:06.672972] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-02T17:29:06.793506] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T17:29:06.812633] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T17:29:06.814106] [INFO ] [REMOTE ] BARK: Full fetch complete (56316 records). [2025-10-02T17:29:06.814262] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-02T17:29:07.248174] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-02T17:29:07.248281] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-02T17:29:07.248997] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-02T17:29:07.249105] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-02T17:29:07.250323] [DEBUG] [LOCAL ] BARK: Trimmed 56316 records to 38304 (keeping 200 days of data) [2025-10-02T17:29:07.473432] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-02T17:29:07.479391] [DEBUG] [LOCAL ] BARK: Primary data saved (38304 records). [2025-10-02T17:29:07.479575] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-02T17:29:07.481067] [INFO ] [MAIN ] Update Progress: 215/2370 symbols completed. BARK took 30.2s. Estimated remaining: 4h 51m 17s. Rate: 7.4 symbols/min [2025-10-02T17:29:07.663712] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:29:07.721622] [DEBUG] [LOCAL ] BBAR: Loaded 41510 existing records from primary storage. [2025-10-02T17:29:07.722459] [INFO ] [MAIN ] BBAR: Loaded 41510 existing records. [2025-10-02T17:29:07.923375] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:29:07.923701] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-02T17:29:07.923772] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-02T17:29:07.925298] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-02T17:29:07.925370] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-02T17:29:08.296137] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-02T17:29:08.331628] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:29:08.366878] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T17:29:09.073008] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-02T17:29:09.872979] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-10-02T17:29:10.140540] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-10-02T17:29:10.381377] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-02T17:29:10.672989] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-02T17:29:10.966257] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T17:29:11.473023] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-02T17:29:11.720221] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T17:29:12.273005] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-02T17:29:12.524403] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T17:29:13.073028] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-02T17:29:13.581828] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-02T17:29:13.660371] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T17:29:13.873007] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-02T17:29:14.669399] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:29:14.680093] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-02T17:29:15.473001] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-02T17:29:16.075940] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-02T17:29:16.272999] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-02T17:29:16.452601] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T17:29:16.529783] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T17:29:17.072987] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-02T17:29:17.873005] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-02T17:29:17.984793] [DEBUG] [REMOTE ] BAX: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-02T17:29:17.985195] [WARN ] [REMOTE ] BAX: No data returned for month 2025-09 [2025-10-02T17:29:17.985307] [FATAL] [REMOTE ] BAX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:29:17.985436] [FATAL] [MAIN ] BAX: Failed to fetch primary data. [2025-10-02T17:29:17.985524] [WARN ] [MAIN ] BAX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:29:17.985621] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-02T17:29:17.985741] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-10-02T17:29:17.985797] [INFO ] [LOCAL ] BAX: Starting deletion of derivative data. [2025-10-02T17:29:17.986229] [DEBUG] [LOCAL ] BAX: Deleted derivative data file. [2025-10-02T17:29:17.986330] [INFO ] [MAIN ] Update Progress: 216/2370 symbols completed. BAX took 36.3s. Estimated remaining: 4h 51m 33s. Rate: 7.4 symbols/min [2025-10-02T17:29:18.177419] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:29:18.230183] [DEBUG] [LOCAL ] BBD: Loaded 53197 existing records from primary storage. [2025-10-02T17:29:18.230543] [INFO ] [MAIN ] BBD: Loaded 53197 existing records. [2025-10-02T17:29:18.433186] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:29:18.433821] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-02T17:29:18.433936] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-02T17:29:18.435704] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-02T17:29:18.435770] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-02T17:29:18.691137] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-02T17:29:18.703270] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-10-02T17:29:18.909817] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T17:29:18.913868] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:29:19.472954] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-10-02T17:29:20.273015] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-02T17:29:20.821142] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-02T17:29:21.072980] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-02T17:29:21.502725] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-02T17:29:21.873044] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-02T17:29:22.429907] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T17:29:22.493385] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-02T17:29:22.673027] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-02T17:29:23.473041] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-02T17:29:23.863720] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-02T17:29:23.866949] [INFO ] [REMOTE ] BB: Full fetch complete (76995 records). [2025-10-02T17:29:23.867170] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-02T17:29:24.282283] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-02T17:29:24.516977] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-02T17:29:24.517122] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-02T17:29:24.524360] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-02T17:29:24.524718] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-02T17:29:24.531410] [DEBUG] [LOCAL ] BB: Trimmed 76995 records to 53320 (keeping 200 days of data) [2025-10-02T17:29:24.921815] [DEBUG] [LOCAL ] BB: Primary data saved (53320 records). [2025-10-02T17:29:24.922002] [INFO ] [MAIN ] BB: Full history saved. [2025-10-02T17:29:24.922231] [INFO ] [MAIN ] Update Progress: 217/2370 symbols completed. BB took 41.5s. Estimated remaining: 4h 51m 13s. Rate: 7.4 symbols/min [2025-10-02T17:29:25.173593] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:29:25.204724] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T17:29:25.215052] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-02T17:29:25.245400] [DEBUG] [LOCAL ] BBDC: Loaded 32973 existing records from primary storage. [2025-10-02T17:29:25.245728] [INFO ] [MAIN ] BBDC: Loaded 32973 existing records. [2025-10-02T17:29:25.443523] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:29:25.443808] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-02T17:29:25.443913] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-02T17:29:25.445022] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-02T17:29:25.445166] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-02T17:29:25.582592] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-10-02T17:29:25.895312] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:29:25.895417] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-02T17:29:25.990477] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T17:29:26.420719] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T17:29:26.673067] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-02T17:29:27.473037] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-02T17:29:27.916692] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T17:29:28.273051] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-02T17:29:28.777492] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-10-02T17:29:29.073124] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-02T17:29:29.075058] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T17:29:29.289981] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T17:29:29.873004] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-02T17:29:30.673010] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-10-02T17:29:31.473010] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-02T17:29:31.524377] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T17:29:31.610061] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.54 seconds). [2025-10-02T17:29:31.612270] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-10-02T17:29:31.612397] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-02T17:29:32.057491] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-02T17:29:32.057767] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-02T17:29:32.058747] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-02T17:29:32.058859] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-02T17:29:32.060595] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 54210 (keeping 200 days of data) [2025-10-02T17:29:32.274048] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-02T17:29:32.325365] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T17:29:32.433448] [DEBUG] [LOCAL ] BBAI: Primary data saved (54210 records). [2025-10-02T17:29:32.433607] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-02T17:29:32.433729] [INFO ] [MAIN ] Update Progress: 218/2370 symbols completed. BBAI took 39.9s. Estimated remaining: 4h 50m 59s. Rate: 7.4 symbols/min [2025-10-02T17:29:32.622365] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:29:32.629316] [DEBUG] [LOCAL ] BBDO: Loaded 4975 existing records from primary storage. [2025-10-02T17:29:32.629559] [INFO ] [MAIN ] BBDO: Loaded 4975 existing records. [2025-10-02T17:29:32.853033] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:29:32.853418] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-02T17:29:32.853496] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-02T17:29:32.853922] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-10-02T17:29:32.853991] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-02T17:29:33.078442] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-02T17:29:33.288214] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:29:33.618881] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-02T17:29:33.768676] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T17:29:33.872995] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-02T17:29:34.483333] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T17:29:34.673033] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-10-02T17:29:35.271212] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-02T17:29:35.472985] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-02T17:29:35.664419] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T17:29:36.273024] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-02T17:29:36.845097] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T17:29:36.847027] [INFO ] [REMOTE ] BBAR: Full fetch complete (60943 records). [2025-10-02T17:29:36.847155] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-02T17:29:36.976569] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-02T17:29:37.083169] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-02T17:29:37.304042] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-02T17:29:37.304138] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-02T17:29:37.304920] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-02T17:29:37.304999] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-02T17:29:37.306583] [DEBUG] [LOCAL ] BBAR: Trimmed 60943 records to 41882 (keeping 200 days of data) [2025-10-02T17:29:37.585532] [DEBUG] [LOCAL ] BBAR: Primary data saved (41882 records). [2025-10-02T17:29:37.585691] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-02T17:29:37.587124] [INFO ] [MAIN ] Update Progress: 219/2370 symbols completed. BBAR took 30.1s. Estimated remaining: 4h 50m 22s. Rate: 7.4 symbols/min [2025-10-02T17:29:37.777546] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:29:37.805079] [DEBUG] [LOCAL ] BBN: Loaded 18077 existing records from primary storage. [2025-10-02T17:29:37.805352] [INFO ] [MAIN ] BBN: Loaded 18077 existing records. [2025-10-02T17:29:37.878206] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-02T17:29:38.006482] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:29:38.006773] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-02T17:29:38.006830] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-02T17:29:38.007461] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-10-02T17:29:38.007525] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-02T17:29:38.407145] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:29:38.530615] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T17:29:38.672987] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-10-02T17:29:38.935682] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T17:29:39.472986] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-02T17:29:39.924530] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T17:29:40.273034] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-02T17:29:41.067215] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-02T17:29:41.072944] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-02T17:29:41.134086] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T17:29:41.873009] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-02T17:29:41.990326] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T17:29:42.473587] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T17:29:42.673040] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-02T17:29:43.473015] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-02T17:29:44.057938] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T17:29:44.193162] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T17:29:44.273003] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-02T17:29:45.072981] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-02T17:29:45.126920] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T17:29:45.873040] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-02T17:29:46.550162] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-02T17:29:46.589122] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T17:29:46.673052] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-02T17:29:47.475585] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-02T17:29:47.477256] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T17:29:48.273001] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-02T17:29:48.445176] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T17:29:48.897314] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-02T17:29:49.073007] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-02T17:29:49.753148] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-02T17:29:49.873039] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-02T17:29:50.673075] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-02T17:29:51.401531] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T17:29:51.472996] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-02T17:29:52.273022] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-02T17:29:52.326554] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T17:29:52.481200] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T17:29:53.072989] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-02T17:29:53.225381] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T17:29:53.873052] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-02T17:29:54.539632] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T17:29:54.673034] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-02T17:29:55.472964] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-02T17:29:55.546766] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T17:29:55.684335] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-02T17:29:56.004843] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T17:29:56.273026] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-02T17:29:57.072986] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-02T17:29:57.504048] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T17:29:57.872982] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-02T17:29:58.038761] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T17:29:58.673024] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-02T17:29:58.975189] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T17:29:59.473008] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-02T17:30:00.052120] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T17:30:00.056883] [INFO ] [REMOTE ] BBD: Full fetch complete (77112 records). [2025-10-02T17:30:00.057025] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-02T17:30:00.288160] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-02T17:30:00.304157] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T17:30:00.540469] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-02T17:30:00.540560] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-02T17:30:00.541527] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-02T17:30:00.541600] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-02T17:30:00.543347] [DEBUG] [LOCAL ] BBD: Trimmed 77112 records to 53587 (keeping 200 days of data) [2025-10-02T17:30:00.895736] [DEBUG] [LOCAL ] BBD: Primary data saved (53587 records). [2025-10-02T17:30:00.896004] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-02T17:30:00.896154] [INFO ] [MAIN ] Update Progress: 220/2370 symbols completed. BBD took 42.9s. Estimated remaining: 4h 52m 42s. Rate: 7.3 symbols/min [2025-10-02T17:30:01.073079] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-02T17:30:01.093571] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:01.094986] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-02T17:30:01.095040] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-02T17:30:01.095162] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-02T17:30:01.095207] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-02T17:30:01.095254] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-02T17:30:01.095356] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-02T17:30:01.534979] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T17:30:01.559323] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:01.873019] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-02T17:30:02.109452] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T17:30:02.110553] [INFO ] [REMOTE ] BBN: Full fetch complete (26529 records). [2025-10-02T17:30:02.110637] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-02T17:30:02.450692] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T17:30:02.468607] [INFO ] [REMOTE ] BBDO: Full fetch complete (7632 records). [2025-10-02T17:30:02.479064] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-02T17:30:02.498474] [FATAL] [VALIDATOR ] BBDO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:30:02.520223] [FATAL] [MAIN ] BBDO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:30:02.556823] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-02T17:30:02.545207] [WARN ] [MAIN ] BBDO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:30:02.556960] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-02T17:30:02.557043] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-02T17:30:02.557157] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-02T17:30:02.557570] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-02T17:30:02.557673] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-02T17:30:02.557758] [INFO ] [LOCAL ] BBDO: Starting deletion of derivative data. [2025-10-02T17:30:02.558228] [DEBUG] [LOCAL ] BBDO: Deleted derivative data file. [2025-10-02T17:30:02.558400] [INFO ] [MAIN ] Update Progress: 221/2370 symbols completed. BBDO took 30.1s. Estimated remaining: 4h 51m 31s. Rate: 7.4 symbols/min [2025-10-02T17:30:02.627960] [DEBUG] [LOCAL ] BBN: Trimmed 26529 records to 18177 (keeping 200 days of data) [2025-10-02T17:30:02.678443] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-10-02T17:30:02.857977] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:02.868037] [DEBUG] [LOCAL ] BBU: Loaded 4720 existing records from primary storage. [2025-10-02T17:30:02.868612] [INFO ] [MAIN ] BBU: Loaded 4720 existing records. [2025-10-02T17:30:03.021682] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:30:03.061300] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-10-02T17:30:03.109426] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:03.109621] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:30:03.110356] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-02T17:30:03.110202] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-02T17:30:03.112376] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-02T17:30:03.113867] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-02T17:30:03.114793] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-02T17:30:03.113487] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:30:03.121200] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-02T17:30:03.139518] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-02T17:30:03.165272] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-02T17:30:03.173835] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-02T17:30:03.191142] [INFO ] [MAIN ] Update Progress: 222/2370 symbols completed. BBT took 2.3s. Estimated remaining: 4h 50m 10s. Rate: 7.4 symbols/min [2025-10-02T17:30:03.479756] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-02T17:30:03.612848] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:03.643213] [DEBUG] [LOCAL ] BBN: Primary data saved (18177 records). [2025-10-02T17:30:03.654402] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-02T17:30:03.677321] [INFO ] [MAIN ] Update Progress: 223/2370 symbols completed. BBN took 26.1s. Estimated remaining: 4h 48m 49s. Rate: 7.4 symbols/min [2025-10-02T17:30:03.873541] [DEBUG] [LOCAL ] BBUC: Loaded 13313 existing records from primary storage. [2025-10-02T17:30:03.867825] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:03.887973] [INFO ] [MAIN ] BBUC: Loaded 13313 existing records. [2025-10-02T17:30:04.106367] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:04.193841] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:04.194116] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-02T17:30:04.194166] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-02T17:30:04.194739] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-02T17:30:04.194808] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-02T17:30:04.275895] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-10-02T17:30:04.530882] [DEBUG] [LOCAL ] BBVA: Loaded 49276 existing records from primary storage. [2025-10-02T17:30:04.550504] [INFO ] [MAIN ] BBVA: Loaded 49276 existing records. [2025-10-02T17:30:04.812851] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:04.878304] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:04.878626] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-02T17:30:04.878714] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-02T17:30:04.880305] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-02T17:30:04.880370] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-02T17:30:05.005986] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T17:30:05.086729] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-02T17:30:05.318223] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T17:30:05.324331] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:05.697160] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T17:30:05.873003] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-10-02T17:30:06.658835] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T17:30:06.672989] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-02T17:30:07.473008] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-02T17:30:07.507246] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T17:30:08.014929] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T17:30:08.273021] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-02T17:30:09.072991] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-10-02T17:30:09.291211] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T17:30:09.292495] [INFO ] [REMOTE ] BBDC: Full fetch complete (48430 records). [2025-10-02T17:30:09.292618] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-02T17:30:09.293331] [FATAL] [VALIDATOR ] BBDC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:30:09.293416] [FATAL] [MAIN ] BBDC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:30:09.293460] [WARN ] [MAIN ] BBDC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:30:09.293528] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-02T17:30:09.293590] [DEBUG] [LOCAL ] BBDC: No primary data file found to delete. [2025-10-02T17:30:09.293626] [INFO ] [LOCAL ] BBDC: Starting deletion of derivative data. [2025-10-02T17:30:09.293927] [DEBUG] [LOCAL ] BBDC: Deleted derivative data file. [2025-10-02T17:30:09.294024] [INFO ] [MAIN ] Update Progress: 224/2370 symbols completed. BBDC took 44.4s. Estimated remaining: 4h 48m 17s. Rate: 7.4 symbols/min [2025-10-02T17:30:09.483992] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:09.515161] [DEBUG] [LOCAL ] BBW: Loaded 26701 existing records from primary storage. [2025-10-02T17:30:09.515514] [INFO ] [MAIN ] BBW: Loaded 26701 existing records. [2025-10-02T17:30:09.718793] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:09.719024] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-02T17:30:09.719079] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-02T17:30:09.720050] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-02T17:30:09.720120] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-02T17:30:09.878157] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-02T17:30:10.130247] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:10.653190] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T17:30:10.688276] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-10-02T17:30:10.692017] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T17:30:11.472977] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-02T17:30:11.709422] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T17:30:12.273003] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-02T17:30:13.072986] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-02T17:30:13.163318] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T17:30:13.203283] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T17:30:13.626472] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-02T17:30:13.872998] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-02T17:30:14.365265] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-02T17:30:14.673000] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-02T17:30:15.472993] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-02T17:30:16.086438] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T17:30:16.273047] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-02T17:30:16.334430] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T17:30:17.073066] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-02T17:30:17.352758] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T17:30:17.873054] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-02T17:30:18.672977] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-02T17:30:18.862994] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T17:30:18.893409] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T17:30:19.473014] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-02T17:30:19.578493] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T17:30:20.273036] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-02T17:30:21.072987] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-02T17:30:21.255400] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T17:30:21.562993] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-02T17:30:21.873052] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-02T17:30:22.460503] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-02T17:30:22.672979] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-02T17:30:23.160391] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (3.69 seconds). [2025-10-02T17:30:23.473037] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-02T17:30:24.052862] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T17:30:24.065083] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T17:30:24.273031] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-02T17:30:25.072988] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-02T17:30:25.687506] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T17:30:25.873049] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-02T17:30:26.634170] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T17:30:26.672996] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-02T17:30:26.792696] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T17:30:27.473002] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-02T17:30:27.540105] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T17:30:28.273053] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-02T17:30:29.002009] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T17:30:29.073048] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-02T17:30:29.872991] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-02T17:30:29.904582] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T17:30:29.975565] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-02T17:30:30.673030] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-02T17:30:30.866617] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-02T17:30:31.473009] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-02T17:30:32.236624] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T17:30:32.273024] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-02T17:30:32.341011] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T17:30:32.819182] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T17:30:32.820186] [INFO ] [REMOTE ] BBUC: Full fetch complete (17976 records). [2025-10-02T17:30:32.820281] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-02T17:30:32.821112] [FATAL] [VALIDATOR ] BBUC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:30:32.821203] [FATAL] [MAIN ] BBUC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:30:32.821247] [WARN ] [MAIN ] BBUC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:30:32.821331] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-02T17:30:32.821415] [DEBUG] [LOCAL ] BBUC: No primary data file found to delete. [2025-10-02T17:30:32.821455] [INFO ] [LOCAL ] BBUC: Starting deletion of derivative data. [2025-10-02T17:30:32.821742] [DEBUG] [LOCAL ] BBUC: Deleted derivative data file. [2025-10-02T17:30:32.821869] [INFO ] [MAIN ] Update Progress: 225/2370 symbols completed. BBUC took 29.6s. Estimated remaining: 4h 50m 37s. Rate: 7.4 symbols/min [2025-10-02T17:30:33.034888] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:33.073478] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-02T17:30:33.090989] [DEBUG] [LOCAL ] BBWI: Loaded 53580 existing records from primary storage. [2025-10-02T17:30:33.091329] [INFO ] [MAIN ] BBWI: Loaded 53580 existing records. [2025-10-02T17:30:33.323239] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:33.323473] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-02T17:30:33.323520] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-02T17:30:33.325057] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-02T17:30:33.325118] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-02T17:30:33.712036] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:33.873028] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-02T17:30:34.220129] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T17:30:34.673038] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-02T17:30:35.473003] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-02T17:30:35.540316] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T17:30:35.873385] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T17:30:36.273048] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-02T17:30:36.400353] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T17:30:36.401229] [INFO ] [REMOTE ] BBU: Full fetch complete (6614 records). [2025-10-02T17:30:36.401326] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-02T17:30:36.401744] [FATAL] [VALIDATOR ] BBU: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:30:36.401866] [FATAL] [MAIN ] BBU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:30:36.401911] [WARN ] [MAIN ] BBU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:30:36.401953] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-02T17:30:36.402102] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-10-02T17:30:36.402156] [INFO ] [LOCAL ] BBU: Starting deletion of derivative data. [2025-10-02T17:30:36.402471] [DEBUG] [LOCAL ] BBU: Deleted derivative data file. [2025-10-02T17:30:36.402578] [INFO ] [MAIN ] Update Progress: 226/2370 symbols completed. BBU took 33.8s. Estimated remaining: 4h 49m 45s. Rate: 7.4 symbols/min [2025-10-02T17:30:36.584186] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:36.651145] [DEBUG] [LOCAL ] BBY: Loaded 53466 existing records from primary storage. [2025-10-02T17:30:36.651547] [INFO ] [MAIN ] BBY: Loaded 53466 existing records. [2025-10-02T17:30:36.842875] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:36.843106] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-02T17:30:36.843156] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-02T17:30:36.844895] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-02T17:30:36.844963] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-02T17:30:37.078146] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-10-02T17:30:37.236318] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:37.873027] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-10-02T17:30:38.088090] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T17:30:38.318141] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T17:30:38.673057] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-02T17:30:39.473020] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-02T17:30:39.807601] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T17:30:39.856372] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:30:40.273009] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-02T17:30:41.072971] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-02T17:30:41.374820] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T17:30:41.444621] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T17:30:41.873028] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-02T17:30:42.376199] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T17:30:42.378250] [INFO ] [REMOTE ] BBVA: Full fetch complete (71606 records). [2025-10-02T17:30:42.378381] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-02T17:30:42.679453] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-02T17:30:42.817104] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-10-02T17:30:42.817208] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-10-02T17:30:42.818199] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-10-02T17:30:42.818287] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-10-02T17:30:42.820172] [DEBUG] [LOCAL ] BBVA: Trimmed 71606 records to 49642 (keeping 200 days of data) [2025-10-02T17:30:43.147074] [DEBUG] [LOCAL ] BBVA: Primary data saved (49642 records). [2025-10-02T17:30:43.147235] [INFO ] [MAIN ] BBVA: Full history saved. [2025-10-02T17:30:43.147328] [INFO ] [MAIN ] Update Progress: 227/2370 symbols completed. BBVA took 39.5s. Estimated remaining: 4h 49m 24s. Rate: 7.4 symbols/min [2025-10-02T17:30:43.339993] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:43.341437] [DEBUG] [LOCAL ] BC: No existing data file found in primary storage. [2025-10-02T17:30:43.341495] [WARN ] [MAIN ] BC: No existing data found, performing full refresh instead. [2025-10-02T17:30:43.341718] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-02T17:30:43.341775] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-02T17:30:43.341820] [DEBUG] [LOCAL ] BC: No primary data file found to delete. [2025-10-02T17:30:43.341863] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-02T17:30:43.485928] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-02T17:30:43.548418] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T17:30:43.799627] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:44.278108] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-10-02T17:30:44.294902] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T17:30:45.000855] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T17:30:45.002361] [INFO ] [REMOTE ] BBW: Full fetch complete (39188 records). [2025-10-02T17:30:45.002440] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-02T17:30:45.078134] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-02T17:30:45.421322] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-02T17:30:45.421459] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-02T17:30:45.421974] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-02T17:30:45.422037] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-02T17:30:45.423015] [DEBUG] [LOCAL ] BBW: Trimmed 39188 records to 26905 (keeping 200 days of data) [2025-10-02T17:30:45.614847] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T17:30:45.635848] [DEBUG] [LOCAL ] BBW: Primary data saved (26905 records). [2025-10-02T17:30:45.635958] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-02T17:30:45.636034] [INFO ] [MAIN ] Update Progress: 228/2370 symbols completed. BBW took 36.3s. Estimated remaining: 4h 48m 23s. Rate: 7.4 symbols/min [2025-10-02T17:30:45.836370] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:30:45.875884] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-02T17:30:45.877712] [DEBUG] [LOCAL ] BCAT: Loaded 34251 existing records from primary storage. [2025-10-02T17:30:45.877968] [INFO ] [MAIN ] BCAT: Loaded 34251 existing records. [2025-10-02T17:30:46.087670] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:30:46.087908] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-02T17:30:46.087962] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-02T17:30:46.089104] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-02T17:30:46.089194] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-02T17:30:46.489936] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:30:46.672969] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-10-02T17:30:47.000288] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T17:30:47.472986] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-02T17:30:47.862516] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-02T17:30:47.902301] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T17:30:48.273005] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-02T17:30:49.073047] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-02T17:30:49.603934] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-02T17:30:49.645329] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T17:30:49.873057] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-02T17:30:50.673006] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-02T17:30:50.892505] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T17:30:51.130384] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T17:30:51.473051] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-02T17:30:52.267815] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:30:52.276796] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-02T17:30:53.079680] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-02T17:30:53.086501] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T17:30:53.873001] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-02T17:30:54.026898] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T17:30:54.193742] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T17:30:54.673039] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-02T17:30:55.473026] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-02T17:30:56.213833] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-02T17:30:56.273003] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-02T17:30:56.434024] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T17:30:57.072985] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-02T17:30:57.189298] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T17:30:57.569726] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T17:30:57.873005] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-02T17:30:58.673039] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-02T17:30:58.704913] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:30:59.472972] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-02T17:30:59.713127] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T17:31:00.272994] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-02T17:31:00.396729] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T17:31:00.724997] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T17:31:01.072995] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-02T17:31:01.873015] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-02T17:31:01.916186] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T17:31:02.672996] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-02T17:31:03.134022] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-02T17:31:03.284969] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:31:03.473015] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-02T17:31:03.928276] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T17:31:04.272998] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-02T17:31:05.072962] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-02T17:31:05.337091] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T17:31:05.431490] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T17:31:05.873000] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-02T17:31:06.673016] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-02T17:31:06.775215] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:31:07.472998] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-02T17:31:07.702915] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T17:31:08.272995] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-02T17:31:08.302569] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T17:31:09.034853] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T17:31:09.037194] [INFO ] [REMOTE ] BBY: Full fetch complete (77238 records). [2025-10-02T17:31:09.037362] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-02T17:31:09.078149] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-02T17:31:09.719411] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-02T17:31:09.719588] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-02T17:31:09.720983] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-02T17:31:09.721094] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-02T17:31:09.723356] [DEBUG] [LOCAL ] BBY: Trimmed 77238 records to 53854 (keeping 200 days of data) [2025-10-02T17:31:09.877463] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-02T17:31:09.949851] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T17:31:10.216140] [DEBUG] [LOCAL ] BBY: Primary data saved (53854 records). [2025-10-02T17:31:10.216318] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-02T17:31:10.216424] [INFO ] [MAIN ] Update Progress: 229/2370 symbols completed. BBY took 33.8s. Estimated remaining: 4h 50m 50s. Rate: 7.4 symbols/min [2025-10-02T17:31:10.432340] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:10.461537] [DEBUG] [LOCAL ] BCC: Loaded 28212 existing records from primary storage. [2025-10-02T17:31:10.461854] [INFO ] [MAIN ] BCC: Loaded 28212 existing records. [2025-10-02T17:31:10.665171] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:10.665429] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-02T17:31:10.665484] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-02T17:31:10.666580] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-02T17:31:10.666676] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-02T17:31:10.702511] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-02T17:31:11.057534] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:11.473004] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-10-02T17:31:11.613236] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-02T17:31:11.691997] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-10-02T17:31:11.832199] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T17:31:12.273029] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-02T17:31:12.377068] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T17:31:13.073066] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-02T17:31:13.608547] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T17:31:13.873012] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-02T17:31:14.073688] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T17:31:14.673044] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-02T17:31:15.473011] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-02T17:31:15.556881] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T17:31:15.560146] [INFO ] [REMOTE ] BBWI: Full fetch complete (77427 records). [2025-10-02T17:31:15.560339] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-02T17:31:16.064590] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:31:16.095388] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-02T17:31:16.095884] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-02T17:31:16.096860] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-02T17:31:16.096994] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-02T17:31:16.098609] [DEBUG] [LOCAL ] BBWI: Trimmed 77427 records to 53970 (keeping 200 days of data) [2025-10-02T17:31:16.293430] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-02T17:31:16.464128] [DEBUG] [LOCAL ] BBWI: Primary data saved (53970 records). [2025-10-02T17:31:16.464281] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-02T17:31:16.464372] [INFO ] [MAIN ] Update Progress: 230/2370 symbols completed. BBWI took 43.6s. Estimated remaining: 4h 50m 24s. Rate: 7.4 symbols/min [2025-10-02T17:31:16.674521] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:16.730148] [DEBUG] [LOCAL ] BCE: Loaded 52287 existing records from primary storage. [2025-10-02T17:31:16.730524] [INFO ] [MAIN ] BCE: Loaded 52287 existing records. [2025-10-02T17:31:16.942285] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:16.942567] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-02T17:31:16.942623] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-02T17:31:16.944691] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-02T17:31:16.944756] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-02T17:31:17.084684] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-02T17:31:17.333454] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T17:31:17.415061] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:17.418590] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T17:31:17.419943] [INFO ] [REMOTE ] BCAT: Full fetch complete (49901 records). [2025-10-02T17:31:17.420040] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-02T17:31:17.420732] [FATAL] [VALIDATOR ] BCAT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:31:17.420824] [FATAL] [MAIN ] BCAT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:31:17.420870] [WARN ] [MAIN ] BCAT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:31:17.420912] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-02T17:31:17.420969] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-10-02T17:31:17.421004] [INFO ] [LOCAL ] BCAT: Starting deletion of derivative data. [2025-10-02T17:31:17.421375] [DEBUG] [LOCAL ] BCAT: Deleted derivative data file. [2025-10-02T17:31:17.421508] [INFO ] [MAIN ] Update Progress: 231/2370 symbols completed. BCAT took 31.8s. Estimated remaining: 4h 49m 9s. Rate: 7.4 symbols/min [2025-10-02T17:31:17.629343] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:17.660103] [DEBUG] [LOCAL ] BCH: Loaded 29569 existing records from primary storage. [2025-10-02T17:31:17.660389] [INFO ] [MAIN ] BCH: Loaded 29569 existing records. [2025-10-02T17:31:17.861469] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:17.861715] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-02T17:31:17.861803] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-02T17:31:17.862723] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-02T17:31:17.862784] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-02T17:31:17.878157] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-10-02T17:31:18.306626] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:18.538899] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T17:31:18.673069] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-02T17:31:19.472963] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-02T17:31:19.729556] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T17:31:20.059364] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T17:31:20.273009] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-02T17:31:21.054570] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T17:31:21.056841] [INFO ] [REMOTE ] BC: Full fetch complete (63761 records). [2025-10-02T17:31:21.057188] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-02T17:31:21.081332] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-10-02T17:31:21.523914] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-02T17:31:21.524033] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-02T17:31:21.524967] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-02T17:31:21.525232] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-02T17:31:21.546867] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T17:31:21.554511] [DEBUG] [LOCAL ] BC: Trimmed 63761 records to 44455 (keeping 200 days of data) [2025-10-02T17:31:21.848117] [DEBUG] [LOCAL ] BC: Primary data saved (44455 records). [2025-10-02T17:31:21.848255] [INFO ] [MAIN ] BC: Full history saved. [2025-10-02T17:31:21.848331] [INFO ] [MAIN ] Update Progress: 232/2370 symbols completed. BC took 38.7s. Estimated remaining: 4h 48m 27s. Rate: 7.4 symbols/min [2025-10-02T17:31:21.883631] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-02T17:31:22.045046] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:22.072256] [DEBUG] [LOCAL ] BCO: Loaded 26080 existing records from primary storage. [2025-10-02T17:31:22.072559] [INFO ] [MAIN ] BCO: Loaded 26080 existing records. [2025-10-02T17:31:22.271722] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T17:31:22.295116] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:22.301794] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-02T17:31:22.301885] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-02T17:31:22.303086] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-02T17:31:22.303149] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-02T17:31:22.683016] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-02T17:31:22.736481] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:23.460047] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T17:31:23.472969] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-02T17:31:23.844867] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T17:31:24.273240] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-10-02T17:31:25.073040] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-02T17:31:25.245693] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T17:31:25.762818] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T17:31:25.872974] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-02T17:31:26.093153] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T17:31:26.672997] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-02T17:31:27.068788] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T17:31:27.473005] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-02T17:31:28.290792] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-02T17:31:28.294586] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T17:31:28.686807] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T17:31:29.072986] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-02T17:31:29.393263] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T17:31:29.873011] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-02T17:31:30.673011] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-02T17:31:31.044426] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T17:31:31.389846] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T17:31:31.473060] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-02T17:31:31.763547] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T17:31:32.273021] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-02T17:31:33.072976] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-02T17:31:33.352407] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T17:31:33.742379] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T17:31:33.873017] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-02T17:31:34.443752] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T17:31:34.673004] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-02T17:31:35.206348] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T17:31:35.473015] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-02T17:31:36.021501] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T17:31:36.273019] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-02T17:31:36.524383] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T17:31:37.073039] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-02T17:31:37.873010] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-02T17:31:38.066717] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T17:31:38.350117] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T17:31:38.673009] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-02T17:31:39.209818] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T17:31:39.473000] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-02T17:31:40.024550] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T17:31:40.273039] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-02T17:31:41.041316] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T17:31:41.073004] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-02T17:31:41.305771] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-02T17:31:41.307745] [INFO ] [REMOTE ] BCC: Full fetch complete (40617 records). [2025-10-02T17:31:41.307840] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-02T17:31:41.753301] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-02T17:31:41.753393] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-02T17:31:41.753916] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-02T17:31:41.753982] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-02T17:31:41.755164] [DEBUG] [LOCAL ] BCC: Trimmed 40617 records to 28408 (keeping 200 days of data) [2025-10-02T17:31:41.873778] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-02T17:31:41.948472] [DEBUG] [LOCAL ] BCC: Primary data saved (28408 records). [2025-10-02T17:31:41.948620] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-02T17:31:41.948749] [INFO ] [MAIN ] Update Progress: 233/2370 symbols completed. BCC took 31.7s. Estimated remaining: 4h 50m 9s. Rate: 7.4 symbols/min [2025-10-02T17:31:42.142103] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:42.142296] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-10-02T17:31:42.142336] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-10-02T17:31:42.142457] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-02T17:31:42.142500] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-02T17:31:42.142543] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-10-02T17:31:42.142577] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-02T17:31:42.582380] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:42.624537] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T17:31:42.672995] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-10-02T17:31:43.131285] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T17:31:43.473025] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-02T17:31:44.272976] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-02T17:31:44.659298] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-02T17:31:45.072996] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-02T17:31:45.092888] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-02T17:31:45.095004] [INFO ] [REMOTE ] BCE: Full fetch complete (76031 records). [2025-10-02T17:31:45.095119] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-02T17:31:45.493437] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T17:31:45.578556] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-10-02T17:31:45.578739] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-10-02T17:31:45.579594] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-10-02T17:31:45.579667] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-10-02T17:31:45.581333] [DEBUG] [LOCAL ] BCE: Trimmed 76031 records to 52641 (keeping 200 days of data) [2025-10-02T17:31:45.888857] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-02T17:31:45.941495] [DEBUG] [LOCAL ] BCE: Primary data saved (52641 records). [2025-10-02T17:31:45.941669] [INFO ] [MAIN ] BCE: Full history saved. [2025-10-02T17:31:45.941776] [INFO ] [MAIN ] Update Progress: 234/2370 symbols completed. BCE took 29.5s. Estimated remaining: 4h 49m 23s. Rate: 7.4 symbols/min [2025-10-02T17:31:46.133386] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:46.165291] [DEBUG] [LOCAL ] BCSF: Loaded 27746 existing records from primary storage. [2025-10-02T17:31:46.165576] [INFO ] [MAIN ] BCSF: Loaded 27746 existing records. [2025-10-02T17:31:46.371809] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:46.372096] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-02T17:31:46.372169] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-02T17:31:46.373251] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-02T17:31:46.373349] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-02T17:31:46.681980] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-02T17:31:46.839205] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:47.201766] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-10-02T17:31:47.363242] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T17:31:47.473048] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-02T17:31:47.690479] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T17:31:48.273007] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-02T17:31:49.073077] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-10-02T17:31:49.260143] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T17:31:49.590751] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T17:31:49.873002] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-02T17:31:50.039205] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T17:31:50.673031] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-02T17:31:51.473066] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-02T17:31:51.629910] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T17:31:51.860297] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-02T17:31:52.272983] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-02T17:31:52.384178] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T17:31:53.073011] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-02T17:31:53.872996] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-02T17:31:54.228298] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T17:31:54.323498] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T17:31:54.653163] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-02T17:31:54.654664] [INFO ] [REMOTE ] BCO: Full fetch complete (36710 records). [2025-10-02T17:31:54.654816] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-02T17:31:54.678324] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-02T17:31:55.090819] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-02T17:31:55.090920] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-02T17:31:55.091413] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-02T17:31:55.091459] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-02T17:31:55.092514] [DEBUG] [LOCAL ] BCO: Trimmed 36710 records to 26183 (keeping 200 days of data) [2025-10-02T17:31:55.276600] [DEBUG] [LOCAL ] BCO: Primary data saved (26183 records). [2025-10-02T17:31:55.276775] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-02T17:31:55.276882] [INFO ] [MAIN ] Update Progress: 235/2370 symbols completed. BCO took 33.4s. Estimated remaining: 4h 49m 26s. Rate: 7.4 symbols/min [2025-10-02T17:31:55.469479] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:55.473056] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-02T17:31:55.495079] [DEBUG] [LOCAL ] BCX: Loaded 21685 existing records from primary storage. [2025-10-02T17:31:55.495370] [INFO ] [MAIN ] BCX: Loaded 21685 existing records. [2025-10-02T17:31:55.699974] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:55.700262] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-02T17:31:55.700328] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-02T17:31:55.701105] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-02T17:31:55.701170] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-02T17:31:55.918546] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T17:31:56.008840] [INFO ] [REMOTE ] BCH: Full fetch complete (40937 records). [2025-10-02T17:31:56.028225] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-02T17:31:56.268389] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:56.273973] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-02T17:31:56.593106] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-02T17:31:56.593196] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-02T17:31:56.593729] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-02T17:31:56.593794] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-02T17:31:56.595049] [DEBUG] [LOCAL ] BCH: Trimmed 40937 records to 29843 (keeping 200 days of data) [2025-10-02T17:31:56.782495] [DEBUG] [LOCAL ] BCH: Primary data saved (29843 records). [2025-10-02T17:31:56.782638] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-02T17:31:56.782782] [INFO ] [MAIN ] Update Progress: 236/2370 symbols completed. BCH took 39.4s. Estimated remaining: 4h 48m 18s. Rate: 7.4 symbols/min [2025-10-02T17:31:56.972037] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:31:56.998059] [DEBUG] [LOCAL ] BDC: Loaded 24616 existing records from primary storage. [2025-10-02T17:31:56.998365] [INFO ] [MAIN ] BDC: Loaded 24616 existing records. [2025-10-02T17:31:57.074481] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-10-02T17:31:57.202988] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:31:57.215339] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-02T17:31:57.215496] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-02T17:31:57.216598] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T17:31:57.222102] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-02T17:31:57.222192] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-02T17:31:57.674255] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:31:57.695862] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-10-02T17:31:57.873005] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-02T17:31:58.352472] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T17:31:58.672996] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-10-02T17:31:59.473170] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-02T17:31:59.755691] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T17:31:59.900950] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T17:32:00.273001] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-02T17:32:00.947173] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T17:32:01.073010] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-02T17:32:01.872974] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-02T17:32:02.315525] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T17:32:02.357769] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-10-02T17:32:02.673003] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-02T17:32:03.101756] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T17:32:03.473013] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-02T17:32:04.272998] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-02T17:32:04.547797] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T17:32:04.922089] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-10-02T17:32:05.072991] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-02T17:32:05.760719] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T17:32:05.873014] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-02T17:32:06.350289] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T17:32:06.672996] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-02T17:32:07.269077] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T17:32:07.472994] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-02T17:32:07.775710] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T17:32:08.273107] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-02T17:32:09.072970] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-02T17:32:09.497408] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T17:32:09.539619] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-02T17:32:09.873037] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-02T17:32:10.553784] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T17:32:10.673034] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-02T17:32:11.275535] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T17:32:11.473056] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-02T17:32:11.531135] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T17:32:12.273050] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-02T17:32:12.746405] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T17:32:13.073002] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-02T17:32:13.872969] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-02T17:32:14.078682] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-02T17:32:14.081614] [INFO ] [REMOTE ] BCS: Full fetch complete (77319 records). [2025-10-02T17:32:14.081807] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-02T17:32:14.547294] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:32:14.547495] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-02T17:32:14.553170] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-02T17:32:14.554560] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-02T17:32:14.554979] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-02T17:32:14.556476] [DEBUG] [LOCAL ] BCS: Trimmed 77319 records to 53841 (keeping 200 days of data) [2025-10-02T17:32:14.672964] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-02T17:32:14.901340] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T17:32:14.934304] [DEBUG] [LOCAL ] BCS: Primary data saved (53841 records). [2025-10-02T17:32:14.934449] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-02T17:32:14.934525] [INFO ] [MAIN ] Update Progress: 237/2370 symbols completed. BCS took 33.0s. Estimated remaining: 4h 49m 40s. Rate: 7.4 symbols/min [2025-10-02T17:32:15.473049] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-02T17:32:15.776030] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T17:32:16.273009] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-02T17:32:16.629893] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T17:32:17.073016] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-02T17:32:17.651749] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T17:32:17.872995] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-02T17:32:18.223316] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T17:32:18.673022] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-02T17:32:18.938340] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T17:32:19.473078] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-02T17:32:19.495382] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T17:32:19.497394] [INFO ] [REMOTE ] BCX: Full fetch complete (34089 records). [2025-10-02T17:32:19.497550] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-02T17:32:20.136871] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-02T17:32:20.136966] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-02T17:32:20.137503] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-02T17:32:20.137600] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-02T17:32:20.139624] [DEBUG] [LOCAL ] BCX: Trimmed 34089 records to 21876 (keeping 200 days of data) [2025-10-02T17:32:20.277759] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-02T17:32:20.286921] [DEBUG] [LOCAL ] BCX: Primary data saved (21876 records). [2025-10-02T17:32:20.287080] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-02T17:32:20.287207] [INFO ] [MAIN ] Update Progress: 238/2370 symbols completed. BCX took 25.0s. Estimated remaining: 4h 49m 7s. Rate: 7.4 symbols/min [2025-10-02T17:32:20.644537] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T17:32:21.073059] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-02T17:32:21.234081] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T17:32:21.872975] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-02T17:32:22.273083] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T17:32:22.673083] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-02T17:32:22.934013] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T17:32:23.472977] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-02T17:32:23.745036] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T17:32:24.273148] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-02T17:32:24.643156] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T17:32:25.073078] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-02T17:32:25.534841] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T17:32:25.536695] [INFO ] [REMOTE ] BCSF: Full fetch complete (38481 records). [2025-10-02T17:32:25.536785] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-02T17:32:25.948217] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-02T17:32:25.948336] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-02T17:32:25.949315] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-02T17:32:25.949383] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-02T17:32:25.956410] [DEBUG] [LOCAL ] BCSF: Trimmed 38481 records to 27982 (keeping 200 days of data) [2025-10-02T17:32:25.956638] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:32:25.959949] [INFO ] [REMOTE ] BDC: Full fetch complete (35732 records). [2025-10-02T17:32:25.960111] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-02T17:32:25.960889] [FATAL] [VALIDATOR ] BDC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:32:25.961009] [FATAL] [MAIN ] BDC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:32:25.961055] [WARN ] [MAIN ] BDC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:32:25.961111] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-02T17:32:25.961227] [DEBUG] [LOCAL ] BDC: No primary data file found to delete. [2025-10-02T17:32:25.961295] [INFO ] [LOCAL ] BDC: Starting deletion of derivative data. [2025-10-02T17:32:25.961770] [DEBUG] [LOCAL ] BDC: Deleted derivative data file. [2025-10-02T17:32:25.961891] [INFO ] [MAIN ] Update Progress: 239/2370 symbols completed. BDC took 29.2s. Estimated remaining: 4h 48m 37s. Rate: 7.4 symbols/min [2025-10-02T17:32:26.161068] [DEBUG] [LOCAL ] BCSF: Primary data saved (27982 records). [2025-10-02T17:32:26.161328] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-02T17:32:26.161460] [INFO ] [MAIN ] Update Progress: 240/2370 symbols completed. BCSF took 40.2s. Estimated remaining: 4h 47m 18s. Rate: 7.4 symbols/min [2025-10-02T17:32:26.893881] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:32:27.087255] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:32:27.089358] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:32:27.122786] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:32:27.172957] [DEBUG] [LOCAL ] BDJ: Loaded 28985 existing records from primary storage. [2025-10-02T17:32:27.173489] [INFO ] [MAIN ] BDJ: Loaded 28985 existing records. [2025-10-02T17:32:27.368485] [DEBUG] [LOCAL ] BDX: Loaded 52388 existing records from primary storage. [2025-10-02T17:32:27.418524] [INFO ] [MAIN ] BDX: Loaded 52388 existing records. [2025-10-02T17:32:27.447718] [DEBUG] [LOCAL ] BE: Loaded 53653 existing records from primary storage. [2025-10-02T17:32:27.446895] [DEBUG] [LOCAL ] BDN: Loaded 47488 existing records from primary storage. [2025-10-02T17:32:27.499164] [INFO ] [MAIN ] BE: Loaded 53653 existing records. [2025-10-02T17:32:27.499049] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:32:27.525420] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-02T17:32:27.525515] [INFO ] [MAIN ] BDN: Loaded 47488 existing records. [2025-10-02T17:32:27.584877] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-02T17:32:27.709803] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-02T17:32:27.813618] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-02T17:32:28.167746] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:32:28.198175] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:32:28.215080] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:32:28.215283] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-02T17:32:28.215527] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-02T17:32:28.215391] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-02T17:32:28.224332] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-02T17:32:28.228279] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-02T17:32:28.228379] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-02T17:32:28.228904] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-02T17:32:28.228629] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-02T17:32:28.234561] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-02T17:32:28.255304] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-02T17:32:28.298225] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-02T17:32:28.318902] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-02T17:32:29.504028] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:32:29.548227] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-10-02T17:32:29.658900] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:32:29.769062] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-10-02T17:32:29.857250] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:32:29.870846] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-10-02T17:32:29.914238] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:32:29.914885] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-10-02T17:32:30.915844] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T17:32:30.922349] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-02T17:32:31.210598] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T17:32:31.221999] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-02T17:32:31.917920] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T17:32:31.943445] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-02T17:32:31.944836] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T17:32:31.953256] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-02T17:32:32.050618] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-10-02T17:32:32.273078] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-02T17:32:32.812994] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:32:32.863930] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T17:32:33.073000] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-02T17:32:33.532106] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:32:33.873002] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-02T17:32:34.232569] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-02T17:32:34.673031] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-02T17:32:34.723622] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T17:32:35.416911] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T17:32:35.473027] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-02T17:32:36.273058] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-02T17:32:36.340780] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T17:32:36.962445] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T17:32:37.073042] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-02T17:32:37.702702] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T17:32:37.873066] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-02T17:32:38.673010] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-02T17:32:39.030636] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T17:32:39.473020] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-02T17:32:39.857297] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T17:32:40.013904] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T17:32:40.272970] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-02T17:32:41.072968] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-02T17:32:41.127201] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T17:32:41.733236] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T17:32:41.873036] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-02T17:32:42.672989] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-02T17:32:43.265920] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-02T17:32:43.473038] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-02T17:32:43.541168] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T17:32:43.625211] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-02T17:32:44.273026] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-02T17:32:45.073176] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-02T17:32:45.205319] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T17:32:45.357271] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T17:32:45.873007] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-02T17:32:46.673014] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-02T17:32:46.894370] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:32:47.425633] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T17:32:47.473003] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-02T17:32:48.272992] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-02T17:32:48.324118] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T17:32:48.798340] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T17:32:49.073082] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-02T17:32:49.872982] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-02T17:32:50.241888] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-02T17:32:50.485106] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T17:32:50.672972] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-02T17:32:50.758285] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T17:32:51.473025] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-02T17:32:52.273026] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-02T17:32:52.825009] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-02T17:32:53.073020] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-02T17:32:53.143553] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T17:32:53.545447] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T17:32:53.873007] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-02T17:32:54.673002] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-02T17:32:55.489337] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-02T17:32:55.492853] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-10-02T17:32:55.583001] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T17:32:56.041411] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T17:32:56.273010] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-02T17:32:56.871847] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T17:32:56.873747] [INFO ] [REMOTE ] BDN: Full fetch complete (69252 records). [2025-10-02T17:32:56.873870] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-02T17:32:57.074513] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-02T17:32:57.318761] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-10-02T17:32:57.318912] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-10-02T17:32:57.319732] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-10-02T17:32:57.319804] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-10-02T17:32:57.321492] [DEBUG] [LOCAL ] BDN: Trimmed 69252 records to 47839 (keeping 200 days of data) [2025-10-02T17:32:57.630981] [DEBUG] [LOCAL ] BDN: Primary data saved (47839 records). [2025-10-02T17:32:57.631128] [INFO ] [MAIN ] BDN: Full history saved. [2025-10-02T17:32:57.631242] [INFO ] [MAIN ] Update Progress: 241/2370 symbols completed. BDN took 31.5s. Estimated remaining: 4h 50m 37s. Rate: 7.3 symbols/min [2025-10-02T17:32:57.821252] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:32:57.821445] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-02T17:32:57.821504] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-02T17:32:57.821703] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-02T17:32:57.821758] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-02T17:32:57.821804] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-02T17:32:57.821837] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-02T17:32:57.877249] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-02T17:32:58.241200] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:32:58.274335] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-02T17:32:58.308044] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T17:32:58.673006] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-10-02T17:32:59.314052] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-02T17:32:59.473000] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-02T17:33:00.273000] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-02T17:33:00.431504] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-10-02T17:33:00.447730] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T17:33:00.450561] [INFO ] [REMOTE ] BDJ: Full fetch complete (42927 records). [2025-10-02T17:33:00.450844] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-02T17:33:00.767148] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-02T17:33:00.933886] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-02T17:33:00.934006] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-02T17:33:00.934707] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-02T17:33:00.934781] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-02T17:33:00.936002] [DEBUG] [LOCAL ] BDJ: Trimmed 42927 records to 29159 (keeping 200 days of data) [2025-10-02T17:33:01.073013] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-02T17:33:01.143533] [DEBUG] [LOCAL ] BDJ: Primary data saved (29159 records). [2025-10-02T17:33:01.143869] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-02T17:33:01.143994] [INFO ] [MAIN ] Update Progress: 242/2370 symbols completed. BDJ took 35.0s. Estimated remaining: 4h 49m 47s. Rate: 7.3 symbols/min [2025-10-02T17:33:01.352944] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:01.418633] [DEBUG] [LOCAL ] BEKE: Loaded 53239 existing records from primary storage. [2025-10-02T17:33:01.419010] [INFO ] [MAIN ] BEKE: Loaded 53239 existing records. [2025-10-02T17:33:01.623555] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:01.623804] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-02T17:33:01.623854] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-02T17:33:01.625546] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-02T17:33:01.625615] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-02T17:33:01.881104] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-02T17:33:02.031092] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:02.281809] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-02T17:33:02.462293] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T17:33:02.466155] [INFO ] [REMOTE ] BDX: Full fetch complete (75744 records). [2025-10-02T17:33:02.466342] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-02T17:33:02.681752] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-10-02T17:33:02.974880] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-02T17:33:02.975212] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-02T17:33:02.976045] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-02T17:33:02.976114] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-02T17:33:02.977604] [DEBUG] [LOCAL ] BDX: Trimmed 75744 records to 52730 (keeping 200 days of data) [2025-10-02T17:33:03.344695] [DEBUG] [LOCAL ] BDX: Primary data saved (52730 records). [2025-10-02T17:33:03.344842] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-02T17:33:03.344928] [INFO ] [MAIN ] Update Progress: 243/2370 symbols completed. BDX took 37.2s. Estimated remaining: 4h 48m 47s. Rate: 7.4 symbols/min [2025-10-02T17:33:03.478175] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-02T17:33:03.550994] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:03.605639] [DEBUG] [LOCAL ] BEN: Loaded 53049 existing records from primary storage. [2025-10-02T17:33:03.606035] [INFO ] [MAIN ] BEN: Loaded 53049 existing records. [2025-10-02T17:33:03.817271] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:03.817544] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-02T17:33:03.817594] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-02T17:33:03.819425] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-02T17:33:03.819490] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-02T17:33:04.230588] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:04.272988] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-10-02T17:33:04.377823] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T17:33:05.073062] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-02T17:33:05.873050] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-02T17:33:05.988494] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-02T17:33:05.990809] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-10-02T17:33:05.990953] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-02T17:33:06.316515] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T17:33:06.503467] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-02T17:33:06.504477] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-02T17:33:06.507754] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-02T17:33:06.506750] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-02T17:33:06.518430] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-02T17:33:06.522088] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 54043 (keeping 200 days of data) [2025-10-02T17:33:06.659262] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T17:33:06.673785] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-02T17:33:06.937743] [DEBUG] [LOCAL ] BE: Primary data saved (54043 records). [2025-10-02T17:33:06.937925] [INFO ] [MAIN ] BE: Full history saved. [2025-10-02T17:33:06.938045] [INFO ] [MAIN ] Update Progress: 244/2370 symbols completed. BE took 40.8s. Estimated remaining: 4h 47m 59s. Rate: 7.4 symbols/min [2025-10-02T17:33:07.139272] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:07.139440] [DEBUG] [LOCAL ] BEP: No existing data file found in primary storage. [2025-10-02T17:33:07.139479] [WARN ] [MAIN ] BEP: No existing data found, performing full refresh instead. [2025-10-02T17:33:07.139594] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-02T17:33:07.139638] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-02T17:33:07.139728] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-10-02T17:33:07.139765] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-02T17:33:07.481622] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-02T17:33:07.565792] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:08.030327] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T17:33:08.092293] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T17:33:08.273038] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-10-02T17:33:09.073041] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-02T17:33:09.810461] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T17:33:09.873041] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-02T17:33:10.330697] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-02T17:33:10.673018] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-02T17:33:10.821169] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T17:33:11.473028] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-02T17:33:12.273038] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-02T17:33:12.667095] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-02T17:33:13.073055] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-02T17:33:13.134966] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T17:33:13.402057] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-02T17:33:13.843881] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T17:33:13.873017] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-02T17:33:14.673065] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-02T17:33:15.472977] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-02T17:33:15.726754] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-02T17:33:15.892787] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-02T17:33:16.272988] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-02T17:33:16.673159] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T17:33:17.073055] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-02T17:33:17.266292] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.19 seconds). [2025-10-02T17:33:17.873010] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-02T17:33:18.271170] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-02T17:33:18.673046] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-02T17:33:19.000953] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-02T17:33:19.403198] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:33:19.473067] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-02T17:33:20.273021] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-02T17:33:20.726090] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T17:33:20.726859] [INFO ] [REMOTE ] BEDU: Full fetch complete (1385 records). [2025-10-02T17:33:20.726935] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-02T17:33:20.727368] [FATAL] [VALIDATOR ] BEDU: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:33:20.727476] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:33:20.727530] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:33:20.727574] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-02T17:33:20.727632] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-02T17:33:20.727709] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-02T17:33:20.727764] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-02T17:33:20.727824] [INFO ] [MAIN ] Update Progress: 245/2370 symbols completed. BEDU took 23.1s. Estimated remaining: 4h 48m 40s. Rate: 7.4 symbols/min [2025-10-02T17:33:20.920694] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:20.968324] [DEBUG] [LOCAL ] BEPC: Loaded 46451 existing records from primary storage. [2025-10-02T17:33:20.968675] [INFO ] [MAIN ] BEPC: Loaded 46451 existing records. [2025-10-02T17:33:21.078102] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-02T17:33:21.173014] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:21.173371] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-02T17:33:21.173449] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-02T17:33:21.184421] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-02T17:33:21.202694] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-02T17:33:21.278611] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T17:33:21.629160] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:21.873014] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-02T17:33:22.673026] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-02T17:33:23.024455] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-02T17:33:23.125672] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T17:33:23.473053] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-02T17:33:24.240057] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T17:33:24.273002] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-02T17:33:25.027790] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T17:33:25.073006] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-02T17:33:25.872981] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-02T17:33:26.064348] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T17:33:26.521720] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:33:26.673016] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-02T17:33:27.472967] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-02T17:33:27.852475] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T17:33:28.202275] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T17:33:28.273042] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-02T17:33:28.966881] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T17:33:29.073017] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-02T17:33:29.873014] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-02T17:33:30.005894] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:33:30.535555] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T17:33:30.537554] [INFO ] [REMOTE ] BEN: Full fetch complete (76886 records). [2025-10-02T17:33:30.537713] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-02T17:33:30.678161] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-10-02T17:33:30.977019] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-02T17:33:30.977107] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-02T17:33:30.977960] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-02T17:33:30.978087] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-02T17:33:30.979628] [DEBUG] [LOCAL ] BEN: Trimmed 76886 records to 53426 (keeping 200 days of data) [2025-10-02T17:33:31.335723] [DEBUG] [LOCAL ] BEN: Primary data saved (53426 records). [2025-10-02T17:33:31.335868] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-02T17:33:31.335953] [INFO ] [MAIN ] Update Progress: 246/2370 symbols completed. BEN took 28.0s. Estimated remaining: 4h 48m 53s. Rate: 7.4 symbols/min [2025-10-02T17:33:31.482605] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-02T17:33:31.555764] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:31.585418] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T17:33:31.601020] [DEBUG] [LOCAL ] BEPH: Loaded 5335 existing records from primary storage. [2025-10-02T17:33:31.601313] [INFO ] [MAIN ] BEPH: Loaded 5335 existing records. [2025-10-02T17:33:31.866191] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:31.866457] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-02T17:33:31.866509] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-02T17:33:31.866913] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-02T17:33:31.866977] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-02T17:33:32.273048] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-02T17:33:32.277869] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:32.314196] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T17:33:33.073002] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-02T17:33:33.145686] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T17:33:33.420737] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T17:33:33.873004] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-02T17:33:34.672986] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-10-02T17:33:34.816865] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T17:33:35.377131] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T17:33:35.472998] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-02T17:33:35.562411] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T17:33:36.273024] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-02T17:33:36.839020] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T17:33:37.073009] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-02T17:33:37.873002] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-02T17:33:38.160734] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T17:33:38.524960] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T17:33:38.673048] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-02T17:33:39.023553] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T17:33:39.025710] [INFO ] [REMOTE ] BEP: Full fetch complete (58339 records). [2025-10-02T17:33:39.025825] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-02T17:33:39.174467] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-02T17:33:39.479549] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-02T17:33:39.481382] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-02T17:33:39.481481] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-02T17:33:39.482283] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-02T17:33:39.482480] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-02T17:33:39.484377] [DEBUG] [LOCAL ] BEP: Trimmed 58339 records to 38963 (keeping 200 days of data) [2025-10-02T17:33:39.735607] [DEBUG] [LOCAL ] BEP: Primary data saved (38963 records). [2025-10-02T17:33:39.735775] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-02T17:33:39.735853] [INFO ] [MAIN ] Update Progress: 247/2370 symbols completed. BEP took 32.8s. Estimated remaining: 4h 48m 47s. Rate: 7.4 symbols/min [2025-10-02T17:33:39.919925] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:39.925994] [DEBUG] [LOCAL ] BEPI: Loaded 3536 existing records from primary storage. [2025-10-02T17:33:39.926210] [INFO ] [MAIN ] BEPI: Loaded 3536 existing records. [2025-10-02T17:33:40.119826] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:40.125023] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-02T17:33:40.125234] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T17:33:40.125511] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-02T17:33:40.128134] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-02T17:33:40.128199] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-02T17:33:40.278160] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-02T17:33:40.546780] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:41.004390] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-02T17:33:41.073053] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-02T17:33:41.704625] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T17:33:41.873038] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-02T17:33:42.672995] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-02T17:33:43.472980] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-02T17:33:43.730331] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T17:33:44.109608] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T17:33:44.273001] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-10-02T17:33:44.404240] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T17:33:44.979244] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T17:33:45.073014] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-02T17:33:45.536489] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T17:33:45.873042] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-02T17:33:46.239167] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-02T17:33:46.673034] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-02T17:33:47.122229] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-02T17:33:47.473015] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-02T17:33:48.273011] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-02T17:33:48.806632] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-02T17:33:49.073020] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-02T17:33:49.208859] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-02T17:33:49.211095] [INFO ] [REMOTE ] BEKE: Full fetch complete (77193 records). [2025-10-02T17:33:49.211245] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-02T17:33:49.649722] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-02T17:33:49.649825] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-02T17:33:49.650680] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-02T17:33:49.650750] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-02T17:33:49.652526] [DEBUG] [LOCAL ] BEKE: Trimmed 77193 records to 53629 (keeping 200 days of data) [2025-10-02T17:33:49.875411] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-02T17:33:49.877254] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T17:33:50.007259] [DEBUG] [LOCAL ] BEKE: Primary data saved (53629 records). [2025-10-02T17:33:50.007431] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-02T17:33:50.007528] [INFO ] [MAIN ] Update Progress: 248/2370 symbols completed. BEKE took 48.9s. Estimated remaining: 4h 48m 57s. Rate: 7.3 symbols/min [2025-10-02T17:33:50.190381] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:50.194973] [DEBUG] [LOCAL ] BEPJ: Loaded 3149 existing records from primary storage. [2025-10-02T17:33:50.195125] [INFO ] [MAIN ] BEPJ: Loaded 3149 existing records. [2025-10-02T17:33:50.385268] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-02T17:33:50.400827] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:50.404263] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-02T17:33:50.404339] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-02T17:33:50.404633] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-02T17:33:50.404737] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-02T17:33:50.678189] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-02T17:33:50.853940] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:51.306350] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-02T17:33:51.473014] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-02T17:33:52.048758] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T17:33:52.272999] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-02T17:33:52.644859] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-02T17:33:53.073007] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-02T17:33:53.450496] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-02T17:33:53.872994] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-02T17:33:54.339349] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T17:33:54.340150] [INFO ] [REMOTE ] BEPI: Full fetch complete (4981 records). [2025-10-02T17:33:54.340223] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-02T17:33:54.685615] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-02T17:33:54.733233] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-02T17:33:54.733315] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-02T17:33:54.733470] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-02T17:33:54.733511] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-02T17:33:54.733925] [DEBUG] [LOCAL ] BEPI: Trimmed 4981 records to 3556 (keeping 200 days of data) [2025-10-02T17:33:54.756195] [DEBUG] [LOCAL ] BEPI: Primary data saved (3556 records). [2025-10-02T17:33:54.756294] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-02T17:33:54.756371] [INFO ] [MAIN ] Update Progress: 249/2370 symbols completed. BEPI took 15.0s. Estimated remaining: 4h 48m 20s. Rate: 7.4 symbols/min [2025-10-02T17:33:54.941996] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:33:54.979332] [DEBUG] [LOCAL ] BFAM: Loaded 33171 existing records from primary storage. [2025-10-02T17:33:54.979695] [INFO ] [MAIN ] BFAM: Loaded 33171 existing records. [2025-10-02T17:33:55.178755] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-02T17:33:55.185187] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:33:55.186942] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-02T17:33:55.187266] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-02T17:33:55.188461] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-02T17:33:55.188523] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-02T17:33:55.478137] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-02T17:33:55.578472] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:33:56.117538] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-02T17:33:56.273009] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-02T17:33:57.073000] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-02T17:33:57.732260] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-02T17:33:57.873005] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-10-02T17:33:58.102209] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T17:33:58.482978] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-02T17:33:58.673036] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-10-02T17:33:59.473132] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-02T17:34:00.084225] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T17:34:00.085470] [INFO ] [REMOTE ] BEPH: Full fetch complete (7705 records). [2025-10-02T17:34:00.085665] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-02T17:34:00.086326] [FATAL] [VALIDATOR ] BEPH: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:34:00.086462] [FATAL] [MAIN ] BEPH: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:34:00.086548] [WARN ] [MAIN ] BEPH: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:34:00.086673] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-02T17:34:00.086802] [DEBUG] [LOCAL ] BEPH: No primary data file found to delete. [2025-10-02T17:34:00.086880] [INFO ] [LOCAL ] BEPH: Starting deletion of derivative data. [2025-10-02T17:34:00.087375] [DEBUG] [LOCAL ] BEPH: Deleted derivative data file. [2025-10-02T17:34:00.087516] [INFO ] [MAIN ] Update Progress: 250/2370 symbols completed. BEPH took 28.8s. Estimated remaining: 4h 47m 48s. Rate: 7.4 symbols/min [2025-10-02T17:34:00.292125] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-02T17:34:00.323563] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:00.347188] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:34:00.394865] [DEBUG] [LOCAL ] BFH: Loaded 41602 existing records from primary storage. [2025-10-02T17:34:00.395164] [INFO ] [MAIN ] BFH: Loaded 41602 existing records. [2025-10-02T17:34:00.599575] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:00.599894] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-02T17:34:00.599979] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-02T17:34:00.601279] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-02T17:34:00.601345] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-02T17:34:01.000937] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:01.072988] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-02T17:34:01.872996] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-02T17:34:01.928352] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T17:34:02.437881] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-02T17:34:02.673048] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-02T17:34:03.137978] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-02T17:34:03.301000] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T17:34:03.473002] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-02T17:34:04.000924] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-02T17:34:04.273054] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-02T17:34:05.073020] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-02T17:34:05.465453] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-02T17:34:05.873021] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-02T17:34:06.520293] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T17:34:06.672978] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-10-02T17:34:06.705033] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T17:34:07.473014] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-02T17:34:08.272974] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-02T17:34:08.507237] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T17:34:08.836344] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:34:08.870780] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-02T17:34:09.073021] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-02T17:34:09.673808] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-02T17:34:09.873034] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-02T17:34:10.673014] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-02T17:34:11.431673] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T17:34:11.473044] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-02T17:34:12.074902] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T17:34:12.273045] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-02T17:34:13.072051] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T17:34:13.083774] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-02T17:34:13.621294] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T17:34:13.696609] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T17:34:13.872998] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-02T17:34:14.673035] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-02T17:34:15.178319] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T17:34:15.180559] [INFO ] [REMOTE ] BEPC: Full fetch complete (68505 records). [2025-10-02T17:34:15.180712] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-10-02T17:34:15.478314] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-02T17:34:15.678753] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-10-02T17:34:15.678912] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-10-02T17:34:15.679747] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-10-02T17:34:15.679821] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-10-02T17:34:15.681408] [DEBUG] [LOCAL ] BEPC: Trimmed 68505 records to 46818 (keeping 200 days of data) [2025-10-02T17:34:15.984756] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T17:34:16.000031] [DEBUG] [LOCAL ] BEPC: Primary data saved (46818 records). [2025-10-02T17:34:16.000184] [INFO ] [MAIN ] BEPC: Full history saved. [2025-10-02T17:34:16.001811] [INFO ] [MAIN ] Update Progress: 251/2370 symbols completed. BEPC took 55.3s. Estimated remaining: 4h 48m 45s. Rate: 7.3 symbols/min [2025-10-02T17:34:16.145707] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T17:34:16.234577] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:16.252128] [DEBUG] [LOCAL ] BFK: Loaded 13896 existing records from primary storage. [2025-10-02T17:34:16.252407] [INFO ] [MAIN ] BFK: Loaded 13896 existing records. [2025-10-02T17:34:16.283145] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-02T17:34:16.489160] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:16.489518] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-02T17:34:16.489579] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-02T17:34:16.490840] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-10-02T17:34:16.490903] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-02T17:34:16.747327] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-02T17:34:16.951102] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:17.073051] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-02T17:34:17.873025] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-10-02T17:34:18.114198] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-02T17:34:18.672978] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-02T17:34:18.940967] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T17:34:19.473042] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-02T17:34:20.081747] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T17:34:20.272979] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-02T17:34:20.339027] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T17:34:21.073039] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-02T17:34:21.670888] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T17:34:21.873026] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-02T17:34:22.544915] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T17:34:22.590230] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T17:34:22.673074] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-02T17:34:23.237157] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T17:34:23.237948] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4492 records). [2025-10-02T17:34:23.238057] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-02T17:34:23.478230] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-02T17:34:23.653089] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-02T17:34:23.653170] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-02T17:34:23.653313] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-02T17:34:23.653354] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-02T17:34:23.653813] [DEBUG] [LOCAL ] BEPJ: Trimmed 4492 records to 3156 (keeping 200 days of data) [2025-10-02T17:34:23.676268] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3156 records). [2025-10-02T17:34:23.676425] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-02T17:34:23.676522] [INFO ] [MAIN ] Update Progress: 252/2370 symbols completed. BEPJ took 33.7s. Estimated remaining: 4h 48m 33s. Rate: 7.3 symbols/min [2025-10-02T17:34:23.877485] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:23.931885] [DEBUG] [LOCAL ] BFLY: Loaded 51781 existing records from primary storage. [2025-10-02T17:34:23.932260] [INFO ] [MAIN ] BFLY: Loaded 51781 existing records. [2025-10-02T17:34:24.133825] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:24.134036] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-02T17:34:24.134088] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-02T17:34:24.135739] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-02T17:34:24.135805] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-02T17:34:24.287438] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-02T17:34:24.548961] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:24.612537] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T17:34:24.614202] [INFO ] [REMOTE ] BFAM: Full fetch complete (46968 records). [2025-10-02T17:34:24.614291] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-02T17:34:25.030810] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-02T17:34:25.030969] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-02T17:34:25.031691] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-02T17:34:25.031795] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-02T17:34:25.033288] [DEBUG] [LOCAL ] BFAM: Trimmed 46968 records to 33413 (keeping 200 days of data) [2025-10-02T17:34:25.086516] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-02T17:34:25.236070] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T17:34:25.264967] [DEBUG] [LOCAL ] BFAM: Primary data saved (33413 records). [2025-10-02T17:34:25.265107] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-02T17:34:25.265202] [INFO ] [MAIN ] Update Progress: 253/2370 symbols completed. BFAM took 30.5s. Estimated remaining: 4h 47m 29s. Rate: 7.4 symbols/min [2025-10-02T17:34:25.452156] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:25.463466] [DEBUG] [LOCAL ] BFS: Loaded 9143 existing records from primary storage. [2025-10-02T17:34:25.463728] [INFO ] [MAIN ] BFS: Loaded 9143 existing records. [2025-10-02T17:34:25.654906] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:25.655156] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-02T17:34:25.655209] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-02T17:34:25.655583] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-02T17:34:25.655683] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-02T17:34:25.881193] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-10-02T17:34:26.058324] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:26.552936] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T17:34:26.672994] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-10-02T17:34:27.472979] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-02T17:34:27.707672] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T17:34:27.725672] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T17:34:28.142970] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-02T17:34:28.273058] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-02T17:34:29.073043] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-02T17:34:29.873012] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-02T17:34:29.908187] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T17:34:30.604860] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T17:34:30.672978] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-02T17:34:30.821743] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T17:34:31.473043] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-02T17:34:32.273017] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-02T17:34:32.392607] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T17:34:32.736917] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T17:34:33.072983] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-02T17:34:33.284670] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T17:34:33.873022] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-02T17:34:34.673007] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-02T17:34:34.737337] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T17:34:35.170446] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T17:34:35.327550] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:34:35.472992] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-02T17:34:36.251970] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T17:34:36.273033] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-02T17:34:36.813628] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T17:34:37.073000] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-02T17:34:37.873000] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-02T17:34:37.953016] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T17:34:38.672989] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-02T17:34:38.751228] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-02T17:34:39.473017] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-02T17:34:40.272986] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-02T17:34:40.315291] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T17:34:40.316979] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:34:41.072969] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-02T17:34:41.315825] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T17:34:41.873009] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-02T17:34:42.241266] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T17:34:42.595111] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T17:34:42.596210] [INFO ] [REMOTE ] BFK: Full fetch complete (19295 records). [2025-10-02T17:34:42.596286] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-02T17:34:42.678121] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-02T17:34:42.997674] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-02T17:34:42.997792] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-02T17:34:42.998171] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-02T17:34:42.998233] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-02T17:34:42.998925] [DEBUG] [LOCAL ] BFK: Trimmed 19295 records to 13980 (keeping 200 days of data) [2025-10-02T17:34:43.085064] [DEBUG] [LOCAL ] BFK: Primary data saved (13980 records). [2025-10-02T17:34:43.085206] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-02T17:34:43.085292] [INFO ] [MAIN ] Update Progress: 254/2370 symbols completed. BFK took 27.1s. Estimated remaining: 4h 48m 42s. Rate: 7.3 symbols/min [2025-10-02T17:34:43.270231] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:43.284633] [DEBUG] [LOCAL ] BFZ: Loaded 12123 existing records from primary storage. [2025-10-02T17:34:43.284930] [INFO ] [MAIN ] BFZ: Loaded 12123 existing records. [2025-10-02T17:34:43.501381] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-02T17:34:43.508678] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:43.510715] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-02T17:34:43.510808] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-02T17:34:43.511294] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-02T17:34:43.511369] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-02T17:34:43.905912] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:44.262399] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:34:44.272972] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-10-02T17:34:44.348979] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T17:34:45.053155] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T17:34:45.072961] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-02T17:34:45.834439] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T17:34:45.872988] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-02T17:34:46.673012] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-02T17:34:47.472983] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-02T17:34:47.508966] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T17:34:48.272998] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-02T17:34:48.317166] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T17:34:48.349278] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T17:34:49.073006] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-02T17:34:49.248095] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T17:34:49.873016] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-02T17:34:49.917050] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T17:34:50.374121] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T17:34:50.672998] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-02T17:34:51.473013] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-02T17:34:51.516295] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T17:34:52.272999] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-02T17:34:52.687696] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T17:34:52.689779] [INFO ] [REMOTE ] BFH: Full fetch complete (59673 records). [2025-10-02T17:34:52.689905] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-02T17:34:53.091633] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-02T17:34:53.125896] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T17:34:53.144624] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-02T17:34:53.147686] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-02T17:34:53.149434] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-02T17:34:53.149509] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-02T17:34:53.150967] [DEBUG] [LOCAL ] BFH: Trimmed 59673 records to 41897 (keeping 200 days of data) [2025-10-02T17:34:53.419926] [DEBUG] [LOCAL ] BFH: Primary data saved (41897 records). [2025-10-02T17:34:53.420056] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-02T17:34:53.420198] [INFO ] [MAIN ] Update Progress: 255/2370 symbols completed. BFH took 53.3s. Estimated remaining: 4h 48m 51s. Rate: 7.3 symbols/min [2025-10-02T17:34:53.612672] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:53.666249] [DEBUG] [LOCAL ] BG: Loaded 50413 existing records from primary storage. [2025-10-02T17:34:53.666623] [INFO ] [MAIN ] BG: Loaded 50413 existing records. [2025-10-02T17:34:53.873072] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-02T17:34:53.901924] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:53.902399] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-02T17:34:53.902551] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-02T17:34:53.911769] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-10-02T17:34:53.913489] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-02T17:34:53.914342] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-02T17:34:54.334405] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:54.673007] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-02T17:34:55.382146] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:34:55.383063] [INFO ] [REMOTE ] BFS: Full fetch complete (12701 records). [2025-10-02T17:34:55.383134] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-02T17:34:55.476246] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-10-02T17:34:55.800396] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-02T17:34:55.800497] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-02T17:34:55.800914] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-02T17:34:55.801025] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-02T17:34:55.813375] [DEBUG] [LOCAL ] BFS: Trimmed 12701 records to 9213 (keeping 200 days of data) [2025-10-02T17:34:55.835625] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T17:34:55.905052] [DEBUG] [LOCAL ] BFS: Primary data saved (9213 records). [2025-10-02T17:34:55.905198] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-02T17:34:55.905322] [INFO ] [MAIN ] Update Progress: 256/2370 symbols completed. BFS took 30.6s. Estimated remaining: 4h 47m 56s. Rate: 7.3 symbols/min [2025-10-02T17:34:56.102057] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:34:56.127366] [DEBUG] [LOCAL ] BGB: Loaded 17523 existing records from primary storage. [2025-10-02T17:34:56.127621] [INFO ] [MAIN ] BGB: Loaded 17523 existing records. [2025-10-02T17:34:56.278134] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-02T17:34:56.359044] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:34:56.359282] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-02T17:34:56.359350] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-02T17:34:56.360129] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-02T17:34:56.360191] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-02T17:34:56.966566] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:34:57.073023] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-02T17:34:57.253366] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T17:34:57.324328] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T17:34:57.873006] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-02T17:34:58.672967] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-02T17:34:58.760072] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T17:34:58.914275] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T17:34:59.472993] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-02T17:34:59.995044] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T17:35:00.095756] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T17:35:00.273041] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-02T17:35:01.073026] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-02T17:35:01.274114] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T17:35:01.873010] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-02T17:35:02.672994] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-10-02T17:35:02.932182] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T17:35:03.222549] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-02T17:35:03.473053] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-02T17:35:03.875858] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-02T17:35:04.273010] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-02T17:35:05.072971] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-02T17:35:05.274235] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:35:05.538111] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T17:35:05.872995] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-02T17:35:05.881220] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T17:35:05.882361] [INFO ] [REMOTE ] BFZ: Full fetch complete (18038 records). [2025-10-02T17:35:05.882437] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-02T17:35:06.284814] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-10-02T17:35:06.284896] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-10-02T17:35:06.285231] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-10-02T17:35:06.285275] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-10-02T17:35:06.285929] [DEBUG] [LOCAL ] BFZ: Trimmed 18038 records to 12227 (keeping 200 days of data) [2025-10-02T17:35:06.374384] [DEBUG] [LOCAL ] BFZ: Primary data saved (12227 records). [2025-10-02T17:35:06.374525] [INFO ] [MAIN ] BFZ: Full history saved. [2025-10-02T17:35:06.374667] [INFO ] [MAIN ] Update Progress: 257/2370 symbols completed. BFZ took 23.3s. Estimated remaining: 4h 48m 7s. Rate: 7.3 symbols/min [2025-10-02T17:35:06.557948] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:06.577766] [DEBUG] [LOCAL ] BGH: Loaded 16856 existing records from primary storage. [2025-10-02T17:35:06.578066] [INFO ] [MAIN ] BGH: Loaded 16856 existing records. [2025-10-02T17:35:06.682442] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-02T17:35:06.771669] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:06.771875] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-02T17:35:06.771922] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-02T17:35:06.772614] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-10-02T17:35:06.772711] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-02T17:35:07.162755] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:07.473004] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-10-02T17:35:07.729401] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T17:35:08.273002] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-02T17:35:08.450049] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T17:35:08.598683] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T17:35:09.073052] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-02T17:35:09.872980] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-02T17:35:10.003184] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T17:35:10.417069] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-02T17:35:10.629223] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T17:35:10.632310] [INFO ] [REMOTE ] BFLY: Full fetch complete (75261 records). [2025-10-02T17:35:10.632534] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-02T17:35:10.682064] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-02T17:35:11.127937] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-02T17:35:11.128055] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-02T17:35:11.128915] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-02T17:35:11.128981] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-02T17:35:11.130527] [DEBUG] [LOCAL ] BFLY: Trimmed 75261 records to 52160 (keeping 200 days of data) [2025-10-02T17:35:11.449192] [DEBUG] [LOCAL ] BFLY: Primary data saved (52160 records). [2025-10-02T17:35:11.449337] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-02T17:35:11.449434] [INFO ] [MAIN ] Update Progress: 258/2370 symbols completed. BFLY took 47.8s. Estimated remaining: 4h 47m 33s. Rate: 7.3 symbols/min [2025-10-02T17:35:11.478098] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-02T17:35:11.648607] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:11.664463] [DEBUG] [LOCAL ] BGR: Loaded 13508 existing records from primary storage. [2025-10-02T17:35:11.664792] [INFO ] [MAIN ] BGR: Loaded 13508 existing records. [2025-10-02T17:35:11.866429] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:11.866900] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-02T17:35:11.866962] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-02T17:35:11.867806] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-02T17:35:11.867873] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-02T17:35:12.252253] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:12.272957] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-10-02T17:35:12.465405] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T17:35:12.507832] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T17:35:12.968229] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-02T17:35:13.073034] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-02T17:35:13.873042] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-02T17:35:13.897553] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T17:35:14.673057] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-02T17:35:15.472984] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-02T17:35:15.624328] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T17:35:15.645500] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T17:35:16.273009] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-02T17:35:16.693667] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T17:35:17.073006] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-02T17:35:17.872967] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-02T17:35:18.092961] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T17:35:18.190503] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T17:35:18.513869] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-02T17:35:18.673015] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-02T17:35:19.473051] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-02T17:35:20.272993] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-02T17:35:20.445057] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T17:35:20.507286] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T17:35:21.072981] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-02T17:35:21.561190] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T17:35:21.873007] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-02T17:35:21.980044] [DEBUG] [REMOTE ] BGR: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-02T17:35:21.980396] [WARN ] [REMOTE ] BGR: No data returned for month 2025-03 [2025-10-02T17:35:21.980507] [FATAL] [REMOTE ] BGR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:35:21.980627] [FATAL] [MAIN ] BGR: Failed to fetch primary data. [2025-10-02T17:35:21.980734] [WARN ] [MAIN ] BGR: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:35:21.980870] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-02T17:35:21.980937] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-10-02T17:35:21.980975] [INFO ] [LOCAL ] BGR: Starting deletion of derivative data. [2025-10-02T17:35:21.981328] [DEBUG] [LOCAL ] BGR: Deleted derivative data file. [2025-10-02T17:35:21.981421] [INFO ] [MAIN ] Update Progress: 259/2370 symbols completed. BGR took 10.5s. Estimated remaining: 4h 47m 44s. Rate: 7.3 symbols/min [2025-10-02T17:35:22.174803] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:22.229140] [DEBUG] [LOCAL ] BGS: Loaded 50455 existing records from primary storage. [2025-10-02T17:35:22.229530] [INFO ] [MAIN ] BGS: Loaded 50455 existing records. [2025-10-02T17:35:22.432852] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:22.433187] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-02T17:35:22.433240] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-02T17:35:22.434572] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-02T17:35:22.434634] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-02T17:35:22.678324] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-02T17:35:22.836433] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:22.866895] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T17:35:23.472997] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-10-02T17:35:23.760584] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T17:35:24.272996] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-02T17:35:25.072991] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-02T17:35:25.342984] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T17:35:25.560314] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T17:35:25.562307] [INFO ] [REMOTE ] BG: Full fetch complete (72801 records). [2025-10-02T17:35:25.562404] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-02T17:35:25.883186] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-02T17:35:25.974313] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T17:35:26.002528] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-02T17:35:26.003236] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-02T17:35:26.004599] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-02T17:35:26.004698] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-02T17:35:26.006328] [DEBUG] [LOCAL ] BG: Trimmed 72801 records to 50788 (keeping 200 days of data) [2025-10-02T17:35:26.335728] [DEBUG] [LOCAL ] BG: Primary data saved (50788 records). [2025-10-02T17:35:26.335880] [INFO ] [MAIN ] BG: Full history saved. [2025-10-02T17:35:26.335964] [INFO ] [MAIN ] Update Progress: 260/2370 symbols completed. BG took 32.9s. Estimated remaining: 4h 47m 5s. Rate: 7.3 symbols/min [2025-10-02T17:35:26.527004] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:26.536227] [DEBUG] [LOCAL ] BGSF: Loaded 7403 existing records from primary storage. [2025-10-02T17:35:26.536443] [INFO ] [MAIN ] BGSF: Loaded 7403 existing records. [2025-10-02T17:35:26.678212] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-02T17:35:26.750025] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:26.750227] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-02T17:35:26.750331] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-02T17:35:26.750774] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-02T17:35:26.750838] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-02T17:35:27.171941] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:27.188415] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-02T17:35:27.473046] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-10-02T17:35:27.779927] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T17:35:28.063101] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-02T17:35:28.273000] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-02T17:35:28.630638] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-02T17:35:29.073004] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-02T17:35:29.404487] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T17:35:29.873008] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-02T17:35:30.672981] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-02T17:35:30.814874] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T17:35:31.440677] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T17:35:31.473010] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-02T17:35:32.273012] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-02T17:35:32.670713] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T17:35:32.848290] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-02T17:35:33.073027] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-02T17:35:33.873004] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-02T17:35:34.042185] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T17:35:34.567720] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T17:35:34.569019] [INFO ] [REMOTE ] BGH: Full fetch complete (22455 records). [2025-10-02T17:35:34.569101] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-02T17:35:34.678181] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-10-02T17:35:34.987926] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-02T17:35:34.988036] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-02T17:35:34.988429] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-02T17:35:34.988483] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-02T17:35:34.989250] [DEBUG] [LOCAL ] BGH: Trimmed 22455 records to 17043 (keeping 200 days of data) [2025-10-02T17:35:35.101984] [DEBUG] [LOCAL ] BGH: Primary data saved (17043 records). [2025-10-02T17:35:35.102132] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-02T17:35:35.102215] [INFO ] [MAIN ] Update Progress: 261/2370 symbols completed. BGH took 28.7s. Estimated remaining: 4h 47m 2s. Rate: 7.3 symbols/min [2025-10-02T17:35:35.295007] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:35.314150] [DEBUG] [LOCAL ] BGT: Loaded 16603 existing records from primary storage. [2025-10-02T17:35:35.314466] [INFO ] [MAIN ] BGT: Loaded 16603 existing records. [2025-10-02T17:35:35.416830] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-02T17:35:35.484890] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-02T17:35:35.537943] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:35.538194] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-02T17:35:35.538246] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-02T17:35:35.538893] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-02T17:35:35.538958] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-02T17:35:35.951264] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:36.273022] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-10-02T17:35:36.720575] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T17:35:37.073010] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-02T17:35:37.344004] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-10-02T17:35:37.873042] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-10-02T17:35:38.127359] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T17:35:38.584596] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T17:35:38.673064] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-02T17:35:39.473052] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-10-02T17:35:39.741612] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T17:35:40.273904] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-02T17:35:40.275980] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T17:35:41.073040] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-02T17:35:41.872978] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-10-02T17:35:41.931855] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T17:35:41.991860] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T17:35:42.673013] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-02T17:35:43.472993] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-02T17:35:43.614625] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T17:35:44.273016] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-02T17:35:44.456391] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T17:35:45.072997] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-02T17:35:45.201677] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-02T17:35:45.215297] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (3.34 seconds). [2025-10-02T17:35:45.873059] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-02T17:35:46.045971] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T17:35:46.672989] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-10-02T17:35:47.464294] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T17:35:47.472957] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-10-02T17:35:47.694604] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T17:35:48.273011] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-02T17:35:48.748151] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T17:35:49.073040] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-02T17:35:49.123393] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T17:35:49.125036] [INFO ] [REMOTE ] BGB: Full fetch complete (27013 records). [2025-10-02T17:35:49.125134] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-02T17:35:49.536253] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-10-02T17:35:49.536344] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-10-02T17:35:49.536793] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-10-02T17:35:49.536857] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-10-02T17:35:49.537777] [DEBUG] [LOCAL ] BGB: Trimmed 27013 records to 17717 (keeping 200 days of data) [2025-10-02T17:35:49.659769] [DEBUG] [LOCAL ] BGB: Primary data saved (17717 records). [2025-10-02T17:35:49.659930] [INFO ] [MAIN ] BGB: Full history saved. [2025-10-02T17:35:49.660019] [INFO ] [MAIN ] Update Progress: 262/2370 symbols completed. BGB took 53.8s. Estimated remaining: 4h 47m 45s. Rate: 7.3 symbols/min [2025-10-02T17:35:49.847364] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:49.861799] [DEBUG] [LOCAL ] BGX: Loaded 10935 existing records from primary storage. [2025-10-02T17:35:49.862113] [INFO ] [MAIN ] BGX: Loaded 10935 existing records. [2025-10-02T17:35:49.878266] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-02T17:35:50.067734] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:50.067985] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-02T17:35:50.068074] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-02T17:35:50.068632] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-02T17:35:50.068751] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-02T17:35:50.455064] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:50.673005] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-10-02T17:35:50.863811] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T17:35:51.249210] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T17:35:51.473014] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-10-02T17:35:51.549060] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T17:35:52.273005] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-02T17:35:52.483079] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T17:35:52.484363] [INFO ] [REMOTE ] BGSF: Full fetch complete (8891 records). [2025-10-02T17:35:52.484434] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-10-02T17:35:52.912210] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-10-02T17:35:52.912288] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-10-02T17:35:52.912530] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-10-02T17:35:52.912571] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-10-02T17:35:52.913050] [DEBUG] [LOCAL ] BGSF: Trimmed 8891 records to 7557 (keeping 200 days of data) [2025-10-02T17:35:52.962142] [DEBUG] [LOCAL ] BGSF: Primary data saved (7557 records). [2025-10-02T17:35:52.962345] [INFO ] [MAIN ] BGSF: Full history saved. [2025-10-02T17:35:52.962468] [INFO ] [MAIN ] Update Progress: 263/2370 symbols completed. BGSF took 26.6s. Estimated remaining: 4h 46m 58s. Rate: 7.3 symbols/min [2025-10-02T17:35:53.078166] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-02T17:35:53.171095] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:35:53.194396] [DEBUG] [LOCAL ] BGY: Loaded 22399 existing records from primary storage. [2025-10-02T17:35:53.194788] [INFO ] [MAIN ] BGY: Loaded 22399 existing records. [2025-10-02T17:35:53.393919] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:35:53.394145] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-02T17:35:53.394213] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-02T17:35:53.395119] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-02T17:35:53.395184] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-02T17:35:53.801154] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:35:53.872971] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-10-02T17:35:54.110965] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:35:54.221571] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-02T17:35:54.672997] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-02T17:35:55.040449] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T17:35:55.472990] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-02T17:35:55.845094] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T17:35:56.272984] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-02T17:35:56.585590] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:35:57.072959] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-02T17:35:57.082827] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T17:35:57.872990] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-02T17:35:58.672974] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-02T17:35:58.861838] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T17:35:58.903073] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T17:35:59.472977] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-02T17:35:59.625681] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-02T17:36:00.273006] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-02T17:36:01.073044] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-02T17:36:01.638183] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:36:01.765608] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-02T17:36:01.840089] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T17:36:01.873024] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-02T17:36:02.673014] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-02T17:36:02.855839] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T17:36:03.473023] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-02T17:36:04.011227] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T17:36:04.273007] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-02T17:36:05.073003] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-02T17:36:05.273701] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:36:05.873040] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-02T17:36:05.990903] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-02T17:36:05.991989] [INFO ] [REMOTE ] BGT: Full fetch complete (24329 records). [2025-10-02T17:36:05.992068] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-02T17:36:06.406363] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-02T17:36:06.406480] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-02T17:36:06.407014] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-02T17:36:06.407146] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-02T17:36:06.408283] [DEBUG] [LOCAL ] BGT: Trimmed 24329 records to 16702 (keeping 200 days of data) [2025-10-02T17:36:06.529383] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T17:36:06.570058] [DEBUG] [LOCAL ] BGT: Primary data saved (16702 records). [2025-10-02T17:36:06.570212] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-02T17:36:06.570298] [INFO ] [MAIN ] Update Progress: 264/2370 symbols completed. BGT took 31.5s. Estimated remaining: 4h 47m 33s. Rate: 7.3 symbols/min [2025-10-02T17:36:06.682510] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-02T17:36:06.769521] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:36:06.770142] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T17:36:06.789714] [DEBUG] [LOCAL ] BH: Loaded 15869 existing records from primary storage. [2025-10-02T17:36:06.789966] [INFO ] [MAIN ] BH: Loaded 15869 existing records. [2025-10-02T17:36:06.979326] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:36:06.979584] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-02T17:36:06.979721] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-02T17:36:06.980291] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-10-02T17:36:06.980350] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-02T17:36:07.391159] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:36:07.473027] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-10-02T17:36:07.780131] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T17:36:08.272994] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-02T17:36:08.515165] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T17:36:09.073052] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-02T17:36:09.356873] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-02T17:36:09.531951] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T17:36:09.873067] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-02T17:36:10.672998] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-02T17:36:11.115623] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T17:36:11.320877] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T17:36:11.473065] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-02T17:36:12.273019] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-02T17:36:12.297897] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T17:36:13.072985] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-02T17:36:13.299223] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T17:36:13.580779] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-02T17:36:13.872998] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-02T17:36:14.673050] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-02T17:36:15.047193] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:36:15.260913] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T17:36:15.473058] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-02T17:36:15.980201] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T17:36:16.273049] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-02T17:36:17.073046] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-02T17:36:17.370266] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T17:36:17.873029] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-02T17:36:18.097777] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T17:36:18.626729] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T17:36:18.672985] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-02T17:36:19.473004] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-02T17:36:19.962300] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:36:20.257960] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T17:36:20.273011] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-02T17:36:21.073012] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-02T17:36:21.872995] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-02T17:36:22.090023] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T17:36:22.210967] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T17:36:22.583283] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:36:22.584617] [INFO ] [REMOTE ] BGY: Full fetch complete (33163 records). [2025-10-02T17:36:22.584776] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-02T17:36:22.678178] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-02T17:36:23.005593] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-02T17:36:23.005719] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-02T17:36:23.006234] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-02T17:36:23.006301] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-02T17:36:23.007285] [DEBUG] [LOCAL ] BGY: Trimmed 33163 records to 22528 (keeping 200 days of data) [2025-10-02T17:36:23.141366] [DEBUG] [LOCAL ] BGY: Primary data saved (22528 records). [2025-10-02T17:36:23.141491] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-02T17:36:23.141570] [INFO ] [MAIN ] Update Progress: 265/2370 symbols completed. BGY took 30.2s. Estimated remaining: 4h 48m 31s. Rate: 7.3 symbols/min [2025-10-02T17:36:23.322621] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:36:23.366516] [DEBUG] [LOCAL ] BHC: Loaded 46844 existing records from primary storage. [2025-10-02T17:36:23.366888] [INFO ] [MAIN ] BHC: Loaded 46844 existing records. [2025-10-02T17:36:23.478754] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-02T17:36:23.564462] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:36:23.564709] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-02T17:36:23.564768] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-02T17:36:23.566320] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-02T17:36:23.566388] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-02T17:36:23.904070] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T17:36:23.974634] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:36:24.273028] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-02T17:36:24.806283] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T17:36:24.810028] [INFO ] [REMOTE ] BGS: Full fetch complete (72492 records). [2025-10-02T17:36:24.810165] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-02T17:36:25.081478] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-10-02T17:36:25.130085] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T17:36:25.172126] [INFO ] [REMOTE ] BH: Full fetch complete (19597 records). [2025-10-02T17:36:25.178164] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-02T17:36:25.436950] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-10-02T17:36:25.437176] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-10-02T17:36:25.438802] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-10-02T17:36:25.444704] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-10-02T17:36:25.505738] [DEBUG] [LOCAL ] BGS: Trimmed 72492 records to 50795 (keeping 200 days of data) [2025-10-02T17:36:25.882869] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-02T17:36:25.886374] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-02T17:36:25.890860] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-02T17:36:25.891399] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-02T17:36:25.892109] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-02T17:36:25.896327] [DEBUG] [LOCAL ] BH: Trimmed 19597 records to 15980 (keeping 200 days of data) [2025-10-02T17:36:26.143615] [DEBUG] [LOCAL ] BH: Primary data saved (15980 records). [2025-10-02T17:36:26.144291] [INFO ] [MAIN ] BH: Full history saved. [2025-10-02T17:36:26.144698] [INFO ] [MAIN ] Update Progress: 266/2370 symbols completed. BH took 19.6s. Estimated remaining: 4h 47m 42s. Rate: 7.3 symbols/min [2025-10-02T17:36:26.347113] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:36:26.380859] [DEBUG] [LOCAL ] BHE: Loaded 24657 existing records from primary storage. [2025-10-02T17:36:26.406884] [INFO ] [MAIN ] BHE: Loaded 24657 existing records. [2025-10-02T17:36:26.640477] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:36:26.642676] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-02T17:36:26.643209] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-02T17:36:26.646494] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-10-02T17:36:26.646708] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-02T17:36:26.775106] [DEBUG] [LOCAL ] BGS: Primary data saved (50795 records). [2025-10-02T17:36:26.800896] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T17:36:26.801148] [INFO ] [MAIN ] BGS: Full history saved. [2025-10-02T17:36:26.810318] [INFO ] [MAIN ] Update Progress: 267/2370 symbols completed. BGS took 1m 5s. Estimated remaining: 4h 46m 34s. Rate: 7.3 symbols/min [2025-10-02T17:36:26.822164] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-02T17:36:27.285039] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:36:27.256353] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:36:27.303010] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:36:27.308122] [DEBUG] [LOCAL ] BHK: No existing data file found in primary storage. [2025-10-02T17:36:27.308186] [WARN ] [MAIN ] BHK: No existing data found, performing full refresh instead. [2025-10-02T17:36:27.308298] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-02T17:36:27.308342] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-02T17:36:27.308384] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-10-02T17:36:27.308417] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-02T17:36:27.477929] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-10-02T17:36:27.693209] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:36:28.273019] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-02T17:36:28.493603] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T17:36:28.852182] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T17:36:28.873862] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T17:36:28.875096] [INFO ] [REMOTE ] BGX: Full fetch complete (16208 records). [2025-10-02T17:36:28.875172] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-02T17:36:29.078136] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-10-02T17:36:29.277711] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-02T17:36:29.277816] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-02T17:36:29.278218] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-02T17:36:29.278283] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-02T17:36:29.278990] [DEBUG] [LOCAL ] BGX: Trimmed 16208 records to 11102 (keeping 200 days of data) [2025-10-02T17:36:29.350138] [DEBUG] [LOCAL ] BGX: Primary data saved (11102 records). [2025-10-02T17:36:29.350292] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-02T17:36:29.350387] [INFO ] [MAIN ] Update Progress: 268/2370 symbols completed. BGX took 39.7s. Estimated remaining: 4h 45m 42s. Rate: 7.4 symbols/min [2025-10-02T17:36:29.536700] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:36:29.596107] [DEBUG] [LOCAL ] BHP: Loaded 53373 existing records from primary storage. [2025-10-02T17:36:29.596530] [INFO ] [MAIN ] BHP: Loaded 53373 existing records. [2025-10-02T17:36:29.791192] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:36:29.791451] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-02T17:36:29.791507] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-02T17:36:29.793157] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-02T17:36:29.793221] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-02T17:36:29.878165] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-10-02T17:36:30.180917] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:36:30.672994] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-10-02T17:36:30.787121] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T17:36:31.024295] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T17:36:31.473038] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-10-02T17:36:32.273059] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-02T17:36:32.769225] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-10-02T17:36:33.029352] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T17:36:33.073015] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-02T17:36:33.437251] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T17:36:33.873031] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-02T17:36:34.631556] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T17:36:34.673009] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-02T17:36:34.998187] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T17:36:35.473006] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-02T17:36:35.856146] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T17:36:36.273001] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-02T17:36:37.073000] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-10-02T17:36:37.304983] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-02T17:36:37.669252] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T17:36:37.873027] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-02T17:36:38.673026] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-02T17:36:38.786454] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T17:36:38.968314] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T17:36:39.473047] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-02T17:36:40.168586] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T17:36:40.251016] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T17:36:40.272976] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-02T17:36:41.073000] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-10-02T17:36:41.269905] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-02T17:36:41.873006] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-02T17:36:42.451700] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T17:36:42.672974] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-10-02T17:36:42.990163] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T17:36:43.472995] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-02T17:36:43.917633] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T17:36:44.273012] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-10-02T17:36:45.073020] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-02T17:36:45.660237] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-02T17:36:45.707416] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T17:36:45.873052] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-10-02T17:36:46.228423] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T17:36:46.673011] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-02T17:36:47.469343] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T17:36:47.479478] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-02T17:36:47.725343] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T17:36:48.273020] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-10-02T17:36:49.073028] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-02T17:36:49.496068] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-02T17:36:49.788576] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T17:36:49.872987] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-02T17:36:49.968939] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:36:50.673001] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-10-02T17:36:51.473002] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-02T17:36:51.936595] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-10-02T17:36:52.018039] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T17:36:52.019982] [INFO ] [REMOTE ] BHC: Full fetch complete (66902 records). [2025-10-02T17:36:52.020120] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-10-02T17:36:52.278126] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-02T17:36:52.462826] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-10-02T17:36:52.462982] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-10-02T17:36:52.463816] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-10-02T17:36:52.463891] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-10-02T17:36:52.465392] [DEBUG] [LOCAL ] BHC: Trimmed 66902 records to 47149 (keeping 200 days of data) [2025-10-02T17:36:52.697164] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T17:36:52.772335] [DEBUG] [LOCAL ] BHC: Primary data saved (47149 records). [2025-10-02T17:36:52.772496] [INFO ] [MAIN ] BHC: Full history saved. [2025-10-02T17:36:52.772599] [INFO ] [MAIN ] Update Progress: 269/2370 symbols completed. BHC took 29.6s. Estimated remaining: 4h 47m 33s. Rate: 7.3 symbols/min [2025-10-02T17:36:52.959257] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:36:52.981016] [DEBUG] [LOCAL ] BHR: Loaded 21361 existing records from primary storage. [2025-10-02T17:36:52.981296] [INFO ] [MAIN ] BHR: Loaded 21361 existing records. [2025-10-02T17:36:53.078973] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-02T17:36:53.179591] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:36:53.179836] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-02T17:36:53.179887] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-02T17:36:53.180941] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-02T17:36:53.181010] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-02T17:36:53.592433] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:36:53.873005] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-02T17:36:54.100291] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T17:36:54.482080] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:36:54.673069] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-02T17:36:55.101070] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T17:36:55.473054] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-02T17:36:56.273061] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-02T17:36:56.677168] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T17:36:56.763803] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T17:36:57.073019] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-02T17:36:57.328201] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T17:36:57.873013] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-02T17:36:58.281247] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-02T17:36:58.673062] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-02T17:36:59.473005] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-10-02T17:36:59.500431] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T17:36:59.501819] [INFO ] [REMOTE ] BHK: Full fetch complete (30270 records). [2025-10-02T17:36:59.501944] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-02T17:36:59.928595] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-02T17:36:59.928764] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-02T17:36:59.929284] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-02T17:36:59.929408] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-02T17:36:59.941214] [DEBUG] [LOCAL ] BHK: Trimmed 30270 records to 23155 (keeping 200 days of data) [2025-10-02T17:36:59.963824] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-02T17:37:00.140347] [DEBUG] [LOCAL ] BHK: Primary data saved (23155 records). [2025-10-02T17:37:00.140535] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-02T17:37:00.140667] [INFO ] [MAIN ] Update Progress: 270/2370 symbols completed. BHK took 33.3s. Estimated remaining: 4h 47m 18s. Rate: 7.3 symbols/min [2025-10-02T17:37:00.278124] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-02T17:37:00.340269] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:00.340458] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-02T17:37:00.340513] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-02T17:37:00.340630] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-02T17:37:00.340830] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-02T17:37:00.340950] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-02T17:37:00.341003] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-02T17:37:00.749113] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T17:37:00.840914] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:01.073112] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-10-02T17:37:01.099501] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T17:37:01.101018] [INFO ] [REMOTE ] BHE: Full fetch complete (36502 records). [2025-10-02T17:37:01.101145] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-02T17:37:01.710891] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-02T17:37:01.760573] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-02T17:37:01.760715] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-02T17:37:01.761358] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-02T17:37:01.761419] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-02T17:37:01.762496] [DEBUG] [LOCAL ] BHE: Trimmed 36502 records to 24774 (keeping 200 days of data) [2025-10-02T17:37:01.878856] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-02T17:37:01.960217] [DEBUG] [LOCAL ] BHE: Primary data saved (24774 records). [2025-10-02T17:37:01.960381] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-02T17:37:01.960520] [INFO ] [MAIN ] Update Progress: 271/2370 symbols completed. BHE took 35.8s. Estimated remaining: 4h 46m 20s. Rate: 7.3 symbols/min [2025-10-02T17:37:02.212234] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:02.269338] [DEBUG] [LOCAL ] BHVN: Loaded 49802 existing records from primary storage. [2025-10-02T17:37:02.269781] [INFO ] [MAIN ] BHVN: Loaded 49802 existing records. [2025-10-02T17:37:02.479059] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:37:02.479350] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-02T17:37:02.479412] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-02T17:37:02.481288] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-02T17:37:02.481371] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-02T17:37:02.673008] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-02T17:37:02.897434] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:03.133528] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T17:37:03.473047] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-02T17:37:03.919877] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-02T17:37:04.273026] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-02T17:37:04.655438] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-02T17:37:04.813759] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T17:37:05.073045] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-02T17:37:05.873038] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-10-02T17:37:06.673025] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-02T17:37:06.781092] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-02T17:37:06.783229] [INFO ] [REMOTE ] BHP: Full fetch complete (77248 records). [2025-10-02T17:37:06.783362] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-02T17:37:07.086856] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-02T17:37:07.221847] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-02T17:37:07.221945] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-02T17:37:07.222812] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-02T17:37:07.222881] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-02T17:37:07.224554] [DEBUG] [LOCAL ] BHP: Trimmed 77248 records to 53758 (keeping 200 days of data) [2025-10-02T17:37:07.473112] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-02T17:37:07.604553] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T17:37:07.621598] [DEBUG] [LOCAL ] BHP: Primary data saved (53758 records). [2025-10-02T17:37:07.621770] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-02T17:37:07.621861] [INFO ] [MAIN ] Update Progress: 272/2370 symbols completed. BHP took 38.3s. Estimated remaining: 4h 45m 53s. Rate: 7.3 symbols/min [2025-10-02T17:37:07.806011] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:07.857128] [DEBUG] [LOCAL ] BILL: Loaded 52336 existing records from primary storage. [2025-10-02T17:37:07.857466] [INFO ] [MAIN ] BILL: Loaded 52336 existing records. [2025-10-02T17:37:08.046945] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:37:08.047245] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-02T17:37:08.047304] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-02T17:37:08.048838] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-02T17:37:08.048985] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-02T17:37:08.280222] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-02T17:37:08.451947] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:08.471165] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-02T17:37:08.690674] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-02T17:37:09.073041] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-10-02T17:37:09.873024] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-02T17:37:10.160531] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-02T17:37:10.672993] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-02T17:37:10.937548] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T17:37:11.473042] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-02T17:37:12.124822] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T17:37:12.273027] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-02T17:37:13.072979] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-02T17:37:13.116946] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T17:37:13.416973] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-02T17:37:13.573230] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T17:37:13.873025] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-02T17:37:14.673044] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-02T17:37:15.123185] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T17:37:15.473038] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-02T17:37:16.273007] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-02T17:37:16.644854] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T17:37:16.695681] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-02T17:37:16.894723] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T17:37:17.073015] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-02T17:37:17.873008] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-02T17:37:18.672974] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-02T17:37:18.869830] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T17:37:18.994272] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T17:37:19.107600] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-02T17:37:19.473049] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-02T17:37:19.939179] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T17:37:20.273036] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-02T17:37:21.073010] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-02T17:37:21.496578] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T17:37:21.497296] [INFO ] [REMOTE ] BHV: Full fetch complete (1373 records). [2025-10-02T17:37:21.497369] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-02T17:37:21.703624] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-02T17:37:21.703873] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:37:21.703946] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:37:21.704030] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-02T17:37:21.704149] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-02T17:37:21.704208] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-02T17:37:21.704270] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-02T17:37:21.704359] [INFO ] [MAIN ] Update Progress: 273/2370 symbols completed. BHV took 21.6s. Estimated remaining: 4h 46m 30s. Rate: 7.3 symbols/min [2025-10-02T17:37:21.878184] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-02T17:37:21.908776] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:21.935436] [DEBUG] [LOCAL ] BIO: Loaded 24947 existing records from primary storage. [2025-10-02T17:37:21.935741] [INFO ] [MAIN ] BIO: Loaded 24947 existing records. [2025-10-02T17:37:22.161787] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T17:37:22.185070] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:37:22.185557] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-02T17:37:22.185703] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-02T17:37:22.196554] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-02T17:37:22.196690] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-02T17:37:22.587093] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:22.649763] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T17:37:22.673021] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-02T17:37:23.473028] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-10-02T17:37:24.273008] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-02T17:37:24.560807] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T17:37:24.593335] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T17:37:25.073005] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-02T17:37:25.127292] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-02T17:37:25.872983] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-02T17:37:26.109730] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T17:37:26.673023] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-02T17:37:26.926973] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T17:37:27.473001] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-02T17:37:27.815473] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T17:37:28.273061] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-02T17:37:29.072978] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-02T17:37:29.207612] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T17:37:29.873004] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-02T17:37:30.030939] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T17:37:30.274887] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T17:37:30.673036] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-02T17:37:31.316607] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T17:37:31.473022] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-02T17:37:31.566485] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T17:37:31.567978] [INFO ] [REMOTE ] BHR: Full fetch complete (30803 records). [2025-10-02T17:37:31.568198] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-02T17:37:32.031870] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-10-02T17:37:32.031960] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-10-02T17:37:32.032481] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-10-02T17:37:32.032550] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-10-02T17:37:32.033631] [DEBUG] [LOCAL ] BHR: Trimmed 30803 records to 21586 (keeping 200 days of data) [2025-10-02T17:37:32.171032] [DEBUG] [LOCAL ] BHR: Primary data saved (21586 records). [2025-10-02T17:37:32.171158] [INFO ] [MAIN ] BHR: Full history saved. [2025-10-02T17:37:32.171270] [INFO ] [MAIN ] Update Progress: 274/2370 symbols completed. BHR took 39.4s. Estimated remaining: 4h 46m 39s. Rate: 7.3 symbols/min [2025-10-02T17:37:32.282889] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-02T17:37:32.364070] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:32.409301] [DEBUG] [LOCAL ] BIP: Loaded 39543 existing records from primary storage. [2025-10-02T17:37:32.409622] [INFO ] [MAIN ] BIP: Loaded 39543 existing records. [2025-10-02T17:37:32.605058] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:37:32.605336] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-02T17:37:32.605452] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-02T17:37:32.606821] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-02T17:37:32.606885] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-02T17:37:32.999492] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:33.073038] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-02T17:37:33.233418] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T17:37:33.873021] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-02T17:37:33.954441] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T17:37:34.028218] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-02T17:37:34.673000] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-02T17:37:35.361327] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T17:37:35.473042] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-10-02T17:37:36.099367] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T17:37:36.273030] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-02T17:37:36.645129] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T17:37:37.073113] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-02T17:37:37.873026] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-02T17:37:38.214858] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T17:37:38.249429] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T17:37:38.673021] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-02T17:37:39.472993] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-02T17:37:39.790817] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T17:37:39.979902] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T17:37:40.273034] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-02T17:37:41.058984] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T17:37:41.072989] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-02T17:37:41.534313] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T17:37:41.872992] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-02T17:37:42.458531] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T17:37:42.672983] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-02T17:37:42.831524] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T17:37:43.473025] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-02T17:37:44.272999] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-02T17:37:44.579265] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T17:37:44.607854] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-02T17:37:45.073032] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-02T17:37:45.873023] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-02T17:37:45.994996] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-02T17:37:45.997425] [INFO ] [REMOTE ] BHVN: Full fetch complete (69987 records). [2025-10-02T17:37:45.997546] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-02T17:37:46.433188] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-02T17:37:46.433337] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-02T17:37:46.434453] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-02T17:37:46.434550] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-02T17:37:46.436819] [DEBUG] [LOCAL ] BHVN: Trimmed 69987 records to 50165 (keeping 200 days of data) [2025-10-02T17:37:46.608016] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:37:46.676461] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-02T17:37:46.823960] [DEBUG] [LOCAL ] BHVN: Primary data saved (50165 records). [2025-10-02T17:37:46.824173] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-02T17:37:46.825221] [INFO ] [MAIN ] Update Progress: 275/2370 symbols completed. BHVN took 44.9s. Estimated remaining: 4h 47m 20s. Rate: 7.3 symbols/min [2025-10-02T17:37:47.023372] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:47.023666] [DEBUG] [LOCAL ] BIPC: No existing data file found in primary storage. [2025-10-02T17:37:47.023735] [WARN ] [MAIN ] BIPC: No existing data found, performing full refresh instead. [2025-10-02T17:37:47.023872] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-02T17:37:47.023925] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-02T17:37:47.023971] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-10-02T17:37:47.024007] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-02T17:37:47.408495] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:47.472965] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-10-02T17:37:47.504321] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T17:37:47.994706] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-02T17:37:47.997419] [INFO ] [REMOTE ] BILL: Full fetch complete (75691 records). [2025-10-02T17:37:47.997560] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-02T17:37:48.282868] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-02T17:37:48.443346] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-02T17:37:48.443457] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-02T17:37:48.444362] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-02T17:37:48.444447] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-02T17:37:48.446138] [DEBUG] [LOCAL ] BILL: Trimmed 75691 records to 52726 (keeping 200 days of data) [2025-10-02T17:37:48.777076] [DEBUG] [LOCAL ] BILL: Primary data saved (52726 records). [2025-10-02T17:37:48.777269] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-02T17:37:48.777398] [INFO ] [MAIN ] Update Progress: 276/2370 symbols completed. BILL took 41.2s. Estimated remaining: 4h 46m 24s. Rate: 7.3 symbols/min [2025-10-02T17:37:48.967143] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:37:48.972712] [DEBUG] [LOCAL ] BIPH: Loaded 2578 existing records from primary storage. [2025-10-02T17:37:48.973014] [INFO ] [MAIN ] BIPH: Loaded 2578 existing records. [2025-10-02T17:37:49.075763] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-02T17:37:49.210092] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:37:49.203288] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T17:37:49.210830] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-02T17:37:49.221185] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-02T17:37:49.226539] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-02T17:37:49.226639] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-02T17:37:49.226911] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T17:37:49.303150] [INFO ] [REMOTE ] BIO: Full fetch complete (34226 records). [2025-10-02T17:37:49.316387] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-02T17:37:49.875861] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-02T17:37:50.065165] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-10-02T17:37:50.071874] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-10-02T17:37:50.071791] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:37:50.072699] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-10-02T17:37:50.072798] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-10-02T17:37:50.074099] [DEBUG] [LOCAL ] BIO: Trimmed 34226 records to 25067 (keeping 200 days of data) [2025-10-02T17:37:50.247672] [DEBUG] [LOCAL ] BIO: Primary data saved (25067 records). [2025-10-02T17:37:50.247821] [INFO ] [MAIN ] BIO: Full history saved. [2025-10-02T17:37:50.247911] [INFO ] [MAIN ] Update Progress: 277/2370 symbols completed. BIO took 28.5s. Estimated remaining: 4h 45m 25s. Rate: 7.3 symbols/min [2025-10-02T17:37:50.673023] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-10-02T17:37:50.935034] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T17:37:51.421576] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T17:37:51.423289] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T17:37:51.472988] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-02T17:37:51.871105] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T17:37:52.272998] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-02T17:37:52.762208] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T17:37:53.073075] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-02T17:37:53.655982] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-02T17:37:53.873065] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-02T17:37:54.673025] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-02T17:37:55.072882] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-02T17:37:55.478080] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-02T17:37:55.492264] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T17:37:55.956501] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-02T17:37:56.273034] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-02T17:37:57.073013] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-02T17:37:57.666934] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T17:37:57.873014] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-02T17:37:58.119054] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T17:37:58.307750] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-02T17:37:58.672998] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-02T17:37:59.130759] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-02T17:37:59.473007] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-02T17:38:00.273064] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-02T17:38:01.073007] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-02T17:38:01.304635] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T17:38:01.627783] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T17:38:01.872970] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-02T17:38:01.927009] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T17:38:02.185470] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-02T17:38:02.672995] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-02T17:38:03.095780] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T17:38:03.096536] [INFO ] [REMOTE ] BIPH: Full fetch complete (4296 records). [2025-10-02T17:38:03.096609] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-02T17:38:03.097046] [FATAL] [VALIDATOR ] BIPH: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:38:03.097131] [FATAL] [MAIN ] BIPH: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:38:03.097183] [WARN ] [MAIN ] BIPH: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:38:03.097276] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-02T17:38:03.097389] [DEBUG] [LOCAL ] BIPH: No primary data file found to delete. [2025-10-02T17:38:03.097476] [INFO ] [LOCAL ] BIPH: Starting deletion of derivative data. [2025-10-02T17:38:03.097977] [DEBUG] [LOCAL ] BIPH: Deleted derivative data file. [2025-10-02T17:38:03.098099] [INFO ] [MAIN ] Update Progress: 278/2370 symbols completed. BIPH took 14.3s. Estimated remaining: 4h 45m 52s. Rate: 7.3 symbols/min [2025-10-02T17:38:03.473030] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-02T17:38:04.273034] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-02T17:38:04.969349] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T17:38:05.073016] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-02T17:38:05.889580] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T17:38:05.899592] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-02T17:38:06.544092] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T17:38:06.672976] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-02T17:38:07.475843] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:38:07.485184] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-02T17:38:08.122136] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T17:38:08.273033] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-02T17:38:08.696258] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T17:38:09.073048] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-02T17:38:09.555710] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T17:38:09.557474] [INFO ] [REMOTE ] BIP: Full fetch complete (56929 records). [2025-10-02T17:38:09.557574] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-02T17:38:09.981600] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-02T17:38:09.981711] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-02T17:38:09.982336] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-02T17:38:09.982379] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-02T17:38:09.983560] [DEBUG] [LOCAL ] BIP: Trimmed 56929 records to 39822 (keeping 200 days of data) [2025-10-02T17:38:10.234044] [DEBUG] [LOCAL ] BIP: Primary data saved (39822 records). [2025-10-02T17:38:10.234191] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-02T17:38:10.234275] [INFO ] [MAIN ] Update Progress: 279/2370 symbols completed. BIP took 38.1s. Estimated remaining: 4h 45m 36s. Rate: 7.3 symbols/min [2025-10-02T17:38:10.616947] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T17:38:10.628375] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-02T17:38:11.807281] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:38:11.816684] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-02T17:38:13.485859] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T17:38:13.495169] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-02T17:38:14.737744] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T17:38:14.744344] [INFO ] [REMOTE ] BIPC: Full fetch complete (59899 records). [2025-10-02T17:38:14.745285] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-02T17:38:15.165522] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-10-02T17:38:15.165619] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-10-02T17:38:15.166369] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-10-02T17:38:15.166430] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-10-02T17:38:15.167857] [DEBUG] [LOCAL ] BIPC: Trimmed 59899 records to 41695 (keeping 200 days of data) [2025-10-02T17:38:15.439536] [DEBUG] [LOCAL ] BIPC: Primary data saved (41695 records). [2025-10-02T17:38:15.439693] [INFO ] [MAIN ] BIPC: Full history saved. [2025-10-02T17:38:15.439777] [INFO ] [MAIN ] Update Progress: 280/2370 symbols completed. BIPC took 28.6s. Estimated remaining: 4h 45m 5s. Rate: 7.3 symbols/min [2025-10-02T17:38:16.035945] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:16.162927] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:16.190045] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:16.226120] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:16.229670] [DEBUG] [LOCAL ] BIPJ: Loaded 3132 existing records from primary storage. [2025-10-02T17:38:16.230036] [INFO ] [MAIN ] BIPJ: Loaded 3132 existing records. [2025-10-02T17:38:16.306231] [DEBUG] [LOCAL ] BIPI: Loaded 3202 existing records from primary storage. [2025-10-02T17:38:16.322622] [INFO ] [MAIN ] BIPI: Loaded 3202 existing records. [2025-10-02T17:38:16.538895] [DEBUG] [LOCAL ] BIT: Loaded 22791 existing records from primary storage. [2025-10-02T17:38:16.609495] [INFO ] [MAIN ] BIT: Loaded 22791 existing records. [2025-10-02T17:38:16.609050] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:16.648470] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-02T17:38:16.684145] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-02T17:38:16.797123] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-10-02T17:38:16.791898] [DEBUG] [LOCAL ] BIRK: Loaded 50925 existing records from primary storage. [2025-10-02T17:38:16.818825] [INFO ] [MAIN ] BIRK: Loaded 50925 existing records. [2025-10-02T17:38:16.818632] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-02T17:38:16.908272] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:16.933214] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-02T17:38:16.972778] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-02T17:38:17.036603] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:17.042101] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-02T17:38:17.095778] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-02T17:38:17.106176] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-02T17:38:17.127132] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-02T17:38:17.216720] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-02T17:38:17.330108] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-02T17:38:17.476216] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:17.732408] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-02T17:38:17.790396] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-02T17:38:17.836976] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-02T17:38:17.880310] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-02T17:38:18.247633] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:18.310867] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-10-02T17:38:18.547237] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:18.628961] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:18.624898] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-10-02T17:38:18.653129] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-10-02T17:38:18.796304] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:18.796669] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-10-02T17:38:19.048356] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-02T17:38:19.050156] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-02T17:38:19.394718] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T17:38:19.396934] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-02T17:38:19.534055] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-02T17:38:19.535453] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-02T17:38:19.604070] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T17:38:19.609295] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-02T17:38:19.916366] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T17:38:19.917915] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-02T17:38:20.020842] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T17:38:20.022436] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-02T17:38:20.427827] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-02T17:38:20.429402] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-02T17:38:20.460215] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T17:38:20.586559] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-02T17:38:20.599194] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T17:38:21.073010] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-02T17:38:21.142551] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T17:38:21.758626] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-02T17:38:21.872992] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-02T17:38:22.673006] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-02T17:38:22.974820] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T17:38:23.234108] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T17:38:23.473001] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-02T17:38:24.057827] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T17:38:24.273014] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-02T17:38:24.583764] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-02T17:38:25.073005] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-02T17:38:25.516066] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-02T17:38:25.873014] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-02T17:38:26.672996] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-02T17:38:26.926624] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T17:38:27.137506] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-02T17:38:27.472997] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-02T17:38:28.053267] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T17:38:28.273011] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-02T17:38:29.073012] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-02T17:38:29.741290] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-02T17:38:29.873033] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-02T17:38:29.994832] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T17:38:30.448244] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T17:38:30.673011] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-02T17:38:31.473009] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-02T17:38:31.754264] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T17:38:32.273027] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-02T17:38:32.755258] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T17:38:33.072996] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-02T17:38:33.155761] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T17:38:33.527909] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-02T17:38:33.872986] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-02T17:38:34.673028] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-02T17:38:35.157725] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T17:38:35.158675] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4436 records). [2025-10-02T17:38:35.158763] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-02T17:38:35.475058] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-02T17:38:35.589912] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-02T17:38:35.590047] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-02T17:38:35.590203] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-02T17:38:35.590494] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-02T17:38:35.591269] [DEBUG] [LOCAL ] BIPJ: Trimmed 4436 records to 3136 (keeping 200 days of data) [2025-10-02T17:38:35.613149] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3136 records). [2025-10-02T17:38:35.613301] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-02T17:38:35.613417] [INFO ] [MAIN ] Update Progress: 281/2370 symbols completed. BIPJ took 20.2s. Estimated remaining: 4h 46m 26s. Rate: 7.3 symbols/min [2025-10-02T17:38:35.750706] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T17:38:35.882886] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:35.936928] [DEBUG] [LOCAL ] BJ: Loaded 51373 existing records from primary storage. [2025-10-02T17:38:35.937237] [INFO ] [MAIN ] BJ: Loaded 51373 existing records. [2025-10-02T17:38:36.134972] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:36.135190] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-02T17:38:36.135239] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-02T17:38:36.136941] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-02T17:38:36.137005] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-02T17:38:36.278097] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-02T17:38:36.459976] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T17:38:36.579165] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:36.932840] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T17:38:37.073001] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-02T17:38:37.703827] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-02T17:38:37.873001] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-02T17:38:38.316319] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T17:38:38.317064] [INFO ] [REMOTE ] BIPI: Full fetch complete (5116 records). [2025-10-02T17:38:38.317136] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-02T17:38:38.678152] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-02T17:38:38.712242] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-02T17:38:38.712332] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-02T17:38:38.712500] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-02T17:38:38.712541] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-02T17:38:38.713046] [DEBUG] [LOCAL ] BIPI: Trimmed 5116 records to 3215 (keeping 200 days of data) [2025-10-02T17:38:38.734714] [DEBUG] [LOCAL ] BIPI: Primary data saved (3215 records). [2025-10-02T17:38:38.734830] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-02T17:38:38.734914] [INFO ] [MAIN ] Update Progress: 282/2370 symbols completed. BIPI took 23.3s. Estimated remaining: 4h 45m 40s. Rate: 7.3 symbols/min [2025-10-02T17:38:38.917669] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:38.975072] [DEBUG] [LOCAL ] BK: Loaded 53537 existing records from primary storage. [2025-10-02T17:38:38.975464] [INFO ] [MAIN ] BK: Loaded 53537 existing records. [2025-10-02T17:38:39.175019] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:39.175311] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-02T17:38:39.175403] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-02T17:38:39.177124] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-02T17:38:39.177216] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-02T17:38:39.478678] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-10-02T17:38:39.577792] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:40.273017] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-02T17:38:40.391109] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T17:38:41.073000] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-02T17:38:41.150725] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:38:41.408858] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T17:38:41.873001] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-02T17:38:42.673020] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-02T17:38:42.896290] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:38:43.196818] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T17:38:43.473001] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-02T17:38:43.897946] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T17:38:44.272991] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-10-02T17:38:45.072975] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-02T17:38:45.113418] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T17:38:45.757819] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T17:38:45.873024] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-02T17:38:46.507726] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T17:38:46.673054] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-02T17:38:47.473040] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-02T17:38:47.723045] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T17:38:48.272976] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-02T17:38:48.466663] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T17:38:49.049024] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T17:38:49.072966] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-02T17:38:49.568217] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T17:38:49.873011] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-02T17:38:50.673004] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-02T17:38:50.808067] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T17:38:50.959525] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T17:38:50.961060] [INFO ] [REMOTE ] BIT: Full fetch complete (31781 records). [2025-10-02T17:38:50.961157] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-02T17:38:51.353909] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-10-02T17:38:51.354001] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-10-02T17:38:51.354453] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-10-02T17:38:51.354605] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-10-02T17:38:51.355704] [DEBUG] [LOCAL ] BIT: Trimmed 31781 records to 23002 (keeping 200 days of data) [2025-10-02T17:38:51.473694] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-02T17:38:51.502500] [DEBUG] [LOCAL ] BIT: Primary data saved (23002 records). [2025-10-02T17:38:51.502631] [INFO ] [MAIN ] BIT: Full history saved. [2025-10-02T17:38:51.502784] [INFO ] [MAIN ] Update Progress: 283/2370 symbols completed. BIT took 36.1s. Estimated remaining: 4h 46m 6s. Rate: 7.3 symbols/min [2025-10-02T17:38:51.689732] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:51.736741] [DEBUG] [LOCAL ] BKD: Loaded 50196 existing records from primary storage. [2025-10-02T17:38:51.737193] [INFO ] [MAIN ] BKD: Loaded 50196 existing records. [2025-10-02T17:38:51.950213] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:51.950434] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-02T17:38:51.950484] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-02T17:38:51.951985] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-02T17:38:51.952052] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-02T17:38:52.274225] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-02T17:38:52.397897] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:52.430258] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T17:38:53.073008] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-10-02T17:38:53.168864] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:38:53.873023] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-02T17:38:54.315091] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-02T17:38:54.651444] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T17:38:54.672958] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-02T17:38:55.149844] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T17:38:55.151904] [INFO ] [REMOTE ] BIRK: Full fetch complete (73043 records). [2025-10-02T17:38:55.152019] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-02T17:38:55.481227] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-02T17:38:55.601279] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-02T17:38:55.601375] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-02T17:38:55.602184] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-02T17:38:55.602256] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-02T17:38:55.603995] [DEBUG] [LOCAL ] BIRK: Trimmed 73043 records to 51310 (keeping 200 days of data) [2025-10-02T17:38:55.926638] [DEBUG] [LOCAL ] BIRK: Primary data saved (51310 records). [2025-10-02T17:38:55.926808] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-02T17:38:55.926898] [INFO ] [MAIN ] Update Progress: 284/2370 symbols completed. BIRK took 40.5s. Estimated remaining: 4h 45m 30s. Rate: 7.3 symbols/min [2025-10-02T17:38:56.118126] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:38:56.152282] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T17:38:56.192004] [DEBUG] [LOCAL ] BKE: Loaded 34453 existing records from primary storage. [2025-10-02T17:38:56.192356] [INFO ] [MAIN ] BKE: Loaded 34453 existing records. [2025-10-02T17:38:56.278102] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-02T17:38:56.397420] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:38:56.397712] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-02T17:38:56.397772] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-02T17:38:56.399219] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-02T17:38:56.399310] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-02T17:38:56.812481] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:38:57.079864] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-02T17:38:57.086067] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T17:38:57.873005] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-02T17:38:58.672988] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-10-02T17:38:58.717719] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-02T17:38:58.770926] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T17:38:59.480849] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-02T17:38:59.487615] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T17:39:00.120756] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T17:39:00.273058] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-02T17:39:01.072994] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-02T17:39:01.687099] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-02T17:39:01.873001] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-02T17:39:01.931926] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T17:39:02.673005] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-02T17:39:03.064973] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T17:39:03.343686] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:39:03.473012] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-02T17:39:04.272976] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-02T17:39:04.406314] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T17:39:05.072975] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-02T17:39:05.163824] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T17:39:05.728894] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T17:39:05.872991] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-02T17:39:06.537790] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T17:39:06.673046] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-02T17:39:06.887005] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T17:39:07.473008] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-02T17:39:08.229813] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T17:39:08.272975] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-02T17:39:09.073031] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-02T17:39:09.300853] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T17:39:09.872740] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T17:39:09.876582] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-02T17:39:10.673023] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-02T17:39:10.748535] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T17:39:11.472997] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-02T17:39:11.569513] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T17:39:12.273021] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-02T17:39:12.960639] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T17:39:13.073076] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-02T17:39:13.872993] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-02T17:39:14.201905] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T17:39:14.237013] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T17:39:14.673034] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-02T17:39:15.188296] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T17:39:15.190462] [INFO ] [REMOTE ] BJ: Full fetch complete (73859 records). [2025-10-02T17:39:15.190568] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-02T17:39:15.473749] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-02T17:39:15.626486] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-02T17:39:15.626628] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-02T17:39:15.627782] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-02T17:39:15.628060] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-02T17:39:15.666587] [DEBUG] [LOCAL ] BJ: Trimmed 73859 records to 51762 (keeping 200 days of data) [2025-10-02T17:39:15.671675] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (5.00 seconds). [2025-10-02T17:39:16.024767] [DEBUG] [LOCAL ] BJ: Primary data saved (51762 records). [2025-10-02T17:39:16.024929] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-02T17:39:16.025020] [INFO ] [MAIN ] Update Progress: 285/2370 symbols completed. BJ took 40.4s. Estimated remaining: 4h 46m 48s. Rate: 7.3 symbols/min [2025-10-02T17:39:16.175875] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T17:39:16.265810] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:39:16.273037] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-02T17:39:16.307248] [DEBUG] [LOCAL ] BKH: Loaded 36630 existing records from primary storage. [2025-10-02T17:39:16.307631] [INFO ] [MAIN ] BKH: Loaded 36630 existing records. [2025-10-02T17:39:16.522163] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:39:16.522441] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-02T17:39:16.522494] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-02T17:39:16.524039] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-10-02T17:39:16.524104] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-02T17:39:16.987268] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:39:17.073016] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-02T17:39:17.396678] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T17:39:17.676742] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T17:39:17.873022] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-02T17:39:18.549798] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T17:39:18.673018] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-10-02T17:39:18.963395] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T17:39:19.473046] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-02T17:39:20.112823] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T17:39:20.273046] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-02T17:39:20.537262] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T17:39:21.073034] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-02T17:39:21.648919] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T17:39:21.651021] [INFO ] [REMOTE ] BKD: Full fetch complete (71674 records). [2025-10-02T17:39:21.651146] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-02T17:39:21.878133] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-02T17:39:22.080449] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-02T17:39:22.080549] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-02T17:39:22.081303] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-02T17:39:22.081369] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-02T17:39:22.082855] [DEBUG] [LOCAL ] BKD: Trimmed 71674 records to 50577 (keeping 200 days of data) [2025-10-02T17:39:22.280129] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T17:39:22.310962] [INFO ] [REMOTE ] BKE: Full fetch complete (50179 records). [2025-10-02T17:39:22.312311] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-02T17:39:22.676435] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-02T17:39:22.886631] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-02T17:39:22.892031] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-02T17:39:22.892154] [DEBUG] [LOCAL ] BKD: Primary data saved (50577 records). [2025-10-02T17:39:22.892960] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-02T17:39:22.894216] [INFO ] [MAIN ] Update Progress: 286/2370 symbols completed. BKD took 31.4s. Estimated remaining: 4h 46m 30s. Rate: 7.3 symbols/min [2025-10-02T17:39:22.892863] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-02T17:39:22.894343] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-02T17:39:23.006720] [DEBUG] [LOCAL ] BKE: Trimmed 50179 records to 34657 (keeping 200 days of data) [2025-10-02T17:39:23.177368] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:39:23.324695] [DEBUG] [LOCAL ] BKKT: Loaded 35253 existing records from primary storage. [2025-10-02T17:39:23.330624] [DEBUG] [LOCAL ] BKE: Primary data saved (34657 records). [2025-10-02T17:39:23.330970] [INFO ] [MAIN ] BKKT: Loaded 35253 existing records. [2025-10-02T17:39:23.336230] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-02T17:39:23.364860] [INFO ] [MAIN ] Update Progress: 287/2370 symbols completed. BKE took 27.4s. Estimated remaining: 4h 45m 25s. Rate: 7.3 symbols/min [2025-10-02T17:39:23.687512] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:39:23.698218] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-02T17:39:23.719630] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-02T17:39:23.732357] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-02T17:39:23.734669] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-02T17:39:23.790443] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:39:23.987156] [DEBUG] [LOCAL ] BKN: Loaded 7730 existing records from primary storage. [2025-10-02T17:39:23.998789] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-10-02T17:39:24.032837] [INFO ] [MAIN ] BKN: Loaded 7730 existing records. [2025-10-02T17:39:24.145027] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-02T17:39:24.455938] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:39:24.499472] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:39:24.499842] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-02T17:39:24.500104] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-10-02T17:39:24.501193] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-02T17:39:24.508896] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-02T17:39:24.509122] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-02T17:39:24.608856] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T17:39:24.928548] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:39:25.073019] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-10-02T17:39:25.798675] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-02T17:39:25.801610] [INFO ] [REMOTE ] BK: Full fetch complete (77479 records). [2025-10-02T17:39:25.801858] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-02T17:39:25.878159] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-02T17:39:26.067976] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T17:39:26.266107] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-02T17:39:26.266203] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-02T17:39:26.267170] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-02T17:39:26.267241] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-02T17:39:26.268958] [DEBUG] [LOCAL ] BK: Trimmed 77479 records to 53927 (keeping 200 days of data) [2025-10-02T17:39:26.554589] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T17:39:26.668826] [DEBUG] [LOCAL ] BK: Primary data saved (53927 records). [2025-10-02T17:39:26.668975] [INFO ] [MAIN ] BK: Full history saved. [2025-10-02T17:39:26.669059] [INFO ] [MAIN ] Update Progress: 288/2370 symbols completed. BK took 47.9s. Estimated remaining: 4h 44m 41s. Rate: 7.3 symbols/min [2025-10-02T17:39:26.674463] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-02T17:39:26.880721] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:39:26.932146] [DEBUG] [LOCAL ] BKSY: Loaded 48210 existing records from primary storage. [2025-10-02T17:39:26.932549] [INFO ] [MAIN ] BKSY: Loaded 48210 existing records. [2025-10-02T17:39:27.168134] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T17:39:27.176608] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:39:27.176962] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-02T17:39:27.177044] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-02T17:39:27.179489] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-02T17:39:27.184243] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-02T17:39:27.478258] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-02T17:39:27.614872] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:39:28.272998] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-10-02T17:39:28.292067] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T17:39:28.317014] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T17:39:29.073022] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-02T17:39:29.872975] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-02T17:39:29.887478] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T17:39:29.917690] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T17:39:30.673006] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-02T17:39:31.301959] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-02T17:39:31.403061] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:39:31.473056] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-02T17:39:32.273025] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-02T17:39:32.395515] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T17:39:33.073028] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-02T17:39:33.093394] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T17:39:33.872994] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-02T17:39:34.615088] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T17:39:34.645762] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T17:39:34.672985] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-02T17:39:35.473012] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-02T17:39:36.272964] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-02T17:39:36.391376] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T17:39:36.656786] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-02T17:39:37.072995] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-02T17:39:37.719239] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T17:39:37.872995] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-02T17:39:38.673012] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-02T17:39:39.092575] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-02T17:39:39.233460] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:39:39.433922] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T17:39:39.472994] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-02T17:39:40.090843] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-02T17:39:40.273007] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-02T17:39:40.764420] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-02T17:39:41.072995] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-02T17:39:41.873007] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-02T17:39:42.349891] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T17:39:42.672991] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-02T17:39:43.278962] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T17:39:43.279963] [INFO ] [REMOTE ] BKN: Full fetch complete (11916 records). [2025-10-02T17:39:43.280128] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-02T17:39:43.478252] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-02T17:39:43.686842] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-02T17:39:43.686941] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-02T17:39:43.687225] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-02T17:39:43.687356] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-02T17:39:43.688113] [DEBUG] [LOCAL ] BKN: Trimmed 11916 records to 7808 (keeping 200 days of data) [2025-10-02T17:39:43.752578] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T17:39:43.776333] [DEBUG] [LOCAL ] BKN: Primary data saved (7808 records). [2025-10-02T17:39:43.776466] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-02T17:39:43.776588] [INFO ] [MAIN ] Update Progress: 289/2370 symbols completed. BKN took 20.4s. Estimated remaining: 4h 45m 37s. Rate: 7.3 symbols/min [2025-10-02T17:39:43.973684] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:39:43.992803] [DEBUG] [LOCAL ] BKT: Loaded 11379 existing records from primary storage. [2025-10-02T17:39:43.993132] [INFO ] [MAIN ] BKT: Loaded 11379 existing records. [2025-10-02T17:39:44.198632] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:39:44.198950] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-02T17:39:44.199030] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-02T17:39:44.199883] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-02T17:39:44.199959] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-02T17:39:44.278083] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-02T17:39:44.598744] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:39:44.719242] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T17:39:45.073006] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-02T17:39:45.482521] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-02T17:39:45.873006] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-10-02T17:39:46.099105] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:39:46.461928] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-02T17:39:46.672999] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-02T17:39:47.473047] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-02T17:39:48.144961] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:39:48.273021] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-02T17:39:49.037388] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T17:39:49.072968] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-02T17:39:49.329015] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T17:39:49.873000] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-02T17:39:50.398560] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T17:39:50.673009] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-02T17:39:51.472977] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-02T17:39:51.668577] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T17:39:52.012257] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-02T17:39:52.157500] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T17:39:52.272994] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-02T17:39:53.073043] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-02T17:39:53.872999] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-02T17:39:54.278943] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T17:39:54.280740] [INFO ] [REMOTE ] BKH: Full fetch complete (52393 records). [2025-10-02T17:39:54.280858] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-02T17:39:54.674912] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-02T17:39:54.775878] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-02T17:39:54.792536] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-02T17:39:54.808185] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-02T17:39:54.808361] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-02T17:39:54.810967] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-10-02T17:39:54.823438] [DEBUG] [LOCAL ] BKH: Trimmed 52393 records to 36907 (keeping 200 days of data) [2025-10-02T17:39:55.063999] [DEBUG] [LOCAL ] BKH: Primary data saved (36907 records). [2025-10-02T17:39:55.064147] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-02T17:39:55.064232] [INFO ] [MAIN ] Update Progress: 290/2370 symbols completed. BKH took 39.0s. Estimated remaining: 4h 45m 51s. Rate: 7.3 symbols/min [2025-10-02T17:39:55.257106] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:39:55.303913] [DEBUG] [LOCAL ] BKU: Loaded 41412 existing records from primary storage. [2025-10-02T17:39:55.304237] [INFO ] [MAIN ] BKU: Loaded 41412 existing records. [2025-10-02T17:39:55.484837] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-02T17:39:55.508864] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:39:55.510398] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-02T17:39:55.510557] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-02T17:39:55.512100] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-02T17:39:55.512165] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-02T17:39:55.744865] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T17:39:55.955872] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:39:55.987275] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-02T17:39:56.273078] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-02T17:39:57.073010] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-02T17:39:57.507537] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-02T17:39:57.873006] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-02T17:39:58.002395] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T17:39:58.072815] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:39:58.673033] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-02T17:39:59.350875] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-02T17:39:59.472986] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-02T17:39:59.954619] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-02T17:40:00.218945] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T17:40:00.272976] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-02T17:40:01.073043] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-10-02T17:40:01.243162] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T17:40:01.873020] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-02T17:40:02.663299] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T17:40:02.672975] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-02T17:40:03.459606] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T17:40:03.472958] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-02T17:40:04.081509] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-02T17:40:04.272997] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-02T17:40:04.324825] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T17:40:05.073040] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-02T17:40:05.873052] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-02T17:40:06.148290] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-02T17:40:06.150246] [INFO ] [REMOTE ] BKKT: Full fetch complete (50327 records). [2025-10-02T17:40:06.150342] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-02T17:40:06.573621] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-02T17:40:06.573744] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-02T17:40:06.574368] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-02T17:40:06.574416] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-02T17:40:06.575672] [DEBUG] [LOCAL ] BKKT: Trimmed 50327 records to 35643 (keeping 200 days of data) [2025-10-02T17:40:06.673026] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-02T17:40:06.810103] [DEBUG] [LOCAL ] BKKT: Primary data saved (35643 records). [2025-10-02T17:40:06.810255] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-02T17:40:06.811051] [INFO ] [MAIN ] Update Progress: 291/2370 symbols completed. BKKT took 43.9s. Estimated remaining: 4h 46m 8s. Rate: 7.3 symbols/min [2025-10-02T17:40:06.895929] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T17:40:06.936229] [INFO ] [REMOTE ] BKSY: Full fetch complete (69271 records). [2025-10-02T17:40:06.947284] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-02T17:40:06.969309] [FATAL] [VALIDATOR ] BKSY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:40:07.000064] [FATAL] [MAIN ] BKSY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:40:07.012704] [WARN ] [MAIN ] BKSY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:40:07.047546] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-02T17:40:07.047254] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:07.048438] [DEBUG] [LOCAL ] BKSY: No primary data file found to delete. [2025-10-02T17:40:07.063415] [INFO ] [LOCAL ] BKSY: Starting deletion of derivative data. [2025-10-02T17:40:07.065906] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T17:40:07.072177] [DEBUG] [LOCAL ] BKSY: Deleted derivative data file. [2025-10-02T17:40:07.072916] [INFO ] [MAIN ] Update Progress: 292/2370 symbols completed. BKSY took 40.4s. Estimated remaining: 4h 45m 3s. Rate: 7.3 symbols/min [2025-10-02T17:40:07.267830] [DEBUG] [LOCAL ] BKV: Loaded 29752 existing records from primary storage. [2025-10-02T17:40:07.289188] [INFO ] [MAIN ] BKV: Loaded 29752 existing records. [2025-10-02T17:40:07.363350] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:07.477024] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-02T17:40:07.554034] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:07.554259] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-02T17:40:07.554308] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-02T17:40:07.555249] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-02T17:40:07.555320] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-02T17:40:07.770469] [DEBUG] [LOCAL ] BLCO: Loaded 35433 existing records from primary storage. [2025-10-02T17:40:07.798878] [INFO ] [MAIN ] BLCO: Loaded 35433 existing records. [2025-10-02T17:40:08.144159] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:08.215036] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:08.215418] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-02T17:40:08.215492] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-02T17:40:08.225661] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-02T17:40:08.241102] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-02T17:40:08.242778] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T17:40:08.289281] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-10-02T17:40:08.596822] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T17:40:08.609874] [INFO ] [REMOTE ] BKT: Full fetch complete (15517 records). [2025-10-02T17:40:08.644266] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-02T17:40:08.758386] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:09.081566] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-02T17:40:09.128062] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-02T17:40:09.128165] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-02T17:40:09.128819] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-02T17:40:09.128900] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-02T17:40:09.129722] [DEBUG] [LOCAL ] BKT: Trimmed 15517 records to 11524 (keeping 200 days of data) [2025-10-02T17:40:09.207070] [DEBUG] [LOCAL ] BKT: Primary data saved (11524 records). [2025-10-02T17:40:09.207272] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-02T17:40:09.207432] [INFO ] [MAIN ] Update Progress: 293/2370 symbols completed. BKT took 25.4s. Estimated remaining: 4h 44m 11s. Rate: 7.3 symbols/min [2025-10-02T17:40:09.402549] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:09.431192] [DEBUG] [LOCAL ] BLD: Loaded 27631 existing records from primary storage. [2025-10-02T17:40:09.431463] [INFO ] [MAIN ] BLD: Loaded 27631 existing records. [2025-10-02T17:40:09.625363] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:09.625596] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-02T17:40:09.625693] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-02T17:40:09.626597] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-02T17:40:09.626691] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-02T17:40:09.874293] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-10-02T17:40:09.981435] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T17:40:10.110209] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:10.532435] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T17:40:10.673037] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-02T17:40:11.121063] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T17:40:11.473000] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-10-02T17:40:11.911855] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T17:40:12.273000] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-02T17:40:13.039392] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T17:40:13.072976] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-02T17:40:13.569923] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T17:40:13.873000] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-02T17:40:14.053127] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T17:40:14.673007] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-02T17:40:15.473015] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-02T17:40:15.781833] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T17:40:16.273019] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-02T17:40:16.592239] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-02T17:40:16.831783] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T17:40:17.073013] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-02T17:40:17.722473] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T17:40:17.873004] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-02T17:40:18.681604] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-02T17:40:18.701632] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:40:19.236883] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:40:19.473031] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-02T17:40:19.855429] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T17:40:20.273005] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-02T17:40:20.960215] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T17:40:21.073015] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-02T17:40:21.454736] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T17:40:21.873046] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-02T17:40:22.673027] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-02T17:40:23.346356] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T17:40:23.473004] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-02T17:40:23.906434] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-02T17:40:23.993920] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (2.92 seconds). [2025-10-02T17:40:24.273047] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-02T17:40:25.039999] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T17:40:25.073027] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-02T17:40:25.530524] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T17:40:25.873003] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-02T17:40:26.563598] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T17:40:26.672999] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-02T17:40:27.118802] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T17:40:27.472998] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-02T17:40:27.857294] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:40:28.273009] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-02T17:40:28.770542] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T17:40:29.073047] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-02T17:40:29.824245] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T17:40:29.872984] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-02T17:40:29.972103] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-02T17:40:30.673012] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-02T17:40:31.062678] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T17:40:31.473032] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-02T17:40:31.981000] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T17:40:32.273004] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-02T17:40:32.724959] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T17:40:32.728864] [INFO ] [REMOTE ] BKU: Full fetch complete (59834 records). [2025-10-02T17:40:32.729038] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-02T17:40:33.078113] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-02T17:40:33.171810] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-02T17:40:33.171893] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-02T17:40:33.172518] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-02T17:40:33.172564] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-02T17:40:33.174005] [DEBUG] [LOCAL ] BKU: Trimmed 59834 records to 41707 (keeping 200 days of data) [2025-10-02T17:40:33.437862] [DEBUG] [LOCAL ] BKU: Primary data saved (41707 records). [2025-10-02T17:40:33.438148] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-02T17:40:33.438263] [INFO ] [MAIN ] Update Progress: 294/2370 symbols completed. BKU took 38.4s. Estimated remaining: 4h 45m 56s. Rate: 7.3 symbols/min [2025-10-02T17:40:33.625419] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:33.685406] [DEBUG] [LOCAL ] BLDR: Loaded 51639 existing records from primary storage. [2025-10-02T17:40:33.685990] [INFO ] [MAIN ] BLDR: Loaded 51639 existing records. [2025-10-02T17:40:33.786437] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T17:40:33.878173] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-02T17:40:33.925987] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:33.926297] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-02T17:40:33.926348] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-02T17:40:33.927810] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-02T17:40:33.927873] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-02T17:40:34.324499] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:34.345041] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T17:40:34.673018] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-02T17:40:35.197204] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T17:40:35.472971] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-10-02T17:40:35.720181] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T17:40:36.272997] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-02T17:40:37.072978] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-02T17:40:37.229491] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T17:40:37.413103] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T17:40:37.872977] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-02T17:40:38.056183] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T17:40:38.672999] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-02T17:40:39.377888] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T17:40:39.472991] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-02T17:40:40.272989] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-02T17:40:40.401309] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T17:40:40.401520] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T17:40:40.413251] [INFO ] [REMOTE ] BLD: Full fetch complete (40090 records). [2025-10-02T17:40:40.414189] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-02T17:40:40.415805] [FATAL] [VALIDATOR ] BLD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:40:40.415929] [FATAL] [MAIN ] BLD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:40:40.415977] [WARN ] [MAIN ] BLD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:40:40.416025] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-02T17:40:40.416087] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-10-02T17:40:40.416171] [INFO ] [LOCAL ] BLD: Starting deletion of derivative data. [2025-10-02T17:40:40.416615] [DEBUG] [LOCAL ] BLD: Deleted derivative data file. [2025-10-02T17:40:40.416757] [INFO ] [MAIN ] Update Progress: 295/2370 symbols completed. BLD took 31.2s. Estimated remaining: 4h 45m 39s. Rate: 7.3 symbols/min [2025-10-02T17:40:40.607333] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:40.623309] [DEBUG] [LOCAL ] BLE: Loaded 14294 existing records from primary storage. [2025-10-02T17:40:40.623570] [INFO ] [MAIN ] BLE: Loaded 14294 existing records. [2025-10-02T17:40:40.811421] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:40.811687] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-02T17:40:40.811755] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-02T17:40:40.812294] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-02T17:40:40.812355] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-02T17:40:41.085337] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-02T17:40:41.198262] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T17:40:41.210901] [INFO ] [REMOTE ] BKV: Full fetch complete (44669 records). [2025-10-02T17:40:41.227398] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-02T17:40:41.233395] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:41.234581] [FATAL] [VALIDATOR ] BKV: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:40:41.234759] [FATAL] [MAIN ] BKV: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:40:41.234810] [WARN ] [MAIN ] BKV: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:40:41.234885] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-02T17:40:41.234975] [DEBUG] [LOCAL ] BKV: No primary data file found to delete. [2025-10-02T17:40:41.235035] [INFO ] [LOCAL ] BKV: Starting deletion of derivative data. [2025-10-02T17:40:41.235759] [DEBUG] [LOCAL ] BKV: Deleted derivative data file. [2025-10-02T17:40:41.235871] [INFO ] [MAIN ] Update Progress: 296/2370 symbols completed. BKV took 34.4s. Estimated remaining: 4h 44m 38s. Rate: 7.3 symbols/min [2025-10-02T17:40:41.430856] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:41.468606] [DEBUG] [LOCAL ] BLK: Loaded 34407 existing records from primary storage. [2025-10-02T17:40:41.468935] [INFO ] [MAIN ] BLK: Loaded 34407 existing records. [2025-10-02T17:40:41.665137] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:41.665397] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-02T17:40:41.665454] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-02T17:40:41.666869] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-02T17:40:41.666933] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-02T17:40:41.878122] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-10-02T17:40:42.089619] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:42.482819] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T17:40:42.671493] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T17:40:42.675329] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-02T17:40:43.473002] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-10-02T17:40:43.986752] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T17:40:44.273040] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-02T17:40:45.072986] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-02T17:40:45.319455] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T17:40:45.872962] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-02T17:40:45.990163] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T17:40:46.350398] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T17:40:46.352348] [INFO ] [REMOTE ] BLCO: Full fetch complete (52627 records). [2025-10-02T17:40:46.352507] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-02T17:40:46.678228] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-02T17:40:46.814043] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-02T17:40:46.814136] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-02T17:40:46.814834] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-02T17:40:46.814901] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-02T17:40:46.816869] [DEBUG] [LOCAL ] BLCO: Trimmed 52627 records to 35657 (keeping 200 days of data) [2025-10-02T17:40:47.040517] [DEBUG] [LOCAL ] BLCO: Primary data saved (35657 records). [2025-10-02T17:40:47.040680] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-02T17:40:47.040787] [INFO ] [MAIN ] Update Progress: 297/2370 symbols completed. BLCO took 40.0s. Estimated remaining: 4h 44m 13s. Rate: 7.3 symbols/min [2025-10-02T17:40:47.227040] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:40:47.275631] [DEBUG] [LOCAL ] BLND: Loaded 49264 existing records from primary storage. [2025-10-02T17:40:47.276030] [INFO ] [MAIN ] BLND: Loaded 49264 existing records. [2025-10-02T17:40:47.472971] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-02T17:40:47.477144] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:40:47.478953] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-02T17:40:47.479071] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-02T17:40:47.480557] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-02T17:40:47.480622] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-02T17:40:47.626962] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T17:40:47.913967] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:40:47.942456] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-10-02T17:40:48.273006] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-02T17:40:48.781370] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-02T17:40:49.073004] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-02T17:40:49.338074] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T17:40:49.873015] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-10-02T17:40:50.548409] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T17:40:50.673092] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-02T17:40:51.473032] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-02T17:40:51.547505] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:40:51.748426] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T17:40:52.273054] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-02T17:40:53.072979] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-02T17:40:53.315680] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T17:40:53.872978] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-02T17:40:54.182059] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-02T17:40:54.649041] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T17:40:54.673000] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-02T17:40:55.459863] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T17:40:55.472966] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-02T17:40:56.273015] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-02T17:40:56.637283] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T17:40:56.927247] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:40:57.073037] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-02T17:40:57.527534] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T17:40:57.873004] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-02T17:40:58.424223] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T17:40:58.443978] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T17:40:58.673045] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-02T17:40:59.473057] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-02T17:41:00.204540] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T17:41:00.273004] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-02T17:41:00.321612] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T17:41:01.072982] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-02T17:41:01.155768] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T17:41:01.873030] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-02T17:41:02.672999] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-02T17:41:03.473064] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-02T17:41:03.784846] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T17:41:04.132905] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T17:41:04.273016] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-02T17:41:04.459830] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T17:41:05.073027] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-02T17:41:05.730220] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T17:41:05.873021] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-02T17:41:06.425006] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T17:41:06.460692] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (5.39 seconds). [2025-10-02T17:41:06.673028] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-02T17:41:07.472988] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-02T17:41:07.603294] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T17:41:08.272972] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-02T17:41:08.511363] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T17:41:08.615129] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-02T17:41:09.073029] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-02T17:41:09.642239] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T17:41:09.643947] [INFO ] [REMOTE ] BLK: Full fetch complete (52678 records). [2025-10-02T17:41:09.644045] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-02T17:41:09.885218] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-02T17:41:10.062478] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-02T17:41:10.062561] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-02T17:41:10.063198] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-02T17:41:10.063264] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-02T17:41:10.064497] [DEBUG] [LOCAL ] BLK: Trimmed 52678 records to 34684 (keeping 200 days of data) [2025-10-02T17:41:10.312484] [DEBUG] [LOCAL ] BLK: Primary data saved (34684 records). [2025-10-02T17:41:10.312709] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-02T17:41:10.313684] [INFO ] [MAIN ] Update Progress: 298/2370 symbols completed. BLK took 29.1s. Estimated remaining: 4h 45m 50s. Rate: 7.2 symbols/min [2025-10-02T17:41:10.532402] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:10.532820] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-02T17:41:10.532913] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-02T17:41:10.533097] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-02T17:41:10.533373] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-02T17:41:10.533491] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-02T17:41:10.533582] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-02T17:41:10.675959] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-02T17:41:10.976106] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:10.970360] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T17:41:11.336917] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:41:11.473011] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-02T17:41:11.644082] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T17:41:11.645309] [INFO ] [REMOTE ] BLE: Full fetch complete (20379 records). [2025-10-02T17:41:11.645391] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-02T17:41:12.069004] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-02T17:41:12.069119] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-02T17:41:12.069491] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-02T17:41:12.069541] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-02T17:41:12.070262] [DEBUG] [LOCAL ] BLE: Trimmed 20379 records to 14402 (keeping 200 days of data) [2025-10-02T17:41:12.161397] [DEBUG] [LOCAL ] BLE: Primary data saved (14402 records). [2025-10-02T17:41:12.161537] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-02T17:41:12.161620] [INFO ] [MAIN ] Update Progress: 299/2370 symbols completed. BLE took 31.7s. Estimated remaining: 4h 44m 57s. Rate: 7.3 symbols/min [2025-10-02T17:41:12.278428] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-10-02T17:41:12.353487] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:12.368846] [DEBUG] [LOCAL ] BLW: Loaded 13110 existing records from primary storage. [2025-10-02T17:41:12.369089] [INFO ] [MAIN ] BLW: Loaded 13110 existing records. [2025-10-02T17:41:12.529274] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:41:12.539027] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-10-02T17:41:12.570262] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:12.570462] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:41:12.570908] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-02T17:41:12.571002] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-02T17:41:12.570827] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-02T17:41:12.571176] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:41:12.571276] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-02T17:41:12.571374] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-02T17:41:12.571432] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-02T17:41:12.571537] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-02T17:41:12.571594] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-02T17:41:12.571856] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-02T17:41:12.571782] [INFO ] [MAIN ] Update Progress: 300/2370 symbols completed. BLSH took 2.3s. Estimated remaining: 4h 43m 54s. Rate: 7.3 symbols/min [2025-10-02T17:41:13.047323] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:13.078129] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-02T17:41:13.204806] [DEBUG] [LOCAL ] BLX: Loaded 15623 existing records from primary storage. [2025-10-02T17:41:13.217733] [INFO ] [MAIN ] BLX: Loaded 15623 existing records. [2025-10-02T17:41:13.298233] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:13.457047] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:13.457794] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-02T17:41:13.457921] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-02T17:41:13.458811] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-02T17:41:13.458878] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-02T17:41:13.769375] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-02T17:41:13.881514] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-02T17:41:13.969226] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:14.673023] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-10-02T17:41:14.810383] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:41:15.473001] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-10-02T17:41:15.674319] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T17:41:15.684186] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-02T17:41:15.686480] [INFO ] [REMOTE ] BLDR: Full fetch complete (74465 records). [2025-10-02T17:41:15.686616] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-02T17:41:16.143987] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-02T17:41:16.144074] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-02T17:41:16.144954] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-02T17:41:16.145024] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-02T17:41:16.146633] [DEBUG] [LOCAL ] BLDR: Trimmed 74465 records to 52007 (keeping 200 days of data) [2025-10-02T17:41:16.272971] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-02T17:41:16.391075] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-02T17:41:16.505632] [DEBUG] [LOCAL ] BLDR: Primary data saved (52007 records). [2025-10-02T17:41:16.505862] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-02T17:41:16.505955] [INFO ] [MAIN ] Update Progress: 301/2370 symbols completed. BLDR took 43.1s. Estimated remaining: 4h 43m 17s. Rate: 7.3 symbols/min [2025-10-02T17:41:16.697352] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:16.733062] [DEBUG] [LOCAL ] BMA: Loaded 35306 existing records from primary storage. [2025-10-02T17:41:16.733356] [INFO ] [MAIN ] BMA: Loaded 35306 existing records. [2025-10-02T17:41:16.921840] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:16.922099] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-02T17:41:16.922155] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-02T17:41:16.923312] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-02T17:41:16.923375] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-02T17:41:17.076167] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-02T17:41:17.303755] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:17.872972] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-10-02T17:41:17.967365] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T17:41:18.032841] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T17:41:18.673015] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-02T17:41:19.362562] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T17:41:19.472975] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-02T17:41:19.562210] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T17:41:20.272991] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-02T17:41:20.583612] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T17:41:21.073045] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-02T17:41:21.122586] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T17:41:21.873006] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-02T17:41:22.673013] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-02T17:41:22.754304] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T17:41:22.800845] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T17:41:23.473014] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-02T17:41:23.488154] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T17:41:24.258810] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T17:41:24.272966] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-02T17:41:25.072997] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-02T17:41:25.139760] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T17:41:25.873004] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-02T17:41:26.673014] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-02T17:41:26.737702] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-02T17:41:26.845544] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T17:41:27.473853] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-02T17:41:27.473435] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-02T17:41:28.273007] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-02T17:41:28.810075] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T17:41:29.073000] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-02T17:41:29.296565] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T17:41:29.873011] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-02T17:41:30.323391] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T17:41:30.379803] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T17:41:30.673002] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-02T17:41:31.473004] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-02T17:41:31.995369] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-02T17:41:32.272986] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-02T17:41:32.417378] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-02T17:41:33.073000] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-02T17:41:33.781010] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T17:41:33.781217] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:41:33.791300] [INFO ] [REMOTE ] BLW: Full fetch complete (19198 records). [2025-10-02T17:41:33.791964] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-02T17:41:33.878154] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-02T17:41:34.209515] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-02T17:41:34.209595] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-02T17:41:34.209939] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-02T17:41:34.210001] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-02T17:41:34.210606] [DEBUG] [LOCAL ] BLW: Trimmed 19198 records to 13258 (keeping 200 days of data) [2025-10-02T17:41:34.297956] [DEBUG] [LOCAL ] BLW: Primary data saved (13258 records). [2025-10-02T17:41:34.298134] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-02T17:41:34.298224] [INFO ] [MAIN ] Update Progress: 302/2370 symbols completed. BLW took 22.1s. Estimated remaining: 4h 44m 14s. Rate: 7.3 symbols/min [2025-10-02T17:41:34.488156] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:34.501951] [DEBUG] [LOCAL ] BME: Loaded 10934 existing records from primary storage. [2025-10-02T17:41:34.502205] [INFO ] [MAIN ] BME: Loaded 10934 existing records. [2025-10-02T17:41:34.673764] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-02T17:41:34.703202] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:34.703576] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-02T17:41:34.703681] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-02T17:41:34.704327] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-02T17:41:34.704391] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-02T17:41:35.056190] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T17:41:35.148056] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:35.473014] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-02T17:41:36.087119] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T17:41:36.089763] [INFO ] [REMOTE ] BLND: Full fetch complete (72255 records). [2025-10-02T17:41:36.089885] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-02T17:41:36.284688] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-02T17:41:36.533352] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-02T17:41:36.533432] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-02T17:41:36.534181] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-02T17:41:36.534246] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-02T17:41:36.535702] [DEBUG] [LOCAL ] BLND: Trimmed 72255 records to 49624 (keeping 200 days of data) [2025-10-02T17:41:36.801382] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-02T17:41:36.886208] [DEBUG] [LOCAL ] BLND: Primary data saved (49624 records). [2025-10-02T17:41:36.886384] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-02T17:41:36.886500] [INFO ] [MAIN ] Update Progress: 303/2370 symbols completed. BLND took 49.8s. Estimated remaining: 4h 43m 27s. Rate: 7.3 symbols/min [2025-10-02T17:41:36.945078] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T17:41:37.078173] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-10-02T17:41:37.092084] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:37.123229] [DEBUG] [LOCAL ] BMEZ: Loaded 26275 existing records from primary storage. [2025-10-02T17:41:37.123515] [INFO ] [MAIN ] BMEZ: Loaded 26275 existing records. [2025-10-02T17:41:37.320921] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:37.321139] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-02T17:41:37.321194] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-02T17:41:37.322088] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-02T17:41:37.322150] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-02T17:41:37.737886] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:37.873049] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-02T17:41:38.126547] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T17:41:38.673046] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-10-02T17:41:39.327286] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T17:41:39.473062] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-02T17:41:40.022384] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T17:41:40.273000] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-02T17:41:40.698295] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T17:41:41.073001] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-02T17:41:41.278229] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-02T17:41:41.700882] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T17:41:41.873029] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-02T17:41:42.673034] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-02T17:41:43.212125] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T17:41:43.473053] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-02T17:41:43.917634] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T17:41:44.273029] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-02T17:41:44.960503] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T17:41:45.072994] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-02T17:41:45.409257] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T17:41:45.719069] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T17:41:45.873009] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-02T17:41:46.673060] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-02T17:41:46.910951] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T17:41:46.913497] [INFO ] [REMOTE ] BMA: Full fetch complete (51514 records). [2025-10-02T17:41:46.913736] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-02T17:41:47.363005] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-02T17:41:47.363119] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-02T17:41:47.363853] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-02T17:41:47.363919] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-02T17:41:47.365237] [DEBUG] [LOCAL ] BMA: Trimmed 51514 records to 35644 (keeping 200 days of data) [2025-10-02T17:41:47.473160] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-02T17:41:47.605762] [DEBUG] [LOCAL ] BMA: Primary data saved (35644 records). [2025-10-02T17:41:47.605927] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-02T17:41:47.606023] [INFO ] [MAIN ] Update Progress: 304/2370 symbols completed. BMA took 31.1s. Estimated remaining: 4h 43m 36s. Rate: 7.3 symbols/min [2025-10-02T17:41:47.802034] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:47.829039] [DEBUG] [LOCAL ] BMI: Loaded 24194 existing records from primary storage. [2025-10-02T17:41:47.829318] [INFO ] [MAIN ] BMI: Loaded 24194 existing records. [2025-10-02T17:41:48.028694] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:48.028931] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-02T17:41:48.028980] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-02T17:41:48.029991] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-02T17:41:48.030071] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-02T17:41:48.280414] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-02T17:41:48.425538] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T17:41:48.505767] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:48.517427] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T17:41:49.073041] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-02T17:41:49.205190] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T17:41:49.783303] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:41:49.784460] [INFO ] [REMOTE ] BLX: Full fetch complete (22762 records). [2025-10-02T17:41:49.784537] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-02T17:41:49.878184] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-02T17:41:50.192158] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-02T17:41:50.192275] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-02T17:41:50.192672] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-02T17:41:50.192735] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-02T17:41:50.193354] [DEBUG] [LOCAL ] BLX: Trimmed 22762 records to 15738 (keeping 200 days of data) [2025-10-02T17:41:50.294688] [DEBUG] [LOCAL ] BLX: Primary data saved (15738 records). [2025-10-02T17:41:50.294835] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-02T17:41:50.294923] [INFO ] [MAIN ] Update Progress: 305/2370 symbols completed. BLX took 37.7s. Estimated remaining: 4h 42m 50s. Rate: 7.3 symbols/min [2025-10-02T17:41:50.488044] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:41:50.492763] [DEBUG] [LOCAL ] BMN: Loaded 2576 existing records from primary storage. [2025-10-02T17:41:50.493127] [INFO ] [MAIN ] BMN: Loaded 2576 existing records. [2025-10-02T17:41:50.678098] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-02T17:41:50.683825] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:41:50.684813] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-02T17:41:50.684872] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-02T17:41:50.685153] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-02T17:41:50.685213] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-02T17:41:51.138471] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:41:51.157829] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T17:41:51.472995] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-10-02T17:41:51.585589] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T17:41:52.273122] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-10-02T17:41:52.576025] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T17:41:52.895254] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-02T17:41:53.073036] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-02T17:41:53.724747] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T17:41:53.872997] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-02T17:41:54.341893] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T17:41:54.673057] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-02T17:41:55.473051] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-02T17:41:55.809218] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T17:41:56.273194] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-02T17:41:56.516038] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T17:41:56.575196] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-10-02T17:41:57.073244] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-02T17:41:57.633199] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T17:41:57.873013] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-02T17:41:58.673008] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-02T17:41:58.929927] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T17:41:58.998447] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-02T17:41:59.473043] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-02T17:42:00.099054] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T17:42:00.273016] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-02T17:42:01.073060] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-02T17:42:01.257916] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T17:42:01.873057] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-02T17:42:02.347605] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-02T17:42:02.673031] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-02T17:42:03.087807] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-02T17:42:03.473026] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-02T17:42:04.273037] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-02T17:42:04.291396] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T17:42:05.073019] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-02T17:42:05.843335] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T17:42:05.866166] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (4.79 seconds). [2025-10-02T17:42:05.872942] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-02T17:42:05.963750] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-02T17:42:06.673039] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-02T17:42:06.866949] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T17:42:07.473069] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-02T17:42:07.704192] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-02T17:42:08.279219] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-02T17:42:08.283243] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T17:42:08.752207] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-02T17:42:09.073029] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-02T17:42:09.552094] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T17:42:09.873004] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-02T17:42:10.406832] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T17:42:10.673022] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-02T17:42:11.473052] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-02T17:42:11.561636] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T17:42:11.562594] [INFO ] [REMOTE ] BME: Full fetch complete (16128 records). [2025-10-02T17:42:11.562688] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-02T17:42:12.009881] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T17:42:12.009755] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-02T17:42:12.010848] [INFO ] [REMOTE ] BMN: Full fetch complete (3748 records). [2025-10-02T17:42:12.010943] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-02T17:42:12.011056] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-02T17:42:12.017131] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-02T17:42:12.051019] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-02T17:42:12.135126] [DEBUG] [LOCAL ] BME: Trimmed 16128 records to 11009 (keeping 200 days of data) [2025-10-02T17:42:12.275178] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-02T17:42:12.481864] [DEBUG] [LOCAL ] BME: Primary data saved (11009 records). [2025-10-02T17:42:12.492372] [INFO ] [MAIN ] BME: Full history saved. [2025-10-02T17:42:12.494035] [INFO ] [MAIN ] Update Progress: 306/2370 symbols completed. BME took 38.2s. Estimated remaining: 4h 44m 16s. Rate: 7.3 symbols/min [2025-10-02T17:42:12.593486] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-02T17:42:12.613051] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-02T17:42:12.647587] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-02T17:42:12.647964] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-02T17:42:12.649269] [DEBUG] [LOCAL ] BMN: Trimmed 3748 records to 2594 (keeping 200 days of data) [2025-10-02T17:42:12.731100] [DEBUG] [LOCAL ] BMN: Primary data saved (2594 records). [2025-10-02T17:42:12.753448] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-02T17:42:12.753725] [INFO ] [MAIN ] Update Progress: 307/2370 symbols completed. BMN took 22.5s. Estimated remaining: 4h 43m 14s. Rate: 7.3 symbols/min [2025-10-02T17:42:12.753326] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:42:12.959736] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:42:12.992321] [DEBUG] [LOCAL ] BMO: Loaded 41214 existing records from primary storage. [2025-10-02T17:42:12.992853] [INFO ] [MAIN ] BMO: Loaded 41214 existing records. [2025-10-02T17:42:13.089948] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-02T17:42:13.235662] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:42:13.237008] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-02T17:42:13.237083] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-02T17:42:13.238239] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-02T17:42:13.238518] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-02T17:42:13.243701] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-02T17:42:13.271273] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-02T17:42:13.585921] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:42:13.632250] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-02T17:42:13.649159] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-02T17:42:13.696993] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-02T17:42:13.707148] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-02T17:42:13.937339] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T17:42:14.076091] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-02T17:42:14.179489] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:42:14.324247] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:42:14.532852] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T17:42:14.672985] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-10-02T17:42:15.132583] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T17:42:15.134210] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40800 records). [2025-10-02T17:42:15.134296] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-02T17:42:15.478216] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-02T17:42:15.562767] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-02T17:42:15.562858] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-02T17:42:15.563378] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-02T17:42:15.563421] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-02T17:42:15.564471] [DEBUG] [LOCAL ] BMEZ: Trimmed 40800 records to 26437 (keeping 200 days of data) [2025-10-02T17:42:15.731156] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26437 records). [2025-10-02T17:42:15.731308] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-02T17:42:15.731396] [INFO ] [MAIN ] Update Progress: 308/2370 symbols completed. BMEZ took 38.8s. Estimated remaining: 4h 42m 31s. Rate: 7.3 symbols/min [2025-10-02T17:42:15.919442] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:42:15.972885] [DEBUG] [LOCAL ] BN: Loaded 52993 existing records from primary storage. [2025-10-02T17:42:15.973370] [INFO ] [MAIN ] BN: Loaded 52993 existing records. [2025-10-02T17:42:16.171478] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:42:16.171804] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-02T17:42:16.171861] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-02T17:42:16.173823] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-02T17:42:16.173899] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-02T17:42:16.283055] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-10-02T17:42:16.575443] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:42:16.767343] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T17:42:16.838379] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-02T17:42:17.073026] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-02T17:42:17.873010] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-10-02T17:42:18.039165] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T17:42:18.115564] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T17:42:18.673048] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-02T17:42:19.472991] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-02T17:42:19.661219] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T17:42:20.171385] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:42:20.272992] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-02T17:42:21.080704] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-02T17:42:21.105403] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:42:21.806431] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T17:42:21.872994] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-02T17:42:22.207558] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T17:42:22.673113] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-02T17:42:23.473059] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-02T17:42:23.586387] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T17:42:24.272990] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-02T17:42:24.778916] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-02T17:42:24.884152] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T17:42:25.072994] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-02T17:42:25.872979] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-02T17:42:25.927316] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T17:42:26.672987] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-02T17:42:27.088729] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T17:42:27.274890] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-10-02T17:42:27.473013] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-02T17:42:28.254612] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:42:28.272955] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-02T17:42:28.724554] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T17:42:29.073010] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-02T17:42:29.283288] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T17:42:29.873007] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-02T17:42:30.228203] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T17:42:30.230002] [INFO ] [REMOTE ] BMI: Full fetch complete (32960 records). [2025-10-02T17:42:30.230142] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-02T17:42:30.658274] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-02T17:42:30.658357] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-02T17:42:30.658797] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-02T17:42:30.658888] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-02T17:42:30.659738] [DEBUG] [LOCAL ] BMI: Trimmed 32960 records to 24385 (keeping 200 days of data) [2025-10-02T17:42:30.730453] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-02T17:42:30.840334] [DEBUG] [LOCAL ] BMI: Primary data saved (24385 records). [2025-10-02T17:42:30.840484] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-02T17:42:30.840592] [INFO ] [MAIN ] Update Progress: 309/2370 symbols completed. BMI took 43.2s. Estimated remaining: 4h 43m 8s. Rate: 7.3 symbols/min [2025-10-02T17:42:31.049196] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:42:31.085489] [DEBUG] [LOCAL ] BNED: Loaded 29491 existing records from primary storage. [2025-10-02T17:42:31.085820] [INFO ] [MAIN ] BNED: Loaded 29491 existing records. [2025-10-02T17:42:31.300364] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:42:31.300727] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-02T17:42:31.300836] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-02T17:42:31.301940] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-02T17:42:31.302035] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-02T17:42:31.478174] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-02T17:42:31.758358] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:42:31.903946] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T17:42:31.974510] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T17:42:32.273010] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-10-02T17:42:33.073023] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-02T17:42:33.446516] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T17:42:33.873123] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-02T17:42:33.966638] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T17:42:34.673001] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-02T17:42:34.896191] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:42:35.451542] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:42:35.473030] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-02T17:42:36.273038] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-02T17:42:36.568463] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T17:42:37.073127] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-02T17:42:37.483889] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T17:42:37.550102] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T17:42:37.873027] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-02T17:42:38.629977] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T17:42:38.673019] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-02T17:42:39.473207] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-02T17:42:39.903845] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T17:42:39.906500] [INFO ] [REMOTE ] BMO: Full fetch complete (59653 records). [2025-10-02T17:42:39.906626] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-02T17:42:40.274836] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-02T17:42:40.314543] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-02T17:42:40.473735] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-02T17:42:40.473858] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-02T17:42:40.474699] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-02T17:42:40.474766] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-02T17:42:40.476186] [DEBUG] [LOCAL ] BMO: Trimmed 59653 records to 41494 (keeping 200 days of data) [2025-10-02T17:42:40.759470] [DEBUG] [LOCAL ] BMO: Primary data saved (41494 records). [2025-10-02T17:42:40.759601] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-02T17:42:40.759735] [INFO ] [MAIN ] Update Progress: 310/2370 symbols completed. BMO took 28.2s. Estimated remaining: 4h 43m 11s. Rate: 7.3 symbols/min [2025-10-02T17:42:40.942342] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:42:40.951294] [DEBUG] [LOCAL ] BNH: Loaded 5106 existing records from primary storage. [2025-10-02T17:42:40.951503] [INFO ] [MAIN ] BNH: Loaded 5106 existing records. [2025-10-02T17:42:41.078265] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-02T17:42:41.175178] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:42:41.176609] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-02T17:42:41.176713] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-02T17:42:41.177071] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-02T17:42:41.177138] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-02T17:42:41.594466] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-02T17:42:41.701463] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:42:41.703443] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T17:42:41.872980] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-02T17:42:42.673017] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-10-02T17:42:42.808422] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T17:42:43.150303] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-02T17:42:43.267524] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-02T17:42:43.473012] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-02T17:42:44.273051] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-02T17:42:44.794682] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T17:42:45.073046] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-02T17:42:45.873066] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-02T17:42:46.240477] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T17:42:46.310663] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-02T17:42:46.379166] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T17:42:46.673067] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-02T17:42:47.472981] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-02T17:42:47.927281] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T17:42:48.272987] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-02T17:42:48.631834] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-02T17:42:49.069849] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-02T17:42:49.073784] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-02T17:42:49.751637] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T17:42:49.873081] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-02T17:42:50.673018] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-02T17:42:51.409977] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-02T17:42:51.473015] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-02T17:42:52.086119] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-02T17:42:52.273052] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-02T17:42:52.848093] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T17:42:52.850398] [INFO ] [REMOTE ] BMY: Full fetch complete (77795 records). [2025-10-02T17:42:52.850515] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-02T17:42:53.014786] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T17:42:53.080065] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-02T17:42:53.328795] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-02T17:42:53.328908] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-02T17:42:53.329762] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-02T17:42:53.329830] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-02T17:42:53.331999] [DEBUG] [LOCAL ] BMY: Trimmed 77795 records to 54147 (keeping 200 days of data) [2025-10-02T17:42:53.703571] [DEBUG] [LOCAL ] BMY: Primary data saved (54147 records). [2025-10-02T17:42:53.703781] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-02T17:42:53.705287] [INFO ] [MAIN ] Update Progress: 311/2370 symbols completed. BMY took 41.0s. Estimated remaining: 4h 43m 34s. Rate: 7.3 symbols/min [2025-10-02T17:42:53.879025] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-02T17:42:53.894385] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T17:42:53.924700] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:42:53.931177] [DEBUG] [LOCAL ] BNJ: Loaded 2630 existing records from primary storage. [2025-10-02T17:42:53.931379] [INFO ] [MAIN ] BNJ: Loaded 2630 existing records. [2025-10-02T17:42:54.136679] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:42:54.136950] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-02T17:42:54.137011] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-02T17:42:54.137220] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-02T17:42:54.137300] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-02T17:42:54.542147] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:42:54.673053] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-02T17:42:55.412436] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T17:42:55.473029] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-10-02T17:42:56.276479] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-02T17:42:56.280017] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T17:42:56.284661] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-02T17:42:57.072996] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-02T17:42:57.451743] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-02T17:42:57.873025] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-02T17:42:58.246920] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-02T17:42:58.491188] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T17:42:58.672998] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-02T17:42:59.473039] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-02T17:43:00.003331] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T17:43:00.273036] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-02T17:43:00.461934] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T17:43:01.073041] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-02T17:43:01.131995] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T17:43:01.133518] [INFO ] [REMOTE ] BNED: Full fetch complete (43842 records). [2025-10-02T17:43:01.133630] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-02T17:43:01.576455] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T17:43:01.613185] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-02T17:43:01.613274] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-02T17:43:01.613869] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-02T17:43:01.613934] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-02T17:43:01.614930] [DEBUG] [LOCAL ] BNED: Trimmed 43842 records to 29657 (keeping 200 days of data) [2025-10-02T17:43:01.799713] [DEBUG] [LOCAL ] BNED: Primary data saved (29657 records). [2025-10-02T17:43:01.799865] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-02T17:43:01.799950] [INFO ] [MAIN ] Update Progress: 312/2370 symbols completed. BNED took 31.0s. Estimated remaining: 4h 43m 25s. Rate: 7.3 symbols/min [2025-10-02T17:43:01.878123] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-02T17:43:02.002485] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:02.057586] [DEBUG] [LOCAL ] BNL: Loaded 46913 existing records from primary storage. [2025-10-02T17:43:02.057936] [INFO ] [MAIN ] BNL: Loaded 46913 existing records. [2025-10-02T17:43:02.265403] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:02.265683] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-02T17:43:02.265761] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-02T17:43:02.267556] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-02T17:43:02.267621] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-02T17:43:02.589552] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T17:43:02.678138] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-02T17:43:02.722275] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:43:03.473016] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-02T17:43:04.070195] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T17:43:04.139829] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T17:43:04.148292] [INFO ] [REMOTE ] BN: Full fetch complete (76693 records). [2025-10-02T17:43:04.148477] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-02T17:43:04.278124] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-02T17:43:04.660900] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-02T17:43:04.660996] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-02T17:43:04.661843] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-02T17:43:04.661921] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-02T17:43:04.663582] [DEBUG] [LOCAL ] BN: Trimmed 76693 records to 53383 (keeping 200 days of data) [2025-10-02T17:43:05.036121] [DEBUG] [LOCAL ] BN: Primary data saved (53383 records). [2025-10-02T17:43:05.036333] [INFO ] [MAIN ] BN: Full history saved. [2025-10-02T17:43:05.036446] [INFO ] [MAIN ] Update Progress: 313/2370 symbols completed. BN took 49.3s. Estimated remaining: 4h 42m 43s. Rate: 7.3 symbols/min [2025-10-02T17:43:05.073013] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-10-02T17:43:05.132469] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-02T17:43:05.249163] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:05.304935] [DEBUG] [LOCAL ] BNS: Loaded 51486 existing records from primary storage. [2025-10-02T17:43:05.305275] [INFO ] [MAIN ] BNS: Loaded 51486 existing records. [2025-10-02T17:43:05.504545] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:05.504803] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-02T17:43:05.504854] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-02T17:43:05.506509] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-02T17:43:05.506574] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-02T17:43:05.878265] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-02T17:43:05.955772] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:43:06.365732] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T17:43:06.672989] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-02T17:43:06.785065] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T17:43:07.112986] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T17:43:07.473044] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-02T17:43:07.765023] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-02T17:43:08.273036] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-02T17:43:09.073017] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-02T17:43:09.470424] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-02T17:43:09.784972] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T17:43:09.873034] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-02T17:43:10.489421] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T17:43:10.673015] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-10-02T17:43:11.473014] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-02T17:43:12.073763] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T17:43:12.074660] [INFO ] [REMOTE ] BNH: Full fetch complete (7002 records). [2025-10-02T17:43:12.074742] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-02T17:43:12.285817] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-02T17:43:12.520282] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-02T17:43:12.520388] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-02T17:43:12.520678] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-02T17:43:12.520884] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-02T17:43:12.521588] [DEBUG] [LOCAL ] BNH: Trimmed 7002 records to 5161 (keeping 200 days of data) [2025-10-02T17:43:12.578346] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T17:43:12.597783] [DEBUG] [LOCAL ] BNH: Primary data saved (5161 records). [2025-10-02T17:43:12.597944] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-02T17:43:12.598091] [INFO ] [MAIN ] Update Progress: 314/2370 symbols completed. BNH took 31.8s. Estimated remaining: 4h 42m 31s. Rate: 7.3 symbols/min [2025-10-02T17:43:12.806718] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:12.812223] [DEBUG] [LOCAL ] BNT: Loaded 3373 existing records from primary storage. [2025-10-02T17:43:12.812448] [INFO ] [MAIN ] BNT: Loaded 3373 existing records. [2025-10-02T17:43:13.014107] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:13.014325] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-02T17:43:13.014376] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-02T17:43:13.014620] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-02T17:43:13.014718] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-02T17:43:13.082510] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-02T17:43:13.469763] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:43:13.859863] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T17:43:13.872955] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-02T17:43:14.673209] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-02T17:43:14.810202] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T17:43:14.990634] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-02T17:43:15.448299] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T17:43:15.473005] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-02T17:43:16.272998] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-10-02T17:43:16.764601] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-10-02T17:43:17.072970] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-02T17:43:17.107255] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:43:17.720372] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-02T17:43:17.872982] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-02T17:43:18.295803] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T17:43:18.296508] [INFO ] [REMOTE ] BNJ: Full fetch complete (4322 records). [2025-10-02T17:43:18.296583] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-02T17:43:18.297012] [FATAL] [VALIDATOR ] BNJ: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:43:18.297165] [FATAL] [MAIN ] BNJ: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:43:18.297250] [WARN ] [MAIN ] BNJ: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:43:18.297340] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-02T17:43:18.297420] [DEBUG] [LOCAL ] BNJ: No primary data file found to delete. [2025-10-02T17:43:18.297465] [INFO ] [LOCAL ] BNJ: Starting deletion of derivative data. [2025-10-02T17:43:18.297909] [DEBUG] [LOCAL ] BNJ: Deleted derivative data file. [2025-10-02T17:43:18.298304] [INFO ] [MAIN ] Update Progress: 315/2370 symbols completed. BNJ took 24.6s. Estimated remaining: 4h 42m 6s. Rate: 7.3 symbols/min [2025-10-02T17:43:18.491481] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:18.501245] [DEBUG] [LOCAL ] BNY: Loaded 7113 existing records from primary storage. [2025-10-02T17:43:18.501476] [INFO ] [MAIN ] BNY: Loaded 7113 existing records. [2025-10-02T17:43:18.675284] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-02T17:43:18.706814] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:18.707048] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-02T17:43:18.707301] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-02T17:43:18.708504] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-02T17:43:18.708565] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-02T17:43:19.112496] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:43:19.473024] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-02T17:43:19.978449] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-02T17:43:20.273048] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-10-02T17:43:20.401135] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T17:43:21.073025] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-02T17:43:21.205394] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T17:43:21.385626] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-02T17:43:21.872992] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-02T17:43:22.327169] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-02T17:43:22.673005] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-02T17:43:23.306080] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T17:43:23.472999] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-02T17:43:24.273191] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-02T17:43:24.874011] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T17:43:25.072973] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-02T17:43:25.185353] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T17:43:25.872998] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-02T17:43:26.358705] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T17:43:26.672973] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-02T17:43:27.034909] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T17:43:27.064536] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-02T17:43:27.473019] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-02T17:43:28.223888] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T17:43:28.273044] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-02T17:43:28.783942] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T17:43:29.073042] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-02T17:43:29.873026] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-02T17:43:30.499279] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-02T17:43:30.673028] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-02T17:43:30.899815] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T17:43:31.403851] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T17:43:31.473060] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-02T17:43:32.273039] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-02T17:43:33.073021] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-02T17:43:33.223018] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T17:43:33.820059] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-02T17:43:33.849221] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T17:43:33.872969] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-02T17:43:34.673063] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-02T17:43:34.704628] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T17:43:35.473049] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-02T17:43:36.256031] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T17:43:36.272956] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-02T17:43:37.026262] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-02T17:43:37.072996] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-02T17:43:37.156219] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T17:43:37.670355] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T17:43:37.872997] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-02T17:43:38.323968] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-02T17:43:38.673052] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-02T17:43:39.473021] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-02T17:43:40.170968] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-02T17:43:40.208539] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T17:43:40.273004] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-02T17:43:41.073054] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-02T17:43:41.871778] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T17:43:41.872807] [INFO ] [REMOTE ] BNY: Full fetch complete (10459 records). [2025-10-02T17:43:41.872889] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-02T17:43:41.873101] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-02T17:43:42.334242] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-02T17:43:42.334591] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-02T17:43:42.337142] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T17:43:42.335382] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-02T17:43:42.347974] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-02T17:43:42.349509] [DEBUG] [LOCAL ] BNY: Trimmed 10459 records to 7174 (keeping 200 days of data) [2025-10-02T17:43:42.396706] [DEBUG] [LOCAL ] BNY: Primary data saved (7174 records). [2025-10-02T17:43:42.396857] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-02T17:43:42.396945] [INFO ] [MAIN ] Update Progress: 316/2370 symbols completed. BNY took 24.1s. Estimated remaining: 4h 43m 41s. Rate: 7.2 symbols/min [2025-10-02T17:43:42.589847] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:42.611162] [DEBUG] [LOCAL ] BOC: Loaded 18283 existing records from primary storage. [2025-10-02T17:43:42.611702] [INFO ] [MAIN ] BOC: Loaded 18283 existing records. [2025-10-02T17:43:42.682404] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-02T17:43:42.816022] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:42.816257] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-02T17:43:42.816305] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-02T17:43:42.816972] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-10-02T17:43:42.817031] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-02T17:43:43.215282] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:43:43.423575] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T17:43:43.473022] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-02T17:43:43.626845] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T17:43:44.039997] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T17:43:44.040966] [INFO ] [REMOTE ] BNT: Full fetch complete (4495 records). [2025-10-02T17:43:44.041037] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-02T17:43:44.278109] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-02T17:43:44.440582] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-02T17:43:44.440693] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-02T17:43:44.440869] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-02T17:43:44.440923] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-02T17:43:44.441337] [DEBUG] [LOCAL ] BNT: Trimmed 4495 records to 3393 (keeping 200 days of data) [2025-10-02T17:43:44.463034] [DEBUG] [LOCAL ] BNT: Primary data saved (3393 records). [2025-10-02T17:43:44.463150] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-02T17:43:44.463234] [INFO ] [MAIN ] Update Progress: 317/2370 symbols completed. BNT took 31.9s. Estimated remaining: 4h 42m 52s. Rate: 7.3 symbols/min [2025-10-02T17:43:45.073129] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-02T17:43:45.873072] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-10-02T17:43:46.030034] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T17:43:46.291871] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T17:43:46.294390] [INFO ] [REMOTE ] BNL: Full fetch complete (66984 records). [2025-10-02T17:43:46.294520] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-02T17:43:46.683046] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-02T17:43:46.758216] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-02T17:43:46.758361] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-02T17:43:46.759173] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-02T17:43:46.759252] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-02T17:43:46.760723] [DEBUG] [LOCAL ] BNL: Trimmed 66984 records to 47291 (keeping 200 days of data) [2025-10-02T17:43:47.005683] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T17:43:47.097635] [DEBUG] [LOCAL ] BNL: Primary data saved (47291 records). [2025-10-02T17:43:47.097799] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-02T17:43:47.097883] [INFO ] [MAIN ] Update Progress: 318/2370 symbols completed. BNL took 45.3s. Estimated remaining: 4h 42m 8s. Rate: 7.3 symbols/min [2025-10-02T17:43:47.473055] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-02T17:43:48.257956] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-02T17:43:48.272958] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-02T17:43:48.459207] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T17:43:49.073022] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-02T17:43:49.613140] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:43:49.615449] [INFO ] [REMOTE ] BNS: Full fetch complete (74246 records). [2025-10-02T17:43:49.615602] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-02T17:43:50.067727] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T17:43:50.091693] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-02T17:43:50.119322] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-02T17:43:50.119432] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-02T17:43:50.120572] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-02T17:43:50.120700] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-02T17:43:50.122496] [DEBUG] [LOCAL ] BNS: Trimmed 74246 records to 51859 (keeping 200 days of data) [2025-10-02T17:43:50.469632] [DEBUG] [LOCAL ] BNS: Primary data saved (51859 records). [2025-10-02T17:43:50.469998] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-02T17:43:50.470084] [INFO ] [MAIN ] Update Progress: 319/2370 symbols completed. BNS took 45.4s. Estimated remaining: 4h 41m 28s. Rate: 7.3 symbols/min [2025-10-02T17:43:51.203527] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T17:43:51.207690] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-02T17:43:52.084511] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T17:43:52.090283] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-02T17:43:52.935514] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T17:43:52.940243] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-02T17:43:53.972587] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:43:53.976619] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-02T17:43:54.999290] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T17:43:55.004373] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-02T17:43:55.856906] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T17:43:55.862576] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-02T17:43:56.875711] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T17:43:56.879878] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-02T17:43:57.701332] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T17:43:57.702535] [INFO ] [REMOTE ] BOC: Full fetch complete (25792 records). [2025-10-02T17:43:57.702609] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-02T17:43:58.104140] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-02T17:43:58.104264] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-02T17:43:58.104734] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-02T17:43:58.104798] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-02T17:43:58.105736] [DEBUG] [LOCAL ] BOC: Trimmed 25792 records to 18384 (keeping 200 days of data) [2025-10-02T17:43:58.217152] [DEBUG] [LOCAL ] BOC: Primary data saved (18384 records). [2025-10-02T17:43:58.217303] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-02T17:43:58.217393] [INFO ] [MAIN ] Update Progress: 320/2370 symbols completed. BOC took 15.8s. Estimated remaining: 4h 41m 17s. Rate: 7.3 symbols/min [2025-10-02T17:43:58.909610] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:58.970444] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:58.997392] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:59.024737] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:43:59.049290] [DEBUG] [LOCAL ] BOE: Loaded 17689 existing records from primary storage. [2025-10-02T17:43:59.049845] [INFO ] [MAIN ] BOE: Loaded 17689 existing records. [2025-10-02T17:43:59.224781] [DEBUG] [LOCAL ] BOND: Loaded 32203 existing records from primary storage. [2025-10-02T17:43:59.253617] [DEBUG] [LOCAL ] BOOT: Loaded 40532 existing records from primary storage. [2025-10-02T17:43:59.254556] [INFO ] [MAIN ] BOND: Loaded 32203 existing records. [2025-10-02T17:43:59.212012] [DEBUG] [LOCAL ] BOH: Loaded 30758 existing records from primary storage. [2025-10-02T17:43:59.289103] [INFO ] [MAIN ] BOOT: Loaded 40532 existing records. [2025-10-02T17:43:59.360717] [INFO ] [MAIN ] BOH: Loaded 30758 existing records. [2025-10-02T17:43:59.411721] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:59.497603] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-02T17:43:59.615742] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-02T17:43:59.667380] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-02T17:43:59.740910] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-02T17:43:59.850503] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:59.979185] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:44:00.022900] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:43:59.972179] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-02T17:44:00.043847] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-02T17:44:00.043969] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-02T17:44:00.054454] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-02T17:44:00.068818] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-02T17:44:00.068665] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-02T17:44:00.074893] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-02T17:44:00.074973] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-02T17:44:00.080237] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-02T17:44:00.085474] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-02T17:44:00.101200] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-02T17:44:00.135273] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-02T17:44:01.128349] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:01.168389] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-10-02T17:44:01.550216] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:01.603887] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-10-02T17:44:01.647050] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:01.694298] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:01.688303] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-10-02T17:44:01.695778] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-10-02T17:44:02.391697] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T17:44:02.397862] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-02T17:44:03.026578] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:44:03.033519] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-02T17:44:03.187112] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T17:44:03.196124] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-02T17:44:03.298068] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T17:44:03.305632] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-02T17:44:03.322756] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T17:44:03.329280] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-02T17:44:04.299045] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T17:44:04.303820] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-02T17:44:04.442182] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T17:44:04.449602] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-02T17:44:04.665384] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T17:44:04.848138] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T17:44:05.072972] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-02T17:44:05.152385] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T17:44:05.728432] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T17:44:05.873033] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-02T17:44:06.656604] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T17:44:06.672980] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-02T17:44:06.721947] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T17:44:07.473008] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-02T17:44:07.923232] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T17:44:08.272998] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-02T17:44:08.983568] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:44:09.073002] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-02T17:44:09.635315] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:44:09.873025] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-02T17:44:10.588146] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T17:44:10.672974] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-02T17:44:11.478491] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-02T17:44:11.494323] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T17:44:11.970912] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T17:44:12.121923] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T17:44:12.273010] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-02T17:44:13.073045] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-02T17:44:13.710801] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T17:44:13.873026] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-02T17:44:14.673009] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-02T17:44:15.011132] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T17:44:15.041022] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T17:44:15.473001] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-02T17:44:16.044276] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T17:44:16.273015] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-02T17:44:16.818301] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T17:44:17.073024] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-02T17:44:17.345848] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T17:44:17.756765] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-02T17:44:17.873001] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-02T17:44:18.672979] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-02T17:44:18.907310] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T17:44:19.472995] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-02T17:44:20.187756] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T17:44:20.272991] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-02T17:44:20.387970] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T17:44:21.073031] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-02T17:44:21.767578] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T17:44:21.873015] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-02T17:44:22.524971] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:44:22.673024] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-02T17:44:22.935142] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T17:44:23.473217] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-02T17:44:24.186716] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T17:44:24.273016] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-02T17:44:24.574551] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T17:44:25.073028] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-02T17:44:25.660455] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T17:44:25.873027] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-02T17:44:26.103812] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T17:44:26.673044] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-02T17:44:27.268580] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T17:44:27.473051] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-02T17:44:28.108309] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:44:28.273000] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-02T17:44:28.589714] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T17:44:28.591123] [INFO ] [REMOTE ] BOE: Full fetch complete (26713 records). [2025-10-02T17:44:28.591242] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-02T17:44:29.050511] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-10-02T17:44:29.050600] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-10-02T17:44:29.051055] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-10-02T17:44:29.051117] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-10-02T17:44:29.051880] [DEBUG] [LOCAL ] BOE: Trimmed 26713 records to 17889 (keeping 200 days of data) [2025-10-02T17:44:29.106032] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-02T17:44:29.178231] [DEBUG] [LOCAL ] BOE: Primary data saved (17889 records). [2025-10-02T17:44:29.178430] [INFO ] [MAIN ] BOE: Full history saved. [2025-10-02T17:44:29.178610] [INFO ] [MAIN ] Update Progress: 321/2370 symbols completed. BOE took 31.0s. Estimated remaining: 4h 43m 33s. Rate: 7.2 symbols/min [2025-10-02T17:44:29.285906] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T17:44:29.320824] [INFO ] [REMOTE ] BOH: Full fetch complete (44780 records). [2025-10-02T17:44:29.324776] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-02T17:44:29.502747] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:44:29.877829] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-02T17:44:29.892544] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-02T17:44:29.893822] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-02T17:44:29.896261] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-02T17:44:29.895413] [DEBUG] [LOCAL ] BORR: Loaded 51122 existing records from primary storage. [2025-10-02T17:44:29.896500] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-02T17:44:29.897373] [INFO ] [MAIN ] BORR: Loaded 51122 existing records. [2025-10-02T17:44:29.994027] [DEBUG] [LOCAL ] BOH: Trimmed 44780 records to 30959 (keeping 200 days of data) [2025-10-02T17:44:30.219938] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:44:30.222154] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-02T17:44:30.225090] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-02T17:44:30.226718] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-02T17:44:30.227230] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-02T17:44:30.706891] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T17:44:30.720971] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:30.722180] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-10-02T17:44:30.814807] [DEBUG] [LOCAL ] BOH: Primary data saved (30959 records). [2025-10-02T17:44:30.814992] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-02T17:44:30.815096] [INFO ] [MAIN ] Update Progress: 322/2370 symbols completed. BOH took 32.6s. Estimated remaining: 4h 42m 43s. Rate: 7.2 symbols/min [2025-10-02T17:44:30.999475] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:44:30.999666] [DEBUG] [LOCAL ] BOW: No existing data file found in primary storage. [2025-10-02T17:44:30.999725] [WARN ] [MAIN ] BOW: No existing data found, performing full refresh instead. [2025-10-02T17:44:30.999877] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-02T17:44:30.999921] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-02T17:44:30.999966] [DEBUG] [LOCAL ] BOW: No primary data file found to delete. [2025-10-02T17:44:31.000001] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-02T17:44:31.168936] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T17:44:31.205780] [INFO ] [REMOTE ] BOOT: Full fetch complete (60200 records). [2025-10-02T17:44:31.275117] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-02T17:44:31.475356] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-02T17:44:31.553881] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:31.905466] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-02T17:44:31.905611] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-02T17:44:31.906870] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-02T17:44:31.906963] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-02T17:44:31.908889] [DEBUG] [LOCAL ] BOOT: Trimmed 60200 records to 40795 (keeping 200 days of data) [2025-10-02T17:44:32.184160] [DEBUG] [LOCAL ] BOOT: Primary data saved (40795 records). [2025-10-02T17:44:32.184303] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-02T17:44:32.184425] [INFO ] [MAIN ] Update Progress: 323/2370 symbols completed. BOOT took 34.0s. Estimated remaining: 4h 41m 51s. Rate: 7.3 symbols/min [2025-10-02T17:44:32.280759] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-10-02T17:44:32.381977] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:44:32.382193] [DEBUG] [LOCAL ] BOX: No existing data file found in primary storage. [2025-10-02T17:44:32.382233] [WARN ] [MAIN ] BOX: No existing data found, performing full refresh instead. [2025-10-02T17:44:32.382354] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-02T17:44:32.382399] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-02T17:44:32.382442] [DEBUG] [LOCAL ] BOX: No primary data file found to delete. [2025-10-02T17:44:32.382477] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-02T17:44:32.765614] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T17:44:32.800360] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:32.803279] [INFO ] [REMOTE ] BOND: Full fetch complete (46484 records). [2025-10-02T17:44:32.803557] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-02T17:44:32.953957] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-10-02T17:44:33.087095] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-02T17:44:33.294943] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T17:44:33.329424] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-10-02T17:44:33.329522] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-10-02T17:44:33.330211] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-10-02T17:44:33.330282] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-10-02T17:44:33.331543] [DEBUG] [LOCAL ] BOND: Trimmed 46484 records to 32444 (keeping 200 days of data) [2025-10-02T17:44:33.550145] [DEBUG] [LOCAL ] BOND: Primary data saved (32444 records). [2025-10-02T17:44:33.550308] [INFO ] [MAIN ] BOND: Full history saved. [2025-10-02T17:44:33.550400] [INFO ] [MAIN ] Update Progress: 324/2370 symbols completed. BOND took 35.3s. Estimated remaining: 4h 40m 59s. Rate: 7.3 symbols/min [2025-10-02T17:44:33.743452] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:44:33.797887] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-10-02T17:44:33.798281] [INFO ] [MAIN ] BP: Loaded 53711 existing records. [2025-10-02T17:44:33.878150] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-02T17:44:33.992316] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:44:33.992546] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-02T17:44:33.992596] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-02T17:44:33.994082] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-02T17:44:33.994144] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-02T17:44:34.372578] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:34.653299] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T17:44:34.672980] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-02T17:44:34.925845] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T17:44:35.473059] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-10-02T17:44:36.273116] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-02T17:44:36.379305] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T17:44:37.073023] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-10-02T17:44:37.184745] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T17:44:37.305581] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T17:44:37.873025] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-02T17:44:38.673083] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-02T17:44:39.158790] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-02T17:44:39.219917] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T17:44:39.473067] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-02T17:44:40.273000] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-02T17:44:40.304119] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T17:44:40.942791] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T17:44:41.073048] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-02T17:44:41.873044] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-02T17:44:42.379277] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-02T17:44:42.672983] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-02T17:44:42.965607] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T17:44:43.094254] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T17:44:43.473067] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-02T17:44:43.885594] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T17:44:44.273049] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-02T17:44:45.073021] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-02T17:44:45.305716] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T17:44:45.873026] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-02T17:44:46.014042] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T17:44:46.049370] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T17:44:46.673031] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-02T17:44:47.473051] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-02T17:44:47.571692] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T17:44:48.273070] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-02T17:44:48.540252] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T17:44:48.741781] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-02T17:44:49.073056] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-02T17:44:49.827189] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T17:44:49.873014] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-02T17:44:50.001669] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:44:50.672982] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-02T17:44:50.813240] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T17:44:51.473075] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-02T17:44:52.272971] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-02T17:44:52.596112] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-02T17:44:52.729001] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T17:44:53.073036] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-02T17:44:53.872999] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-02T17:44:54.180488] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-02T17:44:54.672983] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-02T17:44:55.036193] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T17:44:55.472974] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-02T17:44:55.613825] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T17:44:55.615490] [INFO ] [REMOTE ] BOW: Full fetch complete (31552 records). [2025-10-02T17:44:55.615578] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-02T17:44:56.031229] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-02T17:44:56.031396] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-02T17:44:56.031962] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-02T17:44:56.032077] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-02T17:44:56.033286] [DEBUG] [LOCAL ] BOW: Trimmed 31552 records to 23861 (keeping 200 days of data) [2025-10-02T17:44:56.153854] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-02T17:44:56.224203] [DEBUG] [LOCAL ] BOW: Primary data saved (23861 records). [2025-10-02T17:44:56.224340] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-02T17:44:56.224426] [INFO ] [MAIN ] Update Progress: 325/2370 symbols completed. BOW took 25.4s. Estimated remaining: 4h 42m 21s. Rate: 7.2 symbols/min [2025-10-02T17:44:56.278212] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-02T17:44:56.419246] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:44:56.456277] [DEBUG] [LOCAL ] BR: Loaded 34667 existing records from primary storage. [2025-10-02T17:44:56.456695] [INFO ] [MAIN ] BR: Loaded 34667 existing records. [2025-10-02T17:44:56.653935] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:44:56.654139] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-02T17:44:56.654187] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-02T17:44:56.656916] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-02T17:44:56.656979] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-02T17:44:57.056897] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:44:57.072960] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-10-02T17:44:57.189703] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T17:44:57.873017] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-02T17:44:58.269468] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-02T17:44:58.592984] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T17:44:58.672974] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-02T17:44:59.473028] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-02T17:44:59.529933] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T17:45:00.151501] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T17:45:00.273046] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-02T17:45:01.073032] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-02T17:45:01.601404] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T17:45:01.873034] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-02T17:45:02.094222] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-02T17:45:02.673002] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-02T17:45:02.853901] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-02T17:45:02.856624] [INFO ] [REMOTE ] BORR: Full fetch complete (74650 records). [2025-10-02T17:45:02.856839] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-02T17:45:03.331410] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-02T17:45:03.331509] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-02T17:45:03.332348] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-02T17:45:03.332423] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-02T17:45:03.334069] [DEBUG] [LOCAL ] BORR: Trimmed 74650 records to 51498 (keeping 200 days of data) [2025-10-02T17:45:03.502095] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-02T17:45:03.674521] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:45:03.689499] [DEBUG] [LOCAL ] BORR: Primary data saved (51498 records). [2025-10-02T17:45:03.689870] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-02T17:45:03.689977] [INFO ] [MAIN ] Update Progress: 326/2370 symbols completed. BORR took 34.5s. Estimated remaining: 4h 42m 8s. Rate: 7.2 symbols/min [2025-10-02T17:45:03.882189] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:03.882407] [DEBUG] [LOCAL ] BRBR: No existing data file found in primary storage. [2025-10-02T17:45:03.882502] [WARN ] [MAIN ] BRBR: No existing data found, performing full refresh instead. [2025-10-02T17:45:03.882620] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-02T17:45:03.882723] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-02T17:45:03.882832] [DEBUG] [LOCAL ] BRBR: No primary data file found to delete. [2025-10-02T17:45:03.882882] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-02T17:45:04.286374] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-02T17:45:04.335462] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:04.338316] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T17:45:05.073001] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-10-02T17:45:05.598783] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-02T17:45:05.873032] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-02T17:45:06.226571] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T17:45:06.563595] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T17:45:06.673043] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-02T17:45:07.429768] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T17:45:07.473017] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-02T17:45:08.272974] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-02T17:45:08.366145] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T17:45:09.073035] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-02T17:45:09.774670] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-02T17:45:09.872986] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-02T17:45:09.969319] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T17:45:10.662007] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T17:45:10.672966] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-02T17:45:11.473010] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-02T17:45:11.803330] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T17:45:12.273012] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-02T17:45:12.404786] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T17:45:13.073724] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-02T17:45:13.076332] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T17:45:13.873027] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-02T17:45:14.494439] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-10-02T17:45:14.672970] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-02T17:45:14.775399] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T17:45:15.077729] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T17:45:15.080469] [INFO ] [REMOTE ] BOX: Full fetch complete (72070 records). [2025-10-02T17:45:15.080674] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-02T17:45:15.481600] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-02T17:45:15.539503] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-02T17:45:15.539587] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-02T17:45:15.540341] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-02T17:45:15.540491] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-02T17:45:15.547183] [DEBUG] [LOCAL ] BOX: Trimmed 72070 records to 50593 (keeping 200 days of data) [2025-10-02T17:45:15.871251] [DEBUG] [LOCAL ] BOX: Primary data saved (50593 records). [2025-10-02T17:45:15.871458] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-02T17:45:15.871598] [INFO ] [MAIN ] Update Progress: 327/2370 symbols completed. BOX took 43.7s. Estimated remaining: 4h 42m 24s. Rate: 7.2 symbols/min [2025-10-02T17:45:16.073801] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:16.094137] [DEBUG] [LOCAL ] BRC: Loaded 19040 existing records from primary storage. [2025-10-02T17:45:16.094420] [INFO ] [MAIN ] BRC: Loaded 19040 existing records. [2025-10-02T17:45:16.285690] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-02T17:45:16.292366] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:45:16.292668] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-02T17:45:16.293570] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-02T17:45:16.294377] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-02T17:45:16.294549] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-02T17:45:16.726592] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:16.763541] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-02T17:45:16.765847] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-10-02T17:45:16.766100] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-02T17:45:17.077622] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-10-02T17:45:17.241290] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T17:45:17.275969] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-02T17:45:17.276538] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-02T17:45:17.277901] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-02T17:45:17.278020] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-02T17:45:17.280240] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 54101 (keeping 200 days of data) [2025-10-02T17:45:17.666998] [DEBUG] [LOCAL ] BP: Primary data saved (54101 records). [2025-10-02T17:45:17.667262] [INFO ] [MAIN ] BP: Full history saved. [2025-10-02T17:45:17.667416] [INFO ] [MAIN ] Update Progress: 328/2370 symbols completed. BP took 44.1s. Estimated remaining: 4h 41m 35s. Rate: 7.3 symbols/min [2025-10-02T17:45:17.868278] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:17.883217] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-02T17:45:17.909026] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T17:45:17.967158] [DEBUG] [LOCAL ] BRCC: Loaded 40209 existing records from primary storage. [2025-10-02T17:45:17.967589] [INFO ] [MAIN ] BRCC: Loaded 40209 existing records. [2025-10-02T17:45:18.166300] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:45:18.166800] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-02T17:45:18.166883] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-02T17:45:18.168372] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-02T17:45:18.168449] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-02T17:45:18.516592] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T17:45:18.616595] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:18.673035] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-10-02T17:45:18.999978] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T17:45:19.473087] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-02T17:45:20.193413] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T17:45:20.273009] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-02T17:45:21.073028] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-02T17:45:21.220776] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T17:45:21.727938] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T17:45:21.872998] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-02T17:45:22.418851] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T17:45:22.673051] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-02T17:45:22.922872] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T17:45:23.473007] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-02T17:45:24.238136] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T17:45:24.272962] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-02T17:45:24.461279] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T17:45:25.073042] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-02T17:45:25.555351] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T17:45:25.872997] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-02T17:45:26.673048] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-02T17:45:26.890537] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T17:45:27.072636] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T17:45:27.473017] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-02T17:45:28.021503] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T17:45:28.273021] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-02T17:45:29.072998] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-02T17:45:29.385690] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T17:45:29.761282] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T17:45:29.873022] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-02T17:45:30.368439] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-02T17:45:30.673067] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-02T17:45:31.130237] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T17:45:31.473063] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-02T17:45:31.965482] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T17:45:31.967292] [INFO ] [REMOTE ] BR: Full fetch complete (49298 records). [2025-10-02T17:45:31.967381] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-02T17:45:32.278179] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-02T17:45:32.399873] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-02T17:45:32.399969] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-02T17:45:32.400662] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-02T17:45:32.400739] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-02T17:45:32.402506] [DEBUG] [LOCAL ] BR: Trimmed 49298 records to 34933 (keeping 200 days of data) [2025-10-02T17:45:32.642292] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T17:45:32.665904] [DEBUG] [LOCAL ] BR: Primary data saved (34933 records). [2025-10-02T17:45:32.666059] [INFO ] [MAIN ] BR: Full history saved. [2025-10-02T17:45:32.666151] [INFO ] [MAIN ] Update Progress: 329/2370 symbols completed. BR took 36.4s. Estimated remaining: 4h 42m 9s. Rate: 7.2 symbols/min [2025-10-02T17:45:32.851793] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:32.914337] [DEBUG] [LOCAL ] BRO: Loaded 51893 existing records from primary storage. [2025-10-02T17:45:32.914730] [INFO ] [MAIN ] BRO: Loaded 51893 existing records. [2025-10-02T17:45:33.079932] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-02T17:45:33.103360] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:45:33.104567] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-02T17:45:33.104622] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-02T17:45:33.105775] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-02T17:45:33.105875] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-02T17:45:33.506229] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:33.731960] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:45:33.872993] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-10-02T17:45:34.518816] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T17:45:34.524157] [INFO ] [REMOTE ] BRBR: Full fetch complete (72071 records). [2025-10-02T17:45:34.524301] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-02T17:45:34.686626] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-02T17:45:34.985625] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-02T17:45:34.985748] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-02T17:45:34.986571] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-02T17:45:34.986622] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-02T17:45:34.988225] [DEBUG] [LOCAL ] BRBR: Trimmed 72071 records to 51682 (keeping 200 days of data) [2025-10-02T17:45:35.319024] [DEBUG] [LOCAL ] BRBR: Primary data saved (51682 records). [2025-10-02T17:45:35.319215] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-02T17:45:35.319339] [INFO ] [MAIN ] Update Progress: 330/2370 symbols completed. BRBR took 31.6s. Estimated remaining: 4h 41m 26s. Rate: 7.2 symbols/min [2025-10-02T17:45:35.482589] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-02T17:45:35.513546] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:35.572261] [DEBUG] [LOCAL ] BROS: Loaded 53292 existing records from primary storage. [2025-10-02T17:45:35.572597] [INFO ] [MAIN ] BROS: Loaded 53292 existing records. [2025-10-02T17:45:35.771969] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:45:35.772364] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-02T17:45:35.772529] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-02T17:45:35.773794] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-02T17:45:35.773864] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-02T17:45:36.125397] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-02T17:45:36.215511] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:36.239396] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T17:45:36.272978] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-10-02T17:45:36.618180] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T17:45:37.073004] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-02T17:45:37.873027] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-02T17:45:38.526551] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-02T17:45:38.673005] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-02T17:45:38.837152] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T17:45:38.926450] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T17:45:39.473002] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-02T17:45:40.271991] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T17:45:40.281984] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-02T17:45:40.763923] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T17:45:41.073008] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-02T17:45:41.872976] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-02T17:45:42.020427] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T17:45:42.040515] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T17:45:42.673023] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-02T17:45:43.472979] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-02T17:45:43.553457] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T17:45:44.137872] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T17:45:44.273036] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-02T17:45:44.575306] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T17:45:45.073014] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-02T17:45:45.872986] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-02T17:45:45.974272] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T17:45:45.975492] [INFO ] [REMOTE ] BRC: Full fetch complete (29026 records). [2025-10-02T17:45:45.975590] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-02T17:45:46.405383] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-02T17:45:46.452758] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-02T17:45:46.453169] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-02T17:45:46.453623] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-02T17:45:46.453715] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-02T17:45:46.454432] [DEBUG] [LOCAL ] BRC: Trimmed 29026 records to 19152 (keeping 200 days of data) [2025-10-02T17:45:46.574757] [DEBUG] [LOCAL ] BRC: Primary data saved (19152 records). [2025-10-02T17:45:46.574904] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-02T17:45:46.574987] [INFO ] [MAIN ] Update Progress: 331/2370 symbols completed. BRC took 30.7s. Estimated remaining: 4h 41m 36s. Rate: 7.2 symbols/min [2025-10-02T17:45:46.678102] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-02T17:45:46.767850] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:46.768138] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-02T17:45:46.768198] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-02T17:45:46.768337] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-02T17:45:46.768381] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-02T17:45:46.768425] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-02T17:45:46.768459] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-02T17:45:47.175819] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:47.473021] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-10-02T17:45:47.667283] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:45:47.667605] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-10-02T17:45:47.667721] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:45:47.667792] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-02T17:45:47.667862] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:45:47.667941] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-02T17:45:47.668038] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-02T17:45:47.668114] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-02T17:45:47.668224] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-02T17:45:47.668310] [INFO ] [MAIN ] Update Progress: 332/2370 symbols completed. BRSL took 1.1s. Estimated remaining: 4h 40m 43s. Rate: 7.3 symbols/min [2025-10-02T17:45:47.894986] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:47.934724] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-02T17:45:47.978436] [DEBUG] [LOCAL ] BRSP: Loaded 36857 existing records from primary storage. [2025-10-02T17:45:47.979111] [INFO ] [MAIN ] BRSP: Loaded 36857 existing records. [2025-10-02T17:45:48.186164] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:45:48.186475] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-02T17:45:48.186540] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-02T17:45:48.196663] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-10-02T17:45:48.213776] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-02T17:45:48.291475] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T17:45:48.278687] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-02T17:45:48.626881] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:49.073044] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-02T17:45:49.872976] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-02T17:45:50.201036] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T17:45:50.673010] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-02T17:45:51.285697] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-02T17:45:51.472823] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T17:45:51.473021] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-02T17:45:52.272982] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-02T17:45:52.318517] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T17:45:53.073008] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-02T17:45:53.325729] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T17:45:53.614879] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T17:45:53.616518] [INFO ] [REMOTE ] BRCC: Full fetch complete (57689 records). [2025-10-02T17:45:53.616674] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-02T17:45:53.885341] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-02T17:45:54.025908] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-02T17:45:54.026064] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-02T17:45:54.027002] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-02T17:45:54.027087] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-02T17:45:54.028898] [DEBUG] [LOCAL ] BRCC: Trimmed 57689 records to 40474 (keeping 200 days of data) [2025-10-02T17:45:54.267074] [DEBUG] [LOCAL ] BRCC: Primary data saved (40474 records). [2025-10-02T17:45:54.267202] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-02T17:45:54.267295] [INFO ] [MAIN ] Update Progress: 333/2370 symbols completed. BRCC took 36.6s. Estimated remaining: 4h 40m 25s. Rate: 7.3 symbols/min [2025-10-02T17:45:54.447466] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:45:54.453931] [DEBUG] [LOCAL ] BRT: Loaded 4950 existing records from primary storage. [2025-10-02T17:45:54.454104] [INFO ] [MAIN ] BRT: Loaded 4950 existing records. [2025-10-02T17:45:54.648529] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:45:54.648826] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-02T17:45:54.648876] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-02T17:45:54.649166] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-02T17:45:54.649227] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-02T17:45:54.682717] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-10-02T17:45:55.048898] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:45:55.121050] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T17:45:55.472968] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-02T17:45:55.934933] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-10-02T17:45:56.258844] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T17:45:56.272958] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-02T17:45:57.072978] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-10-02T17:45:57.296705] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T17:45:57.550376] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-02T17:45:57.665493] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T17:45:57.873049] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-02T17:45:58.673047] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-02T17:45:59.148033] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T17:45:59.298078] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T17:45:59.473014] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-02T17:46:00.272987] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-02T17:46:01.073046] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-02T17:46:01.807918] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-10-02T17:46:01.873002] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-02T17:46:02.400760] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T17:46:02.601846] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:46:02.673003] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-02T17:46:02.891033] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-02T17:46:03.435564] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T17:46:03.472995] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-02T17:46:04.273041] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-02T17:46:04.898829] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T17:46:05.073031] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-02T17:46:05.763505] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T17:46:05.765552] [INFO ] [REMOTE ] BRO: Full fetch complete (74231 records). [2025-10-02T17:46:05.765691] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-02T17:46:05.881292] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-02T17:46:06.213685] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-02T17:46:06.214028] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-02T17:46:06.214876] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-02T17:46:06.214947] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-02T17:46:06.216476] [DEBUG] [LOCAL ] BRO: Trimmed 74231 records to 52266 (keeping 200 days of data) [2025-10-02T17:46:06.556228] [DEBUG] [LOCAL ] BRO: Primary data saved (52266 records). [2025-10-02T17:46:06.556373] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-02T17:46:06.556455] [INFO ] [MAIN ] Update Progress: 334/2370 symbols completed. BRO took 33.9s. Estimated remaining: 4h 40m 41s. Rate: 7.3 symbols/min [2025-10-02T17:46:06.673559] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-02T17:46:06.742144] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:46:06.742416] [DEBUG] [LOCAL ] BRW: No existing data file found in primary storage. [2025-10-02T17:46:06.742475] [WARN ] [MAIN ] BRW: No existing data found, performing full refresh instead. [2025-10-02T17:46:06.742666] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-02T17:46:06.742732] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-02T17:46:06.742789] [DEBUG] [LOCAL ] BRW: No primary data file found to delete. [2025-10-02T17:46:06.742831] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-02T17:46:07.151011] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:46:07.219859] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-02T17:46:07.477701] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-10-02T17:46:07.489882] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T17:46:07.502624] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-02T17:46:08.272987] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-02T17:46:08.947238] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T17:46:09.073008] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-02T17:46:09.246255] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T17:46:09.873007] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-02T17:46:10.087420] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T17:46:10.672992] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-02T17:46:11.472968] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-02T17:46:11.863670] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T17:46:12.053812] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-02T17:46:12.272980] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-02T17:46:12.880452] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T17:46:13.073072] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-02T17:46:13.872997] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-02T17:46:13.933842] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T17:46:13.936972] [INFO ] [REMOTE ] BROS: Full fetch complete (77047 records). [2025-10-02T17:46:13.937192] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-02T17:46:14.372732] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-02T17:46:14.372893] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-02T17:46:14.373810] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-02T17:46:14.373966] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-02T17:46:14.375707] [DEBUG] [LOCAL ] BROS: Trimmed 77047 records to 53681 (keeping 200 days of data) [2025-10-02T17:46:14.500968] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T17:46:14.703069] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-02T17:46:14.755598] [DEBUG] [LOCAL ] BROS: Primary data saved (53681 records). [2025-10-02T17:46:14.755759] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-02T17:46:14.755855] [INFO ] [MAIN ] Update Progress: 335/2370 symbols completed. BROS took 39.4s. Estimated remaining: 4h 40m 32s. Rate: 7.3 symbols/min [2025-10-02T17:46:14.962614] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:46:14.964362] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T17:46:15.021374] [DEBUG] [LOCAL ] BRX: Loaded 51713 existing records from primary storage. [2025-10-02T17:46:15.021826] [INFO ] [MAIN ] BRX: Loaded 51713 existing records. [2025-10-02T17:46:15.225491] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:46:15.225764] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-02T17:46:15.225820] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-02T17:46:15.227439] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-02T17:46:15.227521] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-02T17:46:15.478843] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-02T17:46:15.634259] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:46:15.889524] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T17:46:16.142902] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T17:46:16.273026] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-02T17:46:17.072995] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-02T17:46:17.227785] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T17:46:17.557802] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-02T17:46:17.873033] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-02T17:46:18.673035] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-02T17:46:18.854530] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-02T17:46:19.320660] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T17:46:19.473024] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-02T17:46:20.273023] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-02T17:46:20.523310] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T17:46:21.073023] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-02T17:46:21.416575] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T17:46:21.418115] [INFO ] [REMOTE ] BRSP: Full fetch complete (53950 records). [2025-10-02T17:46:21.418217] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-02T17:46:21.419084] [FATAL] [VALIDATOR ] BRSP: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:46:21.419177] [FATAL] [MAIN ] BRSP: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:46:21.419221] [WARN ] [MAIN ] BRSP: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:46:21.419287] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-02T17:46:21.419352] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-10-02T17:46:21.419387] [INFO ] [LOCAL ] BRSP: Starting deletion of derivative data. [2025-10-02T17:46:21.419809] [DEBUG] [LOCAL ] BRSP: Deleted derivative data file. [2025-10-02T17:46:21.420940] [INFO ] [MAIN ] Update Progress: 336/2370 symbols completed. BRSP took 33.8s. Estimated remaining: 4h 40m 14s. Rate: 7.3 symbols/min [2025-10-02T17:46:21.614808] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:46:21.615385] [DEBUG] [LOCAL ] BSAC: No existing data file found in primary storage. [2025-10-02T17:46:21.615578] [WARN ] [MAIN ] BSAC: No existing data found, performing full refresh instead. [2025-10-02T17:46:21.615786] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-02T17:46:21.615840] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-02T17:46:21.615885] [DEBUG] [LOCAL ] BSAC: No primary data file found to delete. [2025-10-02T17:46:21.615918] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-02T17:46:21.873421] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T17:46:21.883800] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-02T17:46:22.044889] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:46:22.611316] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-02T17:46:22.673008] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-02T17:46:23.387244] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:46:23.388481] [INFO ] [REMOTE ] BRT: Full fetch complete (6760 records). [2025-10-02T17:46:23.388622] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-02T17:46:23.389427] [FATAL] [VALIDATOR ] BRT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:46:23.389546] [FATAL] [MAIN ] BRT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:46:23.389616] [WARN ] [MAIN ] BRT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:46:23.389718] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-02T17:46:23.389844] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-10-02T17:46:23.389982] [INFO ] [LOCAL ] BRT: Starting deletion of derivative data. [2025-10-02T17:46:23.390285] [DEBUG] [LOCAL ] BRT: Deleted derivative data file. [2025-10-02T17:46:23.390389] [INFO ] [MAIN ] Update Progress: 337/2370 symbols completed. BRT took 29.1s. Estimated remaining: 4h 39m 28s. Rate: 7.3 symbols/min [2025-10-02T17:46:23.478364] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-10-02T17:46:23.674373] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:46:23.725990] [DEBUG] [LOCAL ] BSBR: Loaded 35400 existing records from primary storage. [2025-10-02T17:46:23.726493] [INFO ] [MAIN ] BSBR: Loaded 35400 existing records. [2025-10-02T17:46:24.042192] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:46:24.042491] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-02T17:46:24.042551] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-02T17:46:24.043835] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-10-02T17:46:24.043912] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-02T17:46:24.277872] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-02T17:46:24.546570] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:46:25.073045] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-10-02T17:46:25.337584] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T17:46:25.647451] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T17:46:25.873031] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-02T17:46:26.223809] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T17:46:26.673008] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-02T17:46:26.859197] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-02T17:46:27.472996] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-10-02T17:46:28.272994] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-02T17:46:28.384506] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T17:46:28.436430] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T17:46:28.961223] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T17:46:29.073020] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-02T17:46:29.873030] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-02T17:46:30.330549] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T17:46:30.673022] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-02T17:46:31.482047] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-02T17:46:31.490117] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T17:46:31.908238] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T17:46:32.272999] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-02T17:46:32.584340] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T17:46:33.073011] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-02T17:46:33.645731] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T17:46:33.873039] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-02T17:46:34.132849] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T17:46:34.134514] [INFO ] [REMOTE ] BRW: Full fetch complete (30373 records). [2025-10-02T17:46:34.134598] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-02T17:46:34.556708] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-02T17:46:34.556804] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-02T17:46:34.557275] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-02T17:46:34.557320] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-02T17:46:34.558303] [DEBUG] [LOCAL ] BRW: Trimmed 30373 records to 20369 (keeping 200 days of data) [2025-10-02T17:46:34.673959] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-02T17:46:34.693636] [DEBUG] [LOCAL ] BRW: Primary data saved (20369 records). [2025-10-02T17:46:34.693810] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-02T17:46:34.693900] [INFO ] [MAIN ] Update Progress: 338/2370 symbols completed. BRW took 28.1s. Estimated remaining: 4h 39m 38s. Rate: 7.3 symbols/min [2025-10-02T17:46:34.900997] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:46:34.911963] [DEBUG] [LOCAL ] BSL: Loaded 8243 existing records from primary storage. [2025-10-02T17:46:34.912394] [INFO ] [MAIN ] BSL: Loaded 8243 existing records. [2025-10-02T17:46:35.109055] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:46:35.109352] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-02T17:46:35.109535] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-02T17:46:35.110185] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-10-02T17:46:35.110249] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-02T17:46:35.267790] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:46:35.485154] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-02T17:46:35.529877] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:46:36.273023] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-10-02T17:46:36.549156] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T17:46:36.905432] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T17:46:37.072967] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-02T17:46:37.388473] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T17:46:37.873049] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-02T17:46:38.363658] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-02T17:46:38.673008] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-02T17:46:38.972513] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T17:46:39.473063] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-02T17:46:39.840184] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-02T17:46:40.273010] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-02T17:46:41.073367] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T17:46:41.073451] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-02T17:46:41.658228] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T17:46:41.872990] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-02T17:46:42.396626] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T17:46:42.673001] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-02T17:46:43.463077] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T17:46:43.473184] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-02T17:46:43.986274] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T17:46:44.272960] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-02T17:46:44.374871] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T17:46:45.073041] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-02T17:46:45.681031] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:46:45.741688] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-02T17:46:45.873019] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-02T17:46:46.673027] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-02T17:46:47.473019] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-02T17:46:47.651573] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T17:46:47.685544] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-02T17:46:48.273000] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-02T17:46:48.488918] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T17:46:49.073020] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-02T17:46:49.719062] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T17:46:49.873001] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-02T17:46:50.352576] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T17:46:50.672984] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-02T17:46:50.752547] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T17:46:51.473030] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-02T17:46:52.089621] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T17:46:52.097292] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-02T17:46:52.272983] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-02T17:46:53.073001] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-02T17:46:53.386540] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T17:46:53.388217] [INFO ] [REMOTE ] BSAC: Full fetch complete (43902 records). [2025-10-02T17:46:53.388341] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-02T17:46:53.603408] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T17:46:53.835329] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-02T17:46:53.835409] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-02T17:46:53.835953] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-02T17:46:53.836025] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-02T17:46:53.837058] [DEBUG] [LOCAL ] BSAC: Trimmed 43902 records to 33243 (keeping 200 days of data) [2025-10-02T17:46:53.888924] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-02T17:46:54.043867] [DEBUG] [LOCAL ] BSAC: Primary data saved (33243 records). [2025-10-02T17:46:54.044022] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-02T17:46:54.044098] [INFO ] [MAIN ] Update Progress: 339/2370 symbols completed. BSAC took 32.6s. Estimated remaining: 4h 40m 37s. Rate: 7.2 symbols/min [2025-10-02T17:46:54.229612] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:46:54.264357] [DEBUG] [LOCAL ] BSM: Loaded 32181 existing records from primary storage. [2025-10-02T17:46:54.264707] [INFO ] [MAIN ] BSM: Loaded 32181 existing records. [2025-10-02T17:46:54.469217] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:46:54.469469] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-02T17:46:54.469520] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-02T17:46:54.470498] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-10-02T17:46:54.470559] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-02T17:46:54.683048] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-02T17:46:54.870338] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:46:55.473029] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-02T17:46:55.639861] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T17:46:56.244826] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T17:46:56.271359] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T17:46:56.273008] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-02T17:46:57.073028] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-10-02T17:46:57.834766] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T17:46:57.872965] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-02T17:46:58.630759] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T17:46:58.672987] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-02T17:46:59.251662] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T17:46:59.253742] [INFO ] [REMOTE ] BRX: Full fetch complete (74907 records). [2025-10-02T17:46:59.253876] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-02T17:46:59.479075] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-02T17:46:59.721320] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-02T17:46:59.721425] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-02T17:46:59.722212] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-02T17:46:59.722279] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-02T17:46:59.723798] [DEBUG] [LOCAL ] BRX: Trimmed 74907 records to 52084 (keeping 200 days of data) [2025-10-02T17:47:00.001599] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T17:47:00.084819] [DEBUG] [LOCAL ] BRX: Primary data saved (52084 records). [2025-10-02T17:47:00.084965] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-02T17:47:00.085052] [INFO ] [MAIN ] Update Progress: 340/2370 symbols completed. BRX took 45.3s. Estimated remaining: 4h 40m 15s. Rate: 7.2 symbols/min [2025-10-02T17:47:00.264762] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:00.265002] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-10-02T17:47:00.265086] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-10-02T17:47:00.265236] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-02T17:47:00.265280] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-02T17:47:00.265328] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-02T17:47:00.265368] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-02T17:47:00.278459] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-02T17:47:00.647889] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:01.072998] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-02T17:47:01.311555] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T17:47:01.361256] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T17:47:01.873009] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-02T17:47:02.492991] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T17:47:02.673007] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-02T17:47:02.725180] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T17:47:03.311085] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T17:47:03.311934] [INFO ] [REMOTE ] BSL: Full fetch complete (12656 records). [2025-10-02T17:47:03.312005] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-02T17:47:03.312475] [FATAL] [VALIDATOR ] BSL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:47:03.312593] [FATAL] [MAIN ] BSL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:47:03.312638] [WARN ] [MAIN ] BSL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:47:03.312740] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-02T17:47:03.312816] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-02T17:47:03.312861] [INFO ] [LOCAL ] BSL: Starting deletion of derivative data. [2025-10-02T17:47:03.313149] [DEBUG] [LOCAL ] BSL: Deleted derivative data file. [2025-10-02T17:47:03.313251] [INFO ] [MAIN ] Update Progress: 341/2370 symbols completed. BSL took 28.6s. Estimated remaining: 4h 39m 36s. Rate: 7.3 symbols/min [2025-10-02T17:47:03.478162] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-02T17:47:03.533115] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:03.533305] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-10-02T17:47:03.533350] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-10-02T17:47:03.533460] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-02T17:47:03.533503] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-02T17:47:03.533547] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-02T17:47:03.533581] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-02T17:47:03.924705] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:04.273022] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-02T17:47:04.721420] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T17:47:04.723792] [INFO ] [REMOTE ] BSBR: Full fetch complete (50688 records). [2025-10-02T17:47:04.723922] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-02T17:47:05.078141] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-10-02T17:47:05.157177] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-02T17:47:05.157282] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-02T17:47:05.158133] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-02T17:47:05.158208] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-02T17:47:05.159588] [DEBUG] [LOCAL ] BSBR: Trimmed 50688 records to 35696 (keeping 200 days of data) [2025-10-02T17:47:05.375418] [DEBUG] [LOCAL ] BSBR: Primary data saved (35696 records). [2025-10-02T17:47:05.375601] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-02T17:47:05.375786] [INFO ] [MAIN ] Update Progress: 342/2370 symbols completed. BSBR took 42.0s. Estimated remaining: 4h 38m 51s. Rate: 7.3 symbols/min [2025-10-02T17:47:05.563494] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:05.563681] [DEBUG] [LOCAL ] BSX: No existing data file found in primary storage. [2025-10-02T17:47:05.563737] [WARN ] [MAIN ] BSX: No existing data found, performing full refresh instead. [2025-10-02T17:47:05.563848] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-02T17:47:05.563897] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-02T17:47:05.563941] [DEBUG] [LOCAL ] BSX: No primary data file found to delete. [2025-10-02T17:47:05.563975] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-02T17:47:05.853504] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T17:47:05.873247] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-10-02T17:47:05.989466] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:06.588983] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T17:47:06.672985] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-02T17:47:07.102975] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T17:47:07.473017] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-02T17:47:07.605305] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T17:47:08.273004] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-02T17:47:08.712890] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T17:47:09.003853] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T17:47:09.072993] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-02T17:47:09.872967] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-10-02T17:47:10.212592] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T17:47:10.673023] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-02T17:47:11.472967] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-02T17:47:11.662569] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T17:47:12.130560] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T17:47:12.273041] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-02T17:47:12.602685] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-02T17:47:13.073069] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-02T17:47:13.872974] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-02T17:47:14.107627] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T17:47:14.254606] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T17:47:14.566732] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-02T17:47:14.673027] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-02T17:47:15.473029] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-02T17:47:15.915373] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T17:47:16.272978] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-02T17:47:16.490009] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T17:47:17.073069] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-02T17:47:17.873026] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-02T17:47:17.954805] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T17:47:18.560395] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T17:47:18.673023] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-02T17:47:19.017415] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T17:47:19.473012] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-02T17:47:19.898049] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-02T17:47:20.272981] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-02T17:47:21.014720] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T17:47:21.081466] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-02T17:47:21.083031] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T17:47:21.872983] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-02T17:47:22.113697] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:47:22.673001] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-02T17:47:23.472991] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-02T17:47:23.964973] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T17:47:24.138419] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T17:47:24.272983] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-02T17:47:24.613140] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T17:47:25.073004] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-02T17:47:25.873000] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-02T17:47:26.035690] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:47:26.148960] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T17:47:26.150150] [INFO ] [REMOTE ] BSM: Full fetch complete (47249 records). [2025-10-02T17:47:26.150260] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-02T17:47:26.150981] [FATAL] [VALIDATOR ] BSM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:47:26.151072] [FATAL] [MAIN ] BSM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:47:26.151119] [WARN ] [MAIN ] BSM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:47:26.151186] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-02T17:47:26.151267] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-02T17:47:26.151324] [INFO ] [LOCAL ] BSM: Starting deletion of derivative data. [2025-10-02T17:47:26.151607] [DEBUG] [LOCAL ] BSM: Deleted derivative data file. [2025-10-02T17:47:26.151904] [INFO ] [MAIN ] Update Progress: 343/2370 symbols completed. BSM took 32.1s. Estimated remaining: 4h 39m 57s. Rate: 7.2 symbols/min [2025-10-02T17:47:26.340699] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:26.349608] [DEBUG] [LOCAL ] BTA: Loaded 5410 existing records from primary storage. [2025-10-02T17:47:26.349921] [INFO ] [MAIN ] BTA: Loaded 5410 existing records. [2025-10-02T17:47:26.553281] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:47:26.553506] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-02T17:47:26.553567] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-02T17:47:26.553987] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-02T17:47:26.554049] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-02T17:47:26.678120] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-02T17:47:26.961378] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:26.972947] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T17:47:27.473030] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-10-02T17:47:28.272854] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T17:47:28.273005] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-02T17:47:28.328929] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T17:47:29.072977] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-02T17:47:29.446483] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:47:29.873039] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-02T17:47:30.356048] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-02T17:47:30.640360] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T17:47:30.673040] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-02T17:47:31.473010] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-02T17:47:31.689101] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T17:47:32.280446] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-02T17:47:32.283529] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T17:47:33.073026] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-02T17:47:33.460536] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:47:33.873004] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-02T17:47:33.880963] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T17:47:33.882126] [INFO ] [REMOTE ] BST: Full fetch complete (28666 records). [2025-10-02T17:47:33.882239] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-02T17:47:33.883350] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:47:33.883460] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:47:33.883528] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:47:33.883695] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-02T17:47:33.883798] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-02T17:47:33.883858] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-10-02T17:47:33.883907] [DEBUG] [LOCAL ] BST: No derivative data file found to delete. [2025-10-02T17:47:33.883982] [INFO ] [MAIN ] Update Progress: 344/2370 symbols completed. BST took 33.8s. Estimated remaining: 4h 39m 46s. Rate: 7.2 symbols/min [2025-10-02T17:47:34.084046] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:34.084241] [DEBUG] [LOCAL ] BTCM: No existing data file found in primary storage. [2025-10-02T17:47:34.084283] [WARN ] [MAIN ] BTCM: No existing data found, performing full refresh instead. [2025-10-02T17:47:34.084439] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-10-02T17:47:34.084483] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-10-02T17:47:34.084527] [DEBUG] [LOCAL ] BTCM: No primary data file found to delete. [2025-10-02T17:47:34.084675] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-10-02T17:47:34.506215] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:34.513247] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T17:47:34.673016] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-02T17:47:35.473022] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-10-02T17:47:36.272983] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-02T17:47:36.569193] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T17:47:36.769686] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T17:47:37.073006] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-10-02T17:47:37.872985] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-02T17:47:37.916377] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T17:47:38.072020] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T17:47:38.660000] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-02T17:47:38.673007] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-02T17:47:39.473025] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-02T17:47:39.687763] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T17:47:39.688972] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36552 records). [2025-10-02T17:47:39.689057] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-02T17:47:39.689719] [FATAL] [VALIDATOR ] BSTZ: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:47:39.689816] [FATAL] [MAIN ] BSTZ: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:47:39.689869] [WARN ] [MAIN ] BSTZ: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:47:39.689918] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-02T17:47:39.689984] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-10-02T17:47:39.690023] [INFO ] [LOCAL ] BSTZ: Starting deletion of derivative data. [2025-10-02T17:47:39.690071] [DEBUG] [LOCAL ] BSTZ: No derivative data file found to delete. [2025-10-02T17:47:39.690148] [INFO ] [MAIN ] Update Progress: 345/2370 symbols completed. BSTZ took 36.4s. Estimated remaining: 4h 39m 23s. Rate: 7.2 symbols/min [2025-10-02T17:47:39.871734] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:39.926672] [DEBUG] [LOCAL ] BTE: Loaded 52720 existing records from primary storage. [2025-10-02T17:47:39.926993] [INFO ] [MAIN ] BTE: Loaded 52720 existing records. [2025-10-02T17:47:40.124626] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:47:40.124905] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-02T17:47:40.124965] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-02T17:47:40.128718] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-02T17:47:40.128781] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-02T17:47:40.278096] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-10-02T17:47:40.507698] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:41.055230] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T17:47:41.072951] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-10-02T17:47:41.151215] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T17:47:41.687309] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-02T17:47:41.873042] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-10-02T17:47:42.593870] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T17:47:42.672999] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-02T17:47:43.473027] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-10-02T17:47:44.195864] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T17:47:44.272974] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-10-02T17:47:44.461683] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T17:47:45.072981] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-02T17:47:45.872980] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-10-02T17:47:46.204176] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T17:47:46.459276] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T17:47:46.672986] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-02T17:47:46.840160] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T17:47:47.106785] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-02T17:47:47.472991] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-02T17:47:47.982290] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T17:47:48.273027] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-10-02T17:47:49.073040] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-02T17:47:49.873033] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-02T17:47:50.126443] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T17:47:50.673009] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-02T17:47:50.747332] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T17:47:51.286299] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T17:47:51.381118] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T17:47:51.383185] [INFO ] [REMOTE ] BSX: Full fetch complete (77697 records). [2025-10-02T17:47:51.383334] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-02T17:47:51.478197] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-10-02T17:47:51.836143] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-02T17:47:51.836241] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-02T17:47:51.837611] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-02T17:47:51.837718] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-02T17:47:51.839726] [DEBUG] [LOCAL ] BSX: Trimmed 77697 records to 54078 (keeping 200 days of data) [2025-10-02T17:47:52.176209] [DEBUG] [LOCAL ] BSX: Primary data saved (54078 records). [2025-10-02T17:47:52.176345] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-02T17:47:52.176420] [INFO ] [MAIN ] Update Progress: 346/2370 symbols completed. BSX took 46.8s. Estimated remaining: 4h 39m 39s. Rate: 7.2 symbols/min [2025-10-02T17:47:52.278106] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-02T17:47:52.384064] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:52.445081] [DEBUG] [LOCAL ] BTI: Loaded 53556 existing records from primary storage. [2025-10-02T17:47:52.445529] [INFO ] [MAIN ] BTI: Loaded 53556 existing records. [2025-10-02T17:47:52.656745] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:47:52.656985] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-02T17:47:52.657043] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-02T17:47:52.661322] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-02T17:47:52.661405] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-02T17:47:52.994868] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-02T17:47:53.078311] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-02T17:47:53.100278] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T17:47:53.107975] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:53.791410] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T17:47:53.873000] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-10-02T17:47:54.673009] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-02T17:47:55.123247] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T17:47:55.124082] [INFO ] [REMOTE ] BTA: Full fetch complete (9456 records). [2025-10-02T17:47:55.124174] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-02T17:47:55.124605] [FATAL] [VALIDATOR ] BTA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:47:55.124714] [FATAL] [MAIN ] BTA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:47:55.124761] [WARN ] [MAIN ] BTA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:47:55.124830] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-02T17:47:55.124897] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-10-02T17:47:55.124933] [INFO ] [LOCAL ] BTA: Starting deletion of derivative data. [2025-10-02T17:47:55.125486] [DEBUG] [LOCAL ] BTA: Deleted derivative data file. [2025-10-02T17:47:55.125614] [INFO ] [MAIN ] Update Progress: 347/2370 symbols completed. BTA took 29.0s. Estimated remaining: 4h 38m 60s. Rate: 7.3 symbols/min [2025-10-02T17:47:55.313162] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:55.325122] [DEBUG] [LOCAL ] BTO: Loaded 8767 existing records from primary storage. [2025-10-02T17:47:55.325347] [INFO ] [MAIN ] BTO: Loaded 8767 existing records. [2025-10-02T17:47:55.488884] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-10-02T17:47:55.534548] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:47:55.534788] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-02T17:47:55.534839] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-02T17:47:55.536332] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-02T17:47:55.536396] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-02T17:47:55.933377] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:47:55.965844] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-02T17:47:56.273051] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-02T17:47:56.836094] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T17:47:57.072998] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-10. [2025-10-02T17:47:57.872990] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-10-02T17:47:58.288681] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-02T17:47:58.523886] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T17:47:58.525557] [INFO ] [REMOTE ] BTCM: Full fetch complete (19363 records). [2025-10-02T17:47:58.525703] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-10-02T17:47:58.678105] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-02T17:47:58.979615] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-10-02T17:47:58.979866] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-10-02T17:47:58.980955] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T17:47:58.980705] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-10-02T17:47:58.983412] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-10-02T17:47:58.984881] [DEBUG] [LOCAL ] BTCM: Trimmed 19363 records to 15505 (keeping 200 days of data) [2025-10-02T17:47:59.086174] [DEBUG] [LOCAL ] BTCM: Primary data saved (15505 records). [2025-10-02T17:47:59.086317] [INFO ] [MAIN ] BTCM: Full history saved. [2025-10-02T17:47:59.086392] [INFO ] [MAIN ] Update Progress: 348/2370 symbols completed. BTCM took 25.2s. Estimated remaining: 4h 38m 26s. Rate: 7.3 symbols/min [2025-10-02T17:47:59.268877] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:47:59.269095] [DEBUG] [LOCAL ] BTT: No existing data file found in primary storage. [2025-10-02T17:47:59.269151] [WARN ] [MAIN ] BTT: No existing data found, performing full refresh instead. [2025-10-02T17:47:59.269293] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-02T17:47:59.269358] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-02T17:47:59.269407] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-02T17:47:59.269442] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-02T17:47:59.478125] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-02T17:47:59.683928] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:00.247373] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T17:48:00.272968] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-10-02T17:48:01.072995] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-02T17:48:01.836138] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T17:48:01.872973] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-02T17:48:01.980156] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-10-02T17:48:02.672982] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-02T17:48:02.809763] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T17:48:03.005462] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T17:48:03.310287] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-02T17:48:03.473003] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-02T17:48:04.273003] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-02T17:48:04.393049] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T17:48:05.072993] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-02T17:48:05.742826] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T17:48:05.872978] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-02T17:48:06.092129] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:48:06.672971] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-02T17:48:06.735576] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T17:48:07.472994] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-02T17:48:08.022922] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-02T17:48:08.262694] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T17:48:08.272960] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-02T17:48:08.921539] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T17:48:09.073046] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-02T17:48:09.872986] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-02T17:48:10.030889] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T17:48:10.673015] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-02T17:48:11.472969] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-02T17:48:11.587460] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T17:48:11.833286] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T17:48:12.273068] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-02T17:48:12.310108] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T17:48:13.073005] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-02T17:48:13.680182] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T17:48:13.873030] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-02T17:48:13.964343] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T17:48:14.673031] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-02T17:48:15.473017] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-02T17:48:15.861390] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-02T17:48:16.052899] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T17:48:16.053880] [INFO ] [REMOTE ] BTO: Full fetch complete (13254 records). [2025-10-02T17:48:16.053959] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-02T17:48:16.281366] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-02T17:48:16.476347] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-02T17:48:16.476549] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-02T17:48:16.476983] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-02T17:48:16.477047] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-02T17:48:16.477567] [DEBUG] [LOCAL ] BTO: Trimmed 13254 records to 8811 (keeping 200 days of data) [2025-10-02T17:48:16.540021] [DEBUG] [LOCAL ] BTO: Primary data saved (8811 records). [2025-10-02T17:48:16.540278] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-02T17:48:16.540427] [INFO ] [MAIN ] Update Progress: 349/2370 symbols completed. BTO took 21.4s. Estimated remaining: 4h 39m 11s. Rate: 7.2 symbols/min [2025-10-02T17:48:16.711429] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-02T17:48:16.783395] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:16.850612] [DEBUG] [LOCAL ] BTU: Loaded 53311 existing records from primary storage. [2025-10-02T17:48:16.851007] [INFO ] [MAIN ] BTU: Loaded 53311 existing records. [2025-10-02T17:48:17.042069] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:48:17.042368] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-02T17:48:17.042479] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-02T17:48:17.044682] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-02T17:48:17.044767] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-02T17:48:17.079124] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-02T17:48:17.256609] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T17:48:17.470955] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:17.873004] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-02T17:48:18.672978] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-10-02T17:48:18.699919] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-02T17:48:18.702331] [INFO ] [REMOTE ] BTE: Full fetch complete (76053 records). [2025-10-02T17:48:18.702446] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-02T17:48:19.066157] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T17:48:19.175830] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-02T17:48:19.175928] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-02T17:48:19.177091] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-02T17:48:19.177180] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-02T17:48:19.178756] [DEBUG] [LOCAL ] BTE: Trimmed 76053 records to 53107 (keeping 200 days of data) [2025-10-02T17:48:19.474895] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-02T17:48:19.518995] [DEBUG] [LOCAL ] BTE: Primary data saved (53107 records). [2025-10-02T17:48:19.519182] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-02T17:48:19.519274] [INFO ] [MAIN ] Update Progress: 350/2370 symbols completed. BTE took 39.8s. Estimated remaining: 4h 38m 32s. Rate: 7.3 symbols/min [2025-10-02T17:48:19.706871] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:19.707099] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-02T17:48:19.707142] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-02T17:48:19.707286] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-02T17:48:19.707337] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-02T17:48:19.707388] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-02T17:48:19.707422] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-02T17:48:20.093380] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:20.272970] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-10-02T17:48:20.474905] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:48:20.475212] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-10-02T17:48:20.475301] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:48:20.475354] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-02T17:48:20.475416] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:48:20.475490] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-02T17:48:20.475559] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-02T17:48:20.475602] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-02T17:48:20.475723] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-02T17:48:20.475798] [INFO ] [MAIN ] Update Progress: 351/2370 symbols completed. BTX took 1.0s. Estimated remaining: 4h 37m 42s. Rate: 7.3 symbols/min [2025-10-02T17:48:20.680215] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:20.680444] [DEBUG] [LOCAL ] BTZ: No existing data file found in primary storage. [2025-10-02T17:48:20.680540] [WARN ] [MAIN ] BTZ: No existing data found, performing full refresh instead. [2025-10-02T17:48:20.680727] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-02T17:48:20.680842] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-02T17:48:20.680978] [DEBUG] [LOCAL ] BTZ: No primary data file found to delete. [2025-10-02T17:48:20.681049] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-02T17:48:20.842834] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-10-02T17:48:21.078102] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-02T17:48:21.148084] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:21.767478] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-02T17:48:21.873029] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-10-02T17:48:22.118472] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-02T17:48:22.673043] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-02T17:48:23.184134] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T17:48:23.473043] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-02T17:48:23.771564] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T17:48:24.273020] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-02T17:48:25.073066] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-02T17:48:25.259786] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T17:48:25.873056] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-02T17:48:26.126172] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T17:48:26.458990] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T17:48:26.673008] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-02T17:48:26.936906] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T17:48:27.364053] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T17:48:27.473050] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-02T17:48:28.273014] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-02T17:48:28.416930] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-02T17:48:29.072972] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-02T17:48:29.138412] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T17:48:29.873025] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-02T17:48:29.884554] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T17:48:29.885634] [INFO ] [REMOTE ] BTT: Full fetch complete (24027 records). [2025-10-02T17:48:29.885746] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-02T17:48:29.886451] [FATAL] [VALIDATOR ] BTT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:48:29.886562] [FATAL] [MAIN ] BTT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:48:29.886802] [WARN ] [MAIN ] BTT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:48:29.886904] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-02T17:48:29.886981] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-10-02T17:48:29.887019] [INFO ] [LOCAL ] BTT: Starting deletion of derivative data. [2025-10-02T17:48:29.887059] [DEBUG] [LOCAL ] BTT: No derivative data file found to delete. [2025-10-02T17:48:29.887199] [INFO ] [MAIN ] Update Progress: 352/2370 symbols completed. BTT took 30.8s. Estimated remaining: 4h 37m 40s. Rate: 7.3 symbols/min [2025-10-02T17:48:30.074538] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:30.137924] [DEBUG] [LOCAL ] BUD: Loaded 52716 existing records from primary storage. [2025-10-02T17:48:30.138390] [INFO ] [MAIN ] BUD: Loaded 52716 existing records. [2025-10-02T17:48:30.342527] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:48:30.342799] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-02T17:48:30.342892] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-02T17:48:30.344755] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-02T17:48:30.344825] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-02T17:48:30.673240] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-02T17:48:30.760748] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:31.473041] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-02T17:48:32.272977] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-10-02T17:48:32.451552] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T17:48:32.541190] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T17:48:33.073016] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-02T17:48:33.873059] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-02T17:48:34.547874] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-10-02T17:48:34.673054] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-02T17:48:34.743768] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T17:48:35.086664] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T17:48:35.473057] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-02T17:48:36.273013] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-02T17:48:36.626460] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (6.75 seconds). [2025-10-02T17:48:36.670790] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-02T17:48:37.073042] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-02T17:48:37.399639] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:48:37.693410] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-10-02T17:48:37.873014] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-02T17:48:38.672976] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-02T17:48:39.027297] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T17:48:39.106160] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T17:48:39.472991] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-02T17:48:40.272987] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-02T17:48:40.807452] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T17:48:41.073019] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-02T17:48:41.520771] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T17:48:41.872964] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-02T17:48:41.909173] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T17:48:42.672974] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-02T17:48:42.781816] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T17:48:43.473039] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-02T17:48:43.753190] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T17:48:43.798332] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T17:48:44.273002] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-02T17:48:45.073020] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-02T17:48:45.442856] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:48:45.872998] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-02T17:48:46.059328] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-02T17:48:46.673015] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-02T17:48:46.804699] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-02T17:48:46.807197] [INFO ] [REMOTE ] BTI: Full fetch complete (77448 records). [2025-10-02T17:48:46.807352] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-02T17:48:47.185564] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T17:48:47.330770] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-02T17:48:47.330865] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-02T17:48:47.331671] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-02T17:48:47.331739] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-02T17:48:47.333221] [DEBUG] [LOCAL ] BTI: Trimmed 77448 records to 53946 (keeping 200 days of data) [2025-10-02T17:48:47.522484] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-02T17:48:47.682365] [DEBUG] [LOCAL ] BTI: Primary data saved (53946 records). [2025-10-02T17:48:47.682532] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-02T17:48:47.682632] [INFO ] [MAIN ] Update Progress: 353/2370 symbols completed. BTI took 55.5s. Estimated remaining: 4h 38m 27s. Rate: 7.2 symbols/min [2025-10-02T17:48:47.866293] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:47.866461] [DEBUG] [LOCAL ] BUI: No existing data file found in primary storage. [2025-10-02T17:48:47.866499] [WARN ] [MAIN ] BUI: No existing data found, performing full refresh instead. [2025-10-02T17:48:47.866679] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-02T17:48:47.866733] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-02T17:48:47.866776] [DEBUG] [LOCAL ] BUI: No primary data file found to delete. [2025-10-02T17:48:47.866809] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-02T17:48:48.251375] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:48.273029] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-02T17:48:48.479032] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T17:48:48.481582] [INFO ] [REMOTE ] BTZ: Full fetch complete (33894 records). [2025-10-02T17:48:48.481821] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-02T17:48:48.714043] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-10-02T17:48:48.959790] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-02T17:48:48.959961] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-02T17:48:48.960769] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-02T17:48:48.960842] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-02T17:48:48.961937] [DEBUG] [LOCAL ] BTZ: Trimmed 33894 records to 22996 (keeping 200 days of data) [2025-10-02T17:48:49.074707] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-02T17:48:49.112596] [DEBUG] [LOCAL ] BTZ: Primary data saved (22996 records). [2025-10-02T17:48:49.112805] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-02T17:48:49.112895] [INFO ] [MAIN ] Update Progress: 354/2370 symbols completed. BTZ took 28.6s. Estimated remaining: 4h 37m 39s. Rate: 7.3 symbols/min [2025-10-02T17:48:49.318887] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:49.363623] [DEBUG] [LOCAL ] BUR: Loaded 45140 existing records from primary storage. [2025-10-02T17:48:49.363986] [INFO ] [MAIN ] BUR: Loaded 45140 existing records. [2025-10-02T17:48:49.565552] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:48:49.565850] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-02T17:48:49.565911] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-02T17:48:49.567948] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-02T17:48:49.568045] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-02T17:48:49.885030] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-10-02T17:48:49.978136] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:48:50.010994] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T17:48:50.672973] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-02T17:48:50.827443] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-02T17:48:51.079329] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-02T17:48:51.473015] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-10-02T17:48:52.255374] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T17:48:52.272964] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-02T17:48:52.984001] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T17:48:53.073052] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-02T17:48:53.639587] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T17:48:53.872988] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-02T17:48:54.086240] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T17:48:54.673023] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-02T17:48:55.224471] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T17:48:55.473004] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-02T17:48:56.272982] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-02T17:48:56.318003] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T17:48:57.038985] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T17:48:57.073062] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-02T17:48:57.112144] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-02T17:48:57.872988] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-02T17:48:58.505083] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-02T17:48:58.672998] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-02T17:48:58.687285] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-02T17:48:58.689548] [INFO ] [REMOTE ] BTU: Full fetch complete (76564 records). [2025-10-02T17:48:58.689721] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-02T17:48:58.690693] [FATAL] [VALIDATOR ] BTU: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:48:58.690807] [FATAL] [MAIN ] BTU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:48:58.690876] [WARN ] [MAIN ] BTU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:48:58.690964] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-02T17:48:58.691096] [DEBUG] [LOCAL ] BTU: No primary data file found to delete. [2025-10-02T17:48:58.691174] [INFO ] [LOCAL ] BTU: Starting deletion of derivative data. [2025-10-02T17:48:58.691840] [DEBUG] [LOCAL ] BTU: Deleted derivative data file. [2025-10-02T17:48:58.691970] [INFO ] [MAIN ] Update Progress: 355/2370 symbols completed. BTU took 42.2s. Estimated remaining: 4h 37m 39s. Rate: 7.3 symbols/min [2025-10-02T17:48:58.893757] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:48:58.942462] [DEBUG] [LOCAL ] BURL: Loaded 45991 existing records from primary storage. [2025-10-02T17:48:58.942843] [INFO ] [MAIN ] BURL: Loaded 45991 existing records. [2025-10-02T17:48:59.136281] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:48:59.136517] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-02T17:48:59.136568] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-02T17:48:59.138900] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-02T17:48:59.138972] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-02T17:48:59.480472] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-02T17:48:59.524678] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:49:00.272998] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-02T17:49:00.319416] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T17:49:01.023717] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-02T17:49:01.072992] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-02T17:49:01.579352] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T17:49:01.873060] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-10-02T17:49:01.988767] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T17:49:02.672999] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-02T17:49:03.472976] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-02T17:49:03.730977] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T17:49:03.749401] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-02T17:49:04.273041] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-02T17:49:05.073035] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-02T17:49:05.522785] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-02T17:49:05.872981] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-02T17:49:05.928157] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T17:49:06.673042] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-02T17:49:06.976558] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T17:49:07.478183] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-02T17:49:07.498905] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T17:49:07.586462] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T17:49:08.272999] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-02T17:49:09.075833] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-02T17:49:09.077828] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T17:49:09.170863] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T17:49:09.873004] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-02T17:49:10.612916] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T17:49:10.672987] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-02T17:49:11.472978] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-02T17:49:11.704250] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T17:49:11.783216] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T17:49:12.273005] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-02T17:49:13.005253] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T17:49:13.072984] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-02T17:49:13.873002] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-02T17:49:14.009960] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T17:49:14.529054] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T17:49:14.530080] [INFO ] [REMOTE ] BUI: Full fetch complete (16308 records). [2025-10-02T17:49:14.530160] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-02T17:49:14.530623] [FATAL] [VALIDATOR ] BUI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:49:14.530734] [FATAL] [MAIN ] BUI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:49:14.530781] [WARN ] [MAIN ] BUI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:49:14.530848] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-02T17:49:14.530916] [DEBUG] [LOCAL ] BUI: No primary data file found to delete. [2025-10-02T17:49:14.530953] [INFO ] [LOCAL ] BUI: Starting deletion of derivative data. [2025-10-02T17:49:14.530995] [DEBUG] [LOCAL ] BUI: No derivative data file found to delete. [2025-10-02T17:49:14.531066] [INFO ] [MAIN ] Update Progress: 356/2370 symbols completed. BUI took 26.8s. Estimated remaining: 4h 38m 13s. Rate: 7.2 symbols/min [2025-10-02T17:49:14.678209] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-02T17:49:14.735358] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:49:14.735562] [DEBUG] [LOCAL ] BUXX: No existing data file found in primary storage. [2025-10-02T17:49:14.735617] [WARN ] [MAIN ] BUXX: No existing data found, performing full refresh instead. [2025-10-02T17:49:14.735751] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-02T17:49:14.735794] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-02T17:49:14.735857] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-02T17:49:14.735893] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-02T17:49:15.164689] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:49:15.193627] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-02T17:49:15.473045] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-02T17:49:16.238297] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T17:49:16.272982] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-02T17:49:16.882252] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T17:49:16.883878] [INFO ] [REMOTE ] BUD: Full fetch complete (76097 records). [2025-10-02T17:49:16.884011] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-02T17:49:16.884769] [FATAL] [VALIDATOR ] BUD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:49:16.884859] [FATAL] [MAIN ] BUD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:49:16.884913] [WARN ] [MAIN ] BUD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:49:16.884979] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-02T17:49:16.885042] [DEBUG] [LOCAL ] BUD: No primary data file found to delete. [2025-10-02T17:49:16.885078] [INFO ] [LOCAL ] BUD: Starting deletion of derivative data. [2025-10-02T17:49:16.885332] [DEBUG] [LOCAL ] BUD: Deleted derivative data file. [2025-10-02T17:49:16.885425] [INFO ] [MAIN ] Update Progress: 357/2370 symbols completed. BUD took 47.0s. Estimated remaining: 4h 37m 31s. Rate: 7.3 symbols/min [2025-10-02T17:49:17.073008] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-02T17:49:17.517692] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T17:49:17.873050] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-10-02T17:49:18.350343] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T17:49:18.535047] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-02T17:49:18.673059] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-02T17:49:19.473070] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-02T17:49:20.188807] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T17:49:20.273010] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-02T17:49:21.025458] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T17:49:21.072968] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-02T17:49:21.872980] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-02T17:49:21.990345] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-02T17:49:22.443342] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T17:49:22.445324] [INFO ] [REMOTE ] BUR: Full fetch complete (63523 records). [2025-10-02T17:49:22.445453] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-02T17:49:22.674465] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-02T17:49:22.757832] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-02T17:49:22.918198] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-02T17:49:22.918287] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-02T17:49:22.919054] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-02T17:49:22.919142] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-02T17:49:22.920760] [DEBUG] [LOCAL ] BUR: Trimmed 63523 records to 45456 (keeping 200 days of data) [2025-10-02T17:49:23.202783] [DEBUG] [LOCAL ] BUR: Primary data saved (45456 records). [2025-10-02T17:49:23.202917] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-02T17:49:23.202999] [INFO ] [MAIN ] Update Progress: 358/2370 symbols completed. BUR took 34.1s. Estimated remaining: 4h 37m 12s. Rate: 7.3 symbols/min [2025-10-02T17:49:23.473035] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-02T17:49:24.354392] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T17:49:24.358250] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-02T17:49:24.441048] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T17:49:24.892729] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-02T17:49:25.073012] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-02T17:49:25.873030] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-02T17:49:26.103882] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T17:49:26.673063] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-02T17:49:27.596595] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T17:49:27.607708] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-02T17:49:27.754200] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T17:49:28.273066] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-02T17:49:28.756981] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T17:49:28.758950] [INFO ] [REMOTE ] BURL: Full fetch complete (65667 records). [2025-10-02T17:49:28.759067] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-02T17:49:29.119302] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T17:49:29.172852] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-02T17:49:29.213172] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-02T17:49:29.213279] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-02T17:49:29.214046] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-02T17:49:29.214114] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-02T17:49:29.215611] [DEBUG] [LOCAL ] BURL: Trimmed 65667 records to 46323 (keeping 200 days of data) [2025-10-02T17:49:29.506199] [DEBUG] [LOCAL ] BURL: Primary data saved (46323 records). [2025-10-02T17:49:29.506345] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-02T17:49:29.507496] [INFO ] [MAIN ] Update Progress: 359/2370 symbols completed. BURL took 30.8s. Estimated remaining: 4h 36m 53s. Rate: 7.3 symbols/min [2025-10-02T17:49:30.246763] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T17:49:30.250616] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-02T17:49:31.059512] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T17:49:31.062984] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-02T17:49:31.942008] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T17:49:31.945786] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-02T17:49:32.829269] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T17:49:32.830420] [INFO ] [REMOTE ] BUXX: Full fetch complete (20364 records). [2025-10-02T17:49:32.830534] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-02T17:49:33.231694] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-02T17:49:33.231850] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-02T17:49:33.232210] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-02T17:49:33.232252] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-02T17:49:33.232854] [DEBUG] [LOCAL ] BUXX: Trimmed 20364 records to 15276 (keeping 200 days of data) [2025-10-02T17:49:33.336933] [DEBUG] [LOCAL ] BUXX: Primary data saved (15276 records). [2025-10-02T17:49:33.337088] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-02T17:49:33.337168] [INFO ] [MAIN ] Update Progress: 360/2370 symbols completed. BUXX took 18.8s. Estimated remaining: 4h 36m 20s. Rate: 7.3 symbols/min [2025-10-02T17:49:34.065200] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:49:34.153766] [DEBUG] [LOCAL ] BV: No existing data file found in primary storage. [2025-10-02T17:49:34.153597] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:49:34.149782] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:49:34.154110] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-10-02T17:49:34.158496] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-02T17:49:34.158399] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:49:34.159484] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-02T17:49:34.160110] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-02T17:49:34.160166] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-02T17:49:34.485101] [DEBUG] [LOCAL ] BW: Loaded 39882 existing records from primary storage. [2025-10-02T17:49:34.485747] [DEBUG] [LOCAL ] BVN: Loaded 44017 existing records from primary storage. [2025-10-02T17:49:34.510138] [INFO ] [MAIN ] BVN: Loaded 44017 existing records. [2025-10-02T17:49:34.510021] [INFO ] [MAIN ] BW: Loaded 39882 existing records. [2025-10-02T17:49:34.574372] [DEBUG] [LOCAL ] BWA: Loaded 52184 existing records from primary storage. [2025-10-02T17:49:34.716841] [INFO ] [MAIN ] BWA: Loaded 52184 existing records. [2025-10-02T17:49:34.977252] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:49:35.075249] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-10-02T17:49:35.260139] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:49:35.290989] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-02T17:49:35.315903] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:49:35.309844] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:49:35.316267] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-02T17:49:35.316436] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-02T17:49:35.316509] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-02T17:49:35.316359] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-02T17:49:35.316685] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-02T17:49:35.318236] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-02T17:49:35.318305] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-02T17:49:35.318347] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-02T17:49:35.318480] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-02T17:49:35.332664] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-10-02T17:49:35.401242] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-02T17:49:36.482341] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:49:36.506905] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:49:36.531366] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-10-02T17:49:36.531945] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-10-02T17:49:36.582601] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:49:36.583693] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-10-02T17:49:36.760936] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T17:49:36.767903] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-02T17:49:38.062633] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T17:49:38.070218] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-02T17:49:38.117116] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T17:49:38.127049] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-02T17:49:38.226757] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T17:49:38.238500] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-02T17:49:38.390630] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T17:49:38.673060] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-02T17:49:39.459928] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:49:39.472979] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-02T17:49:39.597265] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T17:49:39.629930] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:49:40.050107] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T17:49:40.273008] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-02T17:49:40.986962] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:49:41.073010] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-02T17:49:41.655799] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T17:49:41.872999] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-02T17:49:42.493840] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T17:49:42.673067] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-02T17:49:43.170687] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T17:49:43.473048] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-02T17:49:44.069072] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T17:49:44.273007] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-02T17:49:44.753461] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T17:49:45.073052] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-02T17:49:45.553681] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T17:49:45.873008] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-02T17:49:46.524621] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:49:46.673006] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-02T17:49:47.382268] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:49:47.473006] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-02T17:49:47.915958] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T17:49:48.273015] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-02T17:49:49.073002] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-02T17:49:49.141584] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:49:49.837459] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T17:49:49.872960] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-02T17:49:50.552511] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T17:49:50.672990] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-02T17:49:50.994887] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T17:49:51.473015] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-02T17:49:51.970681] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T17:49:52.272997] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-02T17:49:53.078098] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-02T17:49:53.091468] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T17:49:53.817886] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T17:49:53.873019] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-02T17:49:54.338813] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T17:49:54.672997] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-02T17:49:55.473001] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-02T17:49:55.858578] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T17:49:55.892441] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T17:49:56.273002] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-02T17:49:57.018552] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T17:49:57.072989] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-02T17:49:57.872980] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-02T17:49:58.152551] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T17:49:58.346387] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T17:49:58.348269] [INFO ] [REMOTE ] BV: Full fetch complete (54159 records). [2025-10-02T17:49:58.348389] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-02T17:49:58.678099] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-02T17:49:58.783755] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-02T17:49:58.783863] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-02T17:49:58.784577] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-02T17:49:58.784666] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-02T17:49:58.785950] [DEBUG] [LOCAL ] BV: Trimmed 54159 records to 38582 (keeping 200 days of data) [2025-10-02T17:49:59.028116] [DEBUG] [LOCAL ] BV: Primary data saved (38582 records). [2025-10-02T17:49:59.028269] [INFO ] [MAIN ] BV: Full history saved. [2025-10-02T17:49:59.028349] [INFO ] [MAIN ] Update Progress: 361/2370 symbols completed. BV took 25.7s. Estimated remaining: 4h 37m 49s. Rate: 7.2 symbols/min [2025-10-02T17:49:59.222299] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:49:59.236748] [DEBUG] [LOCAL ] BWG: Loaded 12509 existing records from primary storage. [2025-10-02T17:49:59.237013] [INFO ] [MAIN ] BWG: Loaded 12509 existing records. [2025-10-02T17:49:59.436248] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:49:59.436534] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-02T17:49:59.436671] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-02T17:49:59.437337] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-02T17:49:59.437400] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-02T17:49:59.480995] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-02T17:49:59.676902] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:49:59.903030] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:00.272990] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-02T17:50:00.426507] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T17:50:01.073050] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-02T17:50:01.616112] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-02T17:50:01.873093] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-10-02T17:50:02.041087] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T17:50:02.672981] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-02T17:50:02.912019] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T17:50:03.189620] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-02T17:50:03.473045] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-02T17:50:04.273028] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-02T17:50:04.414798] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T17:50:05.072983] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-02T17:50:05.437902] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T17:50:05.873009] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-02T17:50:05.920038] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T17:50:06.498396] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T17:50:06.500345] [INFO ] [REMOTE ] BVN: Full fetch complete (62921 records). [2025-10-02T17:50:06.500455] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-02T17:50:06.674422] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-02T17:50:06.914285] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T17:50:06.966245] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-02T17:50:06.966326] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-02T17:50:06.967080] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-02T17:50:06.967148] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-02T17:50:06.968513] [DEBUG] [LOCAL ] BVN: Trimmed 62921 records to 44365 (keeping 200 days of data) [2025-10-02T17:50:07.238156] [DEBUG] [LOCAL ] BVN: Primary data saved (44365 records). [2025-10-02T17:50:07.238302] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-02T17:50:07.238406] [INFO ] [MAIN ] Update Progress: 362/2370 symbols completed. BVN took 33.9s. Estimated remaining: 4h 37m 40s. Rate: 7.2 symbols/min [2025-10-02T17:50:07.451693] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:07.473039] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-02T17:50:07.486008] [DEBUG] [LOCAL ] BWLP: Loaded 32416 existing records from primary storage. [2025-10-02T17:50:07.486318] [INFO ] [MAIN ] BWLP: Loaded 32416 existing records. [2025-10-02T17:50:07.681219] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:07.681464] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-02T17:50:07.681515] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-02T17:50:07.682371] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-10-02T17:50:07.682432] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-02T17:50:08.092911] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:08.246944] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T17:50:08.279239] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-02T17:50:08.305561] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T17:50:09.073044] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-10-02T17:50:09.624633] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T17:50:09.626475] [INFO ] [REMOTE ] BW: Full fetch complete (58840 records). [2025-10-02T17:50:09.626577] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-02T17:50:09.878109] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-02T17:50:10.054905] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-02T17:50:10.055283] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-02T17:50:10.055991] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-02T17:50:10.056057] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-02T17:50:10.058578] [DEBUG] [LOCAL ] BW: Trimmed 58840 records to 40202 (keeping 200 days of data) [2025-10-02T17:50:10.298478] [DEBUG] [LOCAL ] BW: Primary data saved (40202 records). [2025-10-02T17:50:10.298679] [INFO ] [MAIN ] BW: Full history saved. [2025-10-02T17:50:10.299685] [INFO ] [MAIN ] Update Progress: 363/2370 symbols completed. BW took 36.9s. Estimated remaining: 4h 37m 3s. Rate: 7.2 symbols/min [2025-10-02T17:50:10.507392] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:10.519044] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T17:50:10.530545] [DEBUG] [LOCAL ] BWMX: Loaded 7699 existing records from primary storage. [2025-10-02T17:50:10.530907] [INFO ] [MAIN ] BWMX: Loaded 7699 existing records. [2025-10-02T17:50:10.679614] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-02T17:50:10.792146] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:10.792515] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-02T17:50:10.792696] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-02T17:50:10.793198] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-02T17:50:10.793276] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-02T17:50:10.990435] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T17:50:11.407209] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:11.473076] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-10-02T17:50:12.246821] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T17:50:12.273316] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-02T17:50:12.275885] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T17:50:12.278270] [INFO ] [REMOTE ] BWA: Full fetch complete (75721 records). [2025-10-02T17:50:12.278389] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-02T17:50:12.733739] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-02T17:50:12.733838] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-02T17:50:12.734717] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-02T17:50:12.734786] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-02T17:50:12.736477] [DEBUG] [LOCAL ] BWA: Trimmed 75721 records to 52569 (keeping 200 days of data) [2025-10-02T17:50:13.073310] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-02T17:50:13.091833] [DEBUG] [LOCAL ] BWA: Primary data saved (52569 records). [2025-10-02T17:50:13.091979] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-02T17:50:13.092089] [INFO ] [MAIN ] Update Progress: 364/2370 symbols completed. BWA took 39.7s. Estimated remaining: 4h 36m 24s. Rate: 7.3 symbols/min [2025-10-02T17:50:13.279445] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T17:50:13.319634] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:13.327244] [DEBUG] [LOCAL ] BWNB: Loaded 4444 existing records from primary storage. [2025-10-02T17:50:13.327477] [INFO ] [MAIN ] BWNB: Loaded 4444 existing records. [2025-10-02T17:50:13.524688] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:13.524966] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-02T17:50:13.525018] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-02T17:50:13.525358] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-02T17:50:13.525418] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-02T17:50:13.878084] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-02T17:50:13.962813] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:14.405774] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T17:50:14.511580] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T17:50:14.673057] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-02T17:50:15.472989] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-02T17:50:16.049780] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T17:50:16.273016] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-10-02T17:50:16.297611] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T17:50:16.833325] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-02T17:50:17.073032] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-02T17:50:17.503702] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T17:50:17.873000] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-02T17:50:18.415599] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T17:50:18.673016] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-02T17:50:19.473051] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-02T17:50:19.707449] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T17:50:20.113182] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T17:50:20.273054] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-02T17:50:20.956540] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T17:50:21.073030] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-02T17:50:21.867686] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T17:50:21.872950] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-02T17:50:22.609779] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T17:50:22.673012] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-02T17:50:22.998094] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-02T17:50:23.473009] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-02T17:50:24.088141] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T17:50:24.272998] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-02T17:50:24.916874] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T17:50:25.072998] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-02T17:50:25.765913] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-02T17:50:25.873073] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-02T17:50:26.333709] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-02T17:50:26.673042] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-02T17:50:27.317240] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-02T17:50:27.473059] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-02T17:50:28.272997] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-02T17:50:29.030144] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T17:50:29.054261] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T17:50:29.073009] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-02T17:50:29.873015] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-02T17:50:30.672975] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-02T17:50:30.706612] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T17:50:30.707404] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T17:50:31.473040] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-02T17:50:31.681473] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T17:50:32.273011] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-02T17:50:32.870383] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T17:50:32.979008] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:50:32.980578] [INFO ] [REMOTE ] BWG: Full fetch complete (17952 records). [2025-10-02T17:50:32.980701] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-02T17:50:33.078194] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-02T17:50:33.394755] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-02T17:50:33.394857] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-02T17:50:33.395248] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-02T17:50:33.395370] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-02T17:50:33.396236] [DEBUG] [LOCAL ] BWG: Trimmed 17952 records to 12660 (keeping 200 days of data) [2025-10-02T17:50:33.479978] [DEBUG] [LOCAL ] BWG: Primary data saved (12660 records). [2025-10-02T17:50:33.480133] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-02T17:50:33.480296] [INFO ] [MAIN ] Update Progress: 365/2370 symbols completed. BWG took 34.5s. Estimated remaining: 4h 37m 22s. Rate: 7.2 symbols/min [2025-10-02T17:50:33.656437] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T17:50:33.682700] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:33.696224] [DEBUG] [LOCAL ] BWSN: Loaded 5090 existing records from primary storage. [2025-10-02T17:50:33.696503] [INFO ] [MAIN ] BWSN: Loaded 5090 existing records. [2025-10-02T17:50:33.876927] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-02T17:50:33.901827] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:33.903141] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-02T17:50:33.903207] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-02T17:50:33.903588] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-02T17:50:33.903692] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-02T17:50:34.307457] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:34.673012] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-02T17:50:35.098372] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T17:50:35.472997] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-10-02T17:50:35.657182] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T17:50:36.272996] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-02T17:50:36.299138] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T17:50:36.870160] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-02T17:50:37.073009] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-02T17:50:37.510955] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-02T17:50:37.873037] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-02T17:50:38.321518] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T17:50:38.673020] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-02T17:50:39.473032] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-02T17:50:40.183426] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T17:50:40.273047] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-02T17:50:40.715707] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T17:50:40.716415] [INFO ] [REMOTE ] BWNB: Full fetch complete (5747 records). [2025-10-02T17:50:40.716487] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-02T17:50:41.078099] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-02T17:50:41.127016] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-02T17:50:41.127148] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-02T17:50:41.127357] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-02T17:50:41.127420] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-02T17:50:41.127918] [DEBUG] [LOCAL ] BWNB: Trimmed 5747 records to 4466 (keeping 200 days of data) [2025-10-02T17:50:41.158265] [DEBUG] [LOCAL ] BWNB: Primary data saved (4466 records). [2025-10-02T17:50:41.158429] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-02T17:50:41.158552] [INFO ] [MAIN ] Update Progress: 366/2370 symbols completed. BWNB took 28.1s. Estimated remaining: 4h 37m 11s. Rate: 7.2 symbols/min [2025-10-02T17:50:41.337754] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:41.394510] [DEBUG] [LOCAL ] BWXT: Loaded 46870 existing records from primary storage. [2025-10-02T17:50:41.394953] [INFO ] [MAIN ] BWXT: Loaded 46870 existing records. [2025-10-02T17:50:41.575287] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (2.90 seconds). [2025-10-02T17:50:41.607623] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:41.614885] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-02T17:50:41.615419] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-02T17:50:41.616934] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-10-02T17:50:41.617011] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-02T17:50:41.748885] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T17:50:41.878196] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-02T17:50:42.040412] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:42.555790] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T17:50:42.672997] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-10-02T17:50:43.473061] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-02T17:50:43.872001] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-02T17:50:44.272978] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-02T17:50:44.450314] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T17:50:45.073011] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-02T17:50:45.651872] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T17:50:45.819289] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T17:50:45.872998] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-02T17:50:46.673021] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-02T17:50:46.697607] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T17:50:47.473041] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-02T17:50:47.819771] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-02T17:50:47.826249] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T17:50:47.828190] [INFO ] [REMOTE ] BWLP: Full fetch complete (48204 records). [2025-10-02T17:50:47.828298] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-02T17:50:48.254130] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-02T17:50:48.254211] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-02T17:50:48.254796] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-02T17:50:48.254860] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-02T17:50:48.256147] [DEBUG] [LOCAL ] BWLP: Trimmed 48204 records to 32667 (keeping 200 days of data) [2025-10-02T17:50:48.321059] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-02T17:50:48.479336] [DEBUG] [LOCAL ] BWLP: Primary data saved (32667 records). [2025-10-02T17:50:48.479486] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-02T17:50:48.479602] [INFO ] [MAIN ] Update Progress: 367/2370 symbols completed. BWLP took 41.2s. Estimated remaining: 4h 36m 57s. Rate: 7.2 symbols/min [2025-10-02T17:50:48.679079] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:48.747324] [DEBUG] [LOCAL ] BX: Loaded 53489 existing records from primary storage. [2025-10-02T17:50:48.747775] [INFO ] [MAIN ] BX: Loaded 53489 existing records. [2025-10-02T17:50:48.949093] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:48.949301] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-02T17:50:48.949351] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-02T17:50:48.950866] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-02T17:50:48.950929] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-02T17:50:49.078134] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-02T17:50:49.369558] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:49.707447] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T17:50:49.849030] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T17:50:49.872977] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-10-02T17:50:50.673016] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-02T17:50:51.472997] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-02T17:50:51.854886] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-02T17:50:51.938175] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T17:50:51.981120] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T17:50:52.272996] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-02T17:50:53.072999] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-02T17:50:53.484761] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T17:50:53.485509] [INFO ] [REMOTE ] BWSN: Full fetch complete (6154 records). [2025-10-02T17:50:53.485817] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-02T17:50:53.877199] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-02T17:50:53.913700] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T17:50:53.962876] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-10-02T17:50:53.962957] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-10-02T17:50:53.963141] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-10-02T17:50:53.963201] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-10-02T17:50:53.963724] [DEBUG] [LOCAL ] BWSN: Trimmed 6154 records to 5127 (keeping 200 days of data) [2025-10-02T17:50:53.996710] [DEBUG] [LOCAL ] BWSN: Primary data saved (5127 records). [2025-10-02T17:50:53.996854] [INFO ] [MAIN ] BWSN: Full history saved. [2025-10-02T17:50:53.996952] [INFO ] [MAIN ] Update Progress: 368/2370 symbols completed. BWSN took 20.5s. Estimated remaining: 4h 36m 34s. Rate: 7.2 symbols/min [2025-10-02T17:50:54.192671] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:54.208669] [DEBUG] [LOCAL ] BXC: Loaded 13649 existing records from primary storage. [2025-10-02T17:50:54.208941] [INFO ] [MAIN ] BXC: Loaded 13649 existing records. [2025-10-02T17:50:54.408704] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:54.409068] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-02T17:50:54.409130] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-02T17:50:54.409750] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-10-02T17:50:54.409813] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-02T17:50:54.681724] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-02T17:50:54.809435] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:55.457886] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T17:50:55.472960] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-02T17:50:55.936923] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-02T17:50:56.036357] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T17:50:56.037874] [INFO ] [REMOTE ] BWMX: Full fetch complete (10081 records). [2025-10-02T17:50:56.037951] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-02T17:50:56.278082] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-02T17:50:56.422165] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-02T17:50:56.422247] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-02T17:50:56.422514] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-02T17:50:56.422557] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-02T17:50:56.423023] [DEBUG] [LOCAL ] BWMX: Trimmed 10081 records to 7725 (keeping 200 days of data) [2025-10-02T17:50:56.477158] [DEBUG] [LOCAL ] BWMX: Primary data saved (7725 records). [2025-10-02T17:50:56.477312] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-02T17:50:56.477468] [INFO ] [MAIN ] Update Progress: 369/2370 symbols completed. BWMX took 46.2s. Estimated remaining: 4h 35m 54s. Rate: 7.3 symbols/min [2025-10-02T17:50:56.659927] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:50:56.717811] [DEBUG] [LOCAL ] BXMT: Loaded 47227 existing records from primary storage. [2025-10-02T17:50:56.718245] [INFO ] [MAIN ] BXMT: Loaded 47227 existing records. [2025-10-02T17:50:56.904146] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:50:56.904378] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-02T17:50:56.904426] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-02T17:50:56.905785] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-02T17:50:56.905851] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-02T17:50:57.078258] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-02T17:50:57.301128] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:50:57.873055] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-10-02T17:50:58.230773] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-02T17:50:58.673001] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-02T17:50:58.737179] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T17:50:59.462193] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T17:50:59.472963] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-02T17:51:00.273029] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-10-02T17:51:00.492334] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:51:01.072972] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-02T17:51:01.151667] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T17:51:01.441601] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-02T17:51:01.873014] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-02T17:51:02.672993] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-02T17:51:03.105947] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T17:51:03.473045] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-02T17:51:03.673021] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T17:51:04.029246] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-02T17:51:04.273000] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-02T17:51:04.606538] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-02T17:51:05.073606] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-02T17:51:05.075334] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-02T17:51:05.873022] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-02T17:51:06.673006] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-02T17:51:06.775970] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T17:51:06.816185] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T17:51:07.473016] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-02T17:51:08.272979] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-02T17:51:08.451034] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-02T17:51:08.679505] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T17:51:09.073007] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-02T17:51:09.872985] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-02T17:51:10.582961] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-02T17:51:10.673066] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-02T17:51:11.100425] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T17:51:11.473052] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-02T17:51:11.776481] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T17:51:11.845761] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T17:51:12.273025] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-02T17:51:13.072969] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-02T17:51:13.147580] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T17:51:13.270975] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:51:13.873030] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-02T17:51:14.673017] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-02T17:51:14.933133] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-02T17:51:14.992544] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T17:51:15.473008] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-02T17:51:16.138037] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T17:51:16.273029] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-02T17:51:17.072988] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-02T17:51:17.107708] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T17:51:17.873017] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-02T17:51:18.647126] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T17:51:18.673016] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-02T17:51:19.473059] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-02T17:51:20.469193] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:51:20.486272] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-02T17:51:21.345115] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T17:51:21.357029] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-02T17:51:22.216766] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T17:51:22.227593] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-02T17:51:22.782058] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T17:51:22.793624] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-02T17:51:23.876335] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T17:51:23.887116] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-02T17:51:24.914007] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-02T17:51:24.926416] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-02T17:51:25.289012] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T17:51:25.291626] [INFO ] [REMOTE ] BXMT: Full fetch complete (69670 records). [2025-10-02T17:51:25.291806] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-02T17:51:25.718773] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-10-02T17:51:25.718872] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-10-02T17:51:25.719611] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-10-02T17:51:25.719687] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-10-02T17:51:25.721165] [DEBUG] [LOCAL ] BXMT: Trimmed 69670 records to 47578 (keeping 200 days of data) [2025-10-02T17:51:26.026531] [DEBUG] [LOCAL ] BXMT: Primary data saved (47578 records). [2025-10-02T17:51:26.026701] [INFO ] [MAIN ] BXMT: Full history saved. [2025-10-02T17:51:26.027284] [INFO ] [MAIN ] Update Progress: 370/2370 symbols completed. BXMT took 29.5s. Estimated remaining: 4h 37m 41s. Rate: 7.2 symbols/min [2025-10-02T17:51:26.262323] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:51:26.284570] [DEBUG] [LOCAL ] BXMX: Loaded 19559 existing records from primary storage. [2025-10-02T17:51:26.284855] [INFO ] [MAIN ] BXMX: Loaded 19559 existing records. [2025-10-02T17:51:26.504704] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:51:26.505016] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-02T17:51:26.505157] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-02T17:51:26.506079] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-02T17:51:26.506141] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-02T17:51:26.950736] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:51:26.951449] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-10-02T17:51:26.986762] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-02T17:51:26.998521] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-02T17:51:28.196522] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T17:51:28.201439] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-02T17:51:28.848116] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T17:51:28.861148] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-02T17:51:28.876500] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T17:51:28.881032] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-02T17:51:29.651722] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T17:51:29.656469] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-02T17:51:30.413798] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T17:51:30.416552] [INFO ] [REMOTE ] BX: Full fetch complete (77406 records). [2025-10-02T17:51:30.416769] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-02T17:51:30.888233] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-02T17:51:30.889351] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T17:51:30.889433] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-02T17:51:30.896035] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-02T17:51:30.897072] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-02T17:51:30.897243] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-02T17:51:30.900144] [DEBUG] [LOCAL ] BX: Trimmed 77406 records to 53877 (keeping 200 days of data) [2025-10-02T17:51:31.254902] [DEBUG] [LOCAL ] BX: Primary data saved (53877 records). [2025-10-02T17:51:31.255061] [INFO ] [MAIN ] BX: Full history saved. [2025-10-02T17:51:31.255160] [INFO ] [MAIN ] Update Progress: 371/2370 symbols completed. BX took 42.8s. Estimated remaining: 4h 37m 16s. Rate: 7.2 symbols/min [2025-10-02T17:51:31.438667] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:51:31.486844] [DEBUG] [LOCAL ] BXP: Loaded 49856 existing records from primary storage. [2025-10-02T17:51:31.487217] [INFO ] [MAIN ] BXP: Loaded 49856 existing records. [2025-10-02T17:51:31.688947] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:51:31.689183] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-02T17:51:31.689234] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-02T17:51:31.690538] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-10-02T17:51:31.690598] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-02T17:51:32.102528] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:51:32.103056] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-10-02T17:51:32.121466] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-02T17:51:32.127621] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-02T17:51:33.135001] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T17:51:33.141149] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-02T17:51:33.632075] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T17:51:33.646445] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-02T17:51:34.180826] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T17:51:34.185740] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-02T17:51:34.919114] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T17:51:34.924250] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-02T17:51:35.149026] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:51:35.473004] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-02T17:51:35.545556] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-02T17:51:36.273034] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-02T17:51:36.381817] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (21.71 seconds). [2025-10-02T17:51:36.383907] [INFO ] [REMOTE ] BWXT: Full fetch complete (67512 records). [2025-10-02T17:51:36.384018] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-02T17:51:36.819865] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-02T17:51:36.820003] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-02T17:51:36.820804] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-02T17:51:36.820987] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-02T17:51:36.822974] [DEBUG] [LOCAL ] BWXT: Trimmed 67512 records to 47232 (keeping 200 days of data) [2025-10-02T17:51:36.944503] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T17:51:37.087225] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-02T17:51:37.116081] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T17:51:37.193419] [DEBUG] [LOCAL ] BWXT: Primary data saved (47232 records). [2025-10-02T17:51:37.193567] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-02T17:51:37.193864] [INFO ] [MAIN ] Update Progress: 372/2370 symbols completed. BWXT took 56.0s. Estimated remaining: 4h 36m 54s. Rate: 7.2 symbols/min [2025-10-02T17:51:37.377926] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:51:37.425681] [DEBUG] [LOCAL ] BXSL: Loaded 47639 existing records from primary storage. [2025-10-02T17:51:37.426048] [INFO ] [MAIN ] BXSL: Loaded 47639 existing records. [2025-10-02T17:51:37.614132] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:51:37.614339] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-02T17:51:37.614387] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-02T17:51:37.616004] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-10-02T17:51:37.616067] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-02T17:51:37.879129] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-02T17:51:38.004916] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:51:38.672987] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-10-02T17:51:38.838473] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T17:51:38.863473] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T17:51:38.864970] [INFO ] [REMOTE ] BXMX: Full fetch complete (29085 records). [2025-10-02T17:51:38.865052] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-02T17:51:39.281343] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-02T17:51:39.281436] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-02T17:51:39.281919] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-02T17:51:39.281987] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-02T17:51:39.282907] [DEBUG] [LOCAL ] BXMX: Trimmed 29085 records to 19738 (keeping 200 days of data) [2025-10-02T17:51:39.405605] [DEBUG] [LOCAL ] BXMX: Primary data saved (19738 records). [2025-10-02T17:51:39.405780] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-02T17:51:39.405869] [INFO ] [MAIN ] Update Progress: 373/2370 symbols completed. BXMX took 13.4s. Estimated remaining: 4h 36m 13s. Rate: 7.2 symbols/min [2025-10-02T17:51:39.485346] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-02T17:51:39.611375] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:51:39.633393] [DEBUG] [LOCAL ] BY: Loaded 21678 existing records from primary storage. [2025-10-02T17:51:39.633683] [INFO ] [MAIN ] BY: Loaded 21678 existing records. [2025-10-02T17:51:39.829561] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:51:39.829831] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-02T17:51:39.829889] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-02T17:51:39.830567] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-10-02T17:51:39.830629] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-02T17:51:40.220498] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:51:40.273016] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-10-02T17:51:40.358795] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T17:51:41.032462] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T17:51:41.073023] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-02T17:51:41.365584] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T17:51:41.873012] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-02T17:51:42.682082] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-02T17:51:42.685109] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T17:51:42.994743] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (25.12 seconds). [2025-10-02T17:51:42.995856] [INFO ] [REMOTE ] BXC: Full fetch complete (17930 records). [2025-10-02T17:51:42.995936] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-02T17:51:43.399807] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-02T17:51:43.400089] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-02T17:51:43.400493] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-02T17:51:43.400565] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-02T17:51:43.401430] [DEBUG] [LOCAL ] BXC: Trimmed 17930 records to 13732 (keeping 200 days of data) [2025-10-02T17:51:43.473996] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-02T17:51:43.493899] [DEBUG] [LOCAL ] BXC: Primary data saved (13732 records). [2025-10-02T17:51:43.494333] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-02T17:51:43.494460] [INFO ] [MAIN ] Update Progress: 374/2370 symbols completed. BXC took 49.5s. Estimated remaining: 4h 35m 43s. Rate: 7.2 symbols/min [2025-10-02T17:51:43.717725] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:51:43.720774] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T17:51:43.744721] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T17:51:43.796371] [DEBUG] [LOCAL ] BYD: Loaded 44923 existing records from primary storage. [2025-10-02T17:51:43.796726] [INFO ] [MAIN ] BYD: Loaded 44923 existing records. [2025-10-02T17:51:43.996588] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:51:43.996847] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-02T17:51:43.996898] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-02T17:51:43.998222] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-10-02T17:51:43.998289] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-02T17:51:44.278133] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-02T17:51:44.400429] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:51:45.073086] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-02T17:51:45.076305] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T17:51:45.872982] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-02T17:51:45.909295] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-02T17:51:46.053402] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T17:51:46.673004] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-02T17:51:47.473006] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-10-02T17:51:47.515854] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T17:51:48.149860] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T17:51:48.273006] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-02T17:51:49.015166] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T17:51:49.072982] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-02T17:51:49.872979] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-02T17:51:50.035055] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:51:50.678145] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-02T17:51:50.696305] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T17:51:51.295211] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T17:51:51.473015] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-02T17:51:52.272981] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-02T17:51:52.378207] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T17:51:53.072998] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-02T17:51:53.133963] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T17:51:53.158881] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-02T17:51:53.873004] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-02T17:51:54.634042] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T17:51:54.672975] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-02T17:51:55.472987] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-02T17:51:56.272966] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-02T17:51:56.322636] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T17:51:57.077412] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-02T17:51:57.080498] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T17:51:57.790736] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T17:51:57.792876] [INFO ] [REMOTE ] BXP: Full fetch complete (71537 records). [2025-10-02T17:51:57.792996] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-02T17:51:57.880992] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-02T17:51:58.223947] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-02T17:51:58.224038] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-02T17:51:58.224878] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-02T17:51:58.224941] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-02T17:51:58.226436] [DEBUG] [LOCAL ] BXP: Trimmed 71537 records to 50225 (keeping 200 days of data) [2025-10-02T17:51:58.567412] [DEBUG] [LOCAL ] BXP: Primary data saved (50225 records). [2025-10-02T17:51:58.567589] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-02T17:51:58.567713] [INFO ] [MAIN ] Update Progress: 375/2370 symbols completed. BXP took 27.3s. Estimated remaining: 4h 36m 10s. Rate: 7.2 symbols/min [2025-10-02T17:51:58.767429] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:51:58.782086] [DEBUG] [LOCAL ] BYM: Loaded 12042 existing records from primary storage. [2025-10-02T17:51:58.782376] [INFO ] [MAIN ] BYM: Loaded 12042 existing records. [2025-10-02T17:51:58.977136] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:51:58.977365] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-02T17:51:58.977412] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-02T17:51:58.978094] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-02T17:51:58.978155] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-02T17:51:59.362439] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:51:59.362800] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-10-02T17:51:59.561533] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T17:51:59.572189] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-02T17:52:00.534925] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T17:52:00.538820] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-02T17:52:01.342132] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T17:52:01.345782] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-02T17:52:02.150072] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-02T17:52:02.152910] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-02T17:52:02.996481] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T17:52:03.000623] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-02T17:52:03.968670] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T17:52:03.972633] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-02T17:52:04.817463] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-02T17:52:04.821113] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-02T17:52:17.880684] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (24.01 seconds). [2025-10-02T17:52:17.887247] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-02T17:52:18.806304] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T17:52:18.810292] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-02T17:52:19.296811] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (22.22 seconds). [2025-10-02T17:52:19.308625] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-02T17:52:19.821049] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T17:52:19.827044] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-02T17:52:20.711358] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T17:52:20.717950] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-02T17:52:20.763591] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T17:52:20.781631] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-02T17:52:22.003443] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T17:52:22.008291] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-02T17:52:22.295096] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T17:52:22.297245] [INFO ] [REMOTE ] BXSL: Full fetch complete (69469 records). [2025-10-02T17:52:22.297358] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-02T17:52:22.737909] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-10-02T17:52:22.738026] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-10-02T17:52:22.738823] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-10-02T17:52:22.738890] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-10-02T17:52:22.740534] [DEBUG] [LOCAL ] BXSL: Trimmed 69469 records to 48025 (keeping 200 days of data) [2025-10-02T17:52:23.049331] [DEBUG] [LOCAL ] BXSL: Primary data saved (48025 records). [2025-10-02T17:52:23.049483] [INFO ] [MAIN ] BXSL: Full history saved. [2025-10-02T17:52:23.049572] [INFO ] [MAIN ] Update Progress: 376/2370 symbols completed. BXSL took 45.9s. Estimated remaining: 4h 37m 28s. Rate: 7.2 symbols/min [2025-10-02T17:52:23.250674] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:52:23.247109] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T17:52:23.256597] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-02T17:52:23.289172] [DEBUG] [LOCAL ] BZH: Loaded 32356 existing records from primary storage. [2025-10-02T17:52:23.289455] [INFO ] [MAIN ] BZH: Loaded 32356 existing records. [2025-10-02T17:52:23.486521] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:52:23.486791] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-02T17:52:23.486843] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-02T17:52:23.487950] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-02T17:52:23.488047] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-02T17:52:23.883863] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:52:23.884172] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-10-02T17:52:24.124443] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T17:52:24.125814] [INFO ] [REMOTE ] BY: Full fetch complete (29532 records). [2025-10-02T17:52:24.125908] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-02T17:52:24.526198] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-02T17:52:24.526280] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-02T17:52:24.527004] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-02T17:52:24.527070] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-02T17:52:24.527885] [DEBUG] [LOCAL ] BY: Trimmed 29532 records to 21841 (keeping 200 days of data) [2025-10-02T17:52:24.671127] [DEBUG] [LOCAL ] BY: Primary data saved (21841 records). [2025-10-02T17:52:24.671256] [INFO ] [MAIN ] BY: Full history saved. [2025-10-02T17:52:24.671354] [INFO ] [MAIN ] Update Progress: 377/2370 symbols completed. BY took 45.3s. Estimated remaining: 4h 36m 44s. Rate: 7.2 symbols/min [2025-10-02T17:52:24.889953] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:52:24.944949] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-10-02T17:52:24.945271] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-10-02T17:52:25.147761] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:52:25.148219] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-02T17:52:25.148430] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-02T17:52:25.150383] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-02T17:52:25.150455] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-02T17:52:25.360008] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T17:52:25.423332] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-02T17:52:25.561948] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:52:25.562244] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-10-02T17:52:26.382110] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T17:52:26.388564] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-02T17:52:26.815543] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (27.24 seconds). [2025-10-02T17:52:26.826314] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-02T17:52:27.388505] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-02T17:52:27.397146] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-02T17:52:27.669836] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-02T17:52:27.681681] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-02T17:52:28.498816] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T17:52:28.509954] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-02T17:52:29.843192] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-02T17:52:29.855342] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-02T17:52:30.191796] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T17:52:30.201730] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-02T17:52:31.684947] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T17:52:31.697345] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-02T17:52:31.884512] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-02T17:52:31.895244] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-02T17:52:33.037948] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T17:52:33.048312] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-02T17:52:33.980138] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-02T17:52:33.992729] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-02T17:52:34.521736] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T17:52:34.532019] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-02T17:52:34.884330] [DEBUG] [REMOTE ] BYM: Error fetching primary data for 2025-06: Server request status code is 503. [2025-10-02T17:52:34.884794] [WARN ] [REMOTE ] BYM: No data returned for month 2025-06 [2025-10-02T17:52:34.884916] [FATAL] [REMOTE ] BYM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:52:34.885055] [FATAL] [MAIN ] BYM: Failed to fetch primary data. [2025-10-02T17:52:34.885143] [WARN ] [MAIN ] BYM: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:52:34.885250] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-02T17:52:34.885337] [DEBUG] [LOCAL ] BYM: No primary data file found to delete. [2025-10-02T17:52:34.885376] [INFO ] [LOCAL ] BYM: Starting deletion of derivative data. [2025-10-02T17:52:34.886082] [DEBUG] [LOCAL ] BYM: Deleted derivative data file. [2025-10-02T17:52:34.886406] [INFO ] [MAIN ] Update Progress: 378/2370 symbols completed. BYM took 36.3s. Estimated remaining: 4h 36m 46s. Rate: 7.2 symbols/min [2025-10-02T17:52:35.102294] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:52:35.126360] [DEBUG] [LOCAL ] CAAP: Loaded 19995 existing records from primary storage. [2025-10-02T17:52:35.126711] [INFO ] [MAIN ] CAAP: Loaded 19995 existing records. [2025-10-02T17:52:35.329158] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:52:35.329389] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-02T17:52:35.329441] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-02T17:52:35.330391] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-10-02T17:52:35.330455] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-02T17:52:35.759450] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T17:52:35.758948] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:52:35.760516] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-10-02T17:52:35.763889] [INFO ] [REMOTE ] BYD: Full fetch complete (65082 records). [2025-10-02T17:52:35.764069] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-02T17:52:36.198019] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-02T17:52:36.198166] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-02T17:52:36.199212] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-02T17:52:36.199346] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-02T17:52:36.201734] [DEBUG] [LOCAL ] BYD: Trimmed 65082 records to 45277 (keeping 200 days of data) [2025-10-02T17:52:36.331578] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-02T17:52:36.369768] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-02T17:52:36.544169] [DEBUG] [LOCAL ] BYD: Primary data saved (45277 records). [2025-10-02T17:52:36.544324] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-02T17:52:36.544482] [INFO ] [MAIN ] Update Progress: 379/2370 symbols completed. BYD took 53.0s. Estimated remaining: 4h 36m 2s. Rate: 7.2 symbols/min [2025-10-02T17:52:36.743037] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:52:36.765636] [DEBUG] [LOCAL ] CABO: Loaded 17049 existing records from primary storage. [2025-10-02T17:52:36.765977] [INFO ] [MAIN ] CABO: Loaded 17049 existing records. [2025-10-02T17:52:36.987439] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:52:36.987758] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-02T17:52:36.987844] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-02T17:52:36.988725] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-02T17:52:36.988787] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-02T17:52:37.399213] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:52:37.399529] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-10-02T17:52:38.313696] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-02T17:52:38.316330] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-02T17:52:38.602831] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-02T17:52:38.614623] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-02T17:52:39.119711] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T17:52:39.122447] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-02T17:52:39.810501] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-02T17:52:39.814240] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-02T17:52:40.523900] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T17:52:40.535957] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-02T17:52:40.766384] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T17:52:40.770985] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-02T17:52:41.364529] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-02T17:52:41.368443] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-02T17:52:42.508864] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T17:52:42.515080] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-02T17:52:42.826751] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-02T17:52:42.838894] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-02T17:52:43.618702] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T17:52:43.623600] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-02T17:52:44.475053] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-02T17:52:44.483597] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-02T17:52:45.393016] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T17:52:45.397165] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-02T17:52:46.168003] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T17:52:46.171440] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-02T17:52:46.869586] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T17:52:46.871154] [INFO ] [REMOTE ] CABO: Full fetch complete (23134 records). [2025-10-02T17:52:46.871301] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-02T17:52:47.294499] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-02T17:52:47.294591] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-02T17:52:47.295016] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-02T17:52:47.295080] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-02T17:52:47.296010] [DEBUG] [LOCAL ] CABO: Trimmed 23134 records to 17118 (keeping 200 days of data) [2025-10-02T17:52:47.401408] [DEBUG] [LOCAL ] CABO: Primary data saved (17118 records). [2025-10-02T17:52:47.401564] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-02T17:52:47.401673] [INFO ] [MAIN ] Update Progress: 380/2370 symbols completed. CABO took 10.9s. Estimated remaining: 4h 36m 7s. Rate: 7.2 symbols/min [2025-10-02T17:52:47.635535] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:52:47.673787] [DEBUG] [LOCAL ] CACI: Loaded 24519 existing records from primary storage. [2025-10-02T17:52:47.674110] [INFO ] [MAIN ] CACI: Loaded 24519 existing records. [2025-10-02T17:52:47.870369] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:52:47.870717] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-02T17:52:47.870781] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-02T17:52:47.871848] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-02T17:52:47.871959] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-02T17:52:48.257106] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:52:48.257619] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-10-02T17:52:56.050572] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (28.65 seconds). [2025-10-02T17:52:56.058839] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-02T17:52:57.431900] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T17:52:57.440227] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-02T17:52:58.570310] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T17:52:58.578512] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-02T17:52:59.813011] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T17:52:59.820251] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-02T17:52:59.838567] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (24.08 seconds). [2025-10-02T17:52:59.844007] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-02T17:53:00.864908] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T17:53:00.869602] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-02T17:53:01.175962] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (18.34 seconds). [2025-10-02T17:53:01.196192] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-02T17:53:01.332611] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T17:53:01.340432] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-02T17:53:01.830890] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T17:53:01.834922] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-02T17:53:02.848413] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T17:53:02.856693] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-02T17:53:02.873438] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (14.62 seconds). [2025-10-02T17:53:02.880402] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-02T17:53:02.934011] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T17:53:02.938984] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-02T17:53:02.982855] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T17:53:02.994917] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-02T17:53:03.879796] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-02T17:53:03.884757] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-02T17:53:04.058457] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T17:53:04.065724] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-02T17:53:04.206187] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T17:53:04.214084] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-02T17:53:04.777110] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-02T17:53:04.780374] [INFO ] [REMOTE ] C: Full fetch complete (77784 records). [2025-10-02T17:53:04.796857] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-02T17:53:04.801626] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T17:53:04.857347] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-02T17:53:05.165018] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T17:53:05.200395] [INFO ] [REMOTE ] BZH: Full fetch complete (46979 records). [2025-10-02T17:53:05.227615] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-02T17:53:05.558119] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-02T17:53:05.558533] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-02T17:53:05.560673] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-02T17:53:05.560815] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-02T17:53:05.612314] [DEBUG] [LOCAL ] C: Trimmed 77784 records to 54130 (keeping 200 days of data) [2025-10-02T17:53:06.052131] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T17:53:06.115304] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-02T17:53:06.114867] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-02T17:53:06.117573] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-02T17:53:06.120419] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-02T17:53:06.120550] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-02T17:53:06.127481] [DEBUG] [LOCAL ] BZH: Trimmed 46979 records to 32621 (keeping 200 days of data) [2025-10-02T17:53:06.533832] [DEBUG] [LOCAL ] BZH: Primary data saved (32621 records). [2025-10-02T17:53:06.540805] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-02T17:53:06.560954] [INFO ] [MAIN ] Update Progress: 381/2370 symbols completed. BZH took 43.5s. Estimated remaining: 4h 36m 55s. Rate: 7.2 symbols/min [2025-10-02T17:53:06.768479] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:06.787845] [DEBUG] [LOCAL ] C: Primary data saved (54130 records). [2025-10-02T17:53:06.788039] [INFO ] [MAIN ] C: Full history saved. [2025-10-02T17:53:06.789467] [INFO ] [MAIN ] Update Progress: 382/2370 symbols completed. C took 42.1s. Estimated remaining: 4h 36m 5s. Rate: 7.2 symbols/min [2025-10-02T17:53:07.018036] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:07.019884] [DEBUG] [LOCAL ] CADE: Loaded 48856 existing records from primary storage. [2025-10-02T17:53:07.020221] [INFO ] [MAIN ] CADE: Loaded 48856 existing records. [2025-10-02T17:53:07.231630] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:07.231995] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-02T17:53:07.232072] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-02T17:53:07.234265] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-02T17:53:07.234362] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-02T17:53:07.363151] [DEBUG] [LOCAL ] CAE: Loaded 39036 existing records from primary storage. [2025-10-02T17:53:07.379728] [INFO ] [MAIN ] CAE: Loaded 39036 existing records. [2025-10-02T17:53:07.866205] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:07.869547] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:07.870024] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-10-02T17:53:07.870217] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-02T17:53:07.871161] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-02T17:53:07.880356] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-02T17:53:07.880689] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-02T17:53:07.895743] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T17:53:07.958901] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-02T17:53:08.025223] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (3.96 seconds). [2025-10-02T17:53:08.102236] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-02T17:53:08.319885] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:08.320195] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-10-02T17:53:08.996686] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T17:53:09.001991] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-02T17:53:09.328329] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T17:53:09.338633] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-02T17:53:09.781478] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T17:53:09.790361] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-02T17:53:10.053289] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T17:53:10.061030] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-02T17:53:10.350144] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T17:53:10.356834] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-02T17:53:10.960723] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T17:53:10.971179] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-02T17:53:11.038519] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T17:53:11.048631] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-02T17:53:11.078288] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T17:53:11.080177] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T17:53:11.091524] [INFO ] [REMOTE ] CAAP: Full fetch complete (27843 records). [2025-10-02T17:53:11.092570] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-02T17:53:11.092251] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-02T17:53:11.568307] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-02T17:53:11.568445] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-02T17:53:11.569356] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-02T17:53:11.569435] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-02T17:53:11.570778] [DEBUG] [LOCAL ] CAAP: Trimmed 27843 records to 20146 (keeping 200 days of data) [2025-10-02T17:53:11.714032] [DEBUG] [LOCAL ] CAAP: Primary data saved (20146 records). [2025-10-02T17:53:11.714163] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-02T17:53:11.714309] [INFO ] [MAIN ] Update Progress: 383/2370 symbols completed. CAAP took 36.8s. Estimated remaining: 4h 35m 39s. Rate: 7.2 symbols/min [2025-10-02T17:53:11.926472] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:11.934091] [DEBUG] [LOCAL ] CAF: Loaded 3394 existing records from primary storage. [2025-10-02T17:53:11.934328] [INFO ] [MAIN ] CAF: Loaded 3394 existing records. [2025-10-02T17:53:12.144396] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:12.145019] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-02T17:53:12.145267] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-02T17:53:12.145754] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-02T17:53:12.145952] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-02T17:53:12.349907] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T17:53:12.428181] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-02T17:53:12.616949] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:12.632333] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-10-02T17:53:12.634121] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T17:53:12.654067] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-02T17:53:12.655232] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T17:53:12.665908] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-02T17:53:13.445258] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T17:53:13.448561] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-02T17:53:13.464279] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T17:53:13.470064] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-02T17:53:13.634562] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T17:53:13.643502] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-02T17:53:13.784243] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-02T17:53:13.786097] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-02T17:53:14.337408] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-02T17:53:14.339404] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-02T17:53:14.394209] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T17:53:14.405209] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-02T17:53:14.586592] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T17:53:14.592077] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-02T17:53:14.760191] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-02T17:53:14.761835] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-02T17:53:14.939162] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T17:53:14.949013] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-02T17:53:15.214445] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T17:53:15.216224] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-02T17:53:15.571802] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-02T17:53:15.573633] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-02T17:53:15.660734] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T17:53:15.665997] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-02T17:53:16.045304] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-02T17:53:16.046798] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-02T17:53:16.186248] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T17:53:16.195712] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-02T17:53:16.231932] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T17:53:16.243566] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-02T17:53:16.384339] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T17:53:16.389286] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-02T17:53:16.422723] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-02T17:53:17.073020] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-02T17:53:17.221780] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T17:53:17.379375] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-02T17:53:17.380693] [INFO ] [REMOTE ] CACI: Full fetch complete (38866 records). [2025-10-02T17:53:17.380783] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-02T17:53:17.497168] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-02T17:53:17.793319] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-02T17:53:17.793514] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-02T17:53:17.794190] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-02T17:53:17.794272] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-02T17:53:17.795533] [DEBUG] [LOCAL ] CACI: Trimmed 38866 records to 24689 (keeping 200 days of data) [2025-10-02T17:53:17.885638] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-02T17:53:17.998230] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T17:53:18.017212] [DEBUG] [LOCAL ] CACI: Primary data saved (24689 records). [2025-10-02T17:53:18.017936] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-02T17:53:18.018097] [INFO ] [MAIN ] Update Progress: 384/2370 symbols completed. CACI took 30.6s. Estimated remaining: 4h 35m 20s. Rate: 7.2 symbols/min [2025-10-02T17:53:18.220749] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:18.279373] [DEBUG] [LOCAL ] CAG: Loaded 53663 existing records from primary storage. [2025-10-02T17:53:18.279774] [INFO ] [MAIN ] CAG: Loaded 53663 existing records. [2025-10-02T17:53:18.488595] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:18.489004] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-02T17:53:18.489059] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-02T17:53:18.491114] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-10-02T17:53:18.491184] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-02T17:53:18.601802] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T17:53:18.674666] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-02T17:53:18.941291] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:19.195437] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T17:53:19.196284] [INFO ] [REMOTE ] CAF: Full fetch complete (5562 records). [2025-10-02T17:53:19.196358] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-02T17:53:19.478224] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-02T17:53:19.601578] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-02T17:53:19.601689] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-02T17:53:19.601893] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-02T17:53:19.601937] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-02T17:53:19.602346] [DEBUG] [LOCAL ] CAF: Trimmed 5562 records to 3421 (keeping 200 days of data) [2025-10-02T17:53:19.623143] [DEBUG] [LOCAL ] CAF: Primary data saved (3421 records). [2025-10-02T17:53:19.623292] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-02T17:53:19.623398] [INFO ] [MAIN ] Update Progress: 385/2370 symbols completed. CAF took 7.9s. Estimated remaining: 4h 34m 37s. Rate: 7.2 symbols/min [2025-10-02T17:53:19.811225] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:19.876473] [DEBUG] [LOCAL ] CAH: Loaded 51417 existing records from primary storage. [2025-10-02T17:53:19.876865] [INFO ] [MAIN ] CAH: Loaded 51417 existing records. [2025-10-02T17:53:20.079002] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:20.079275] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-02T17:53:20.079338] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-02T17:53:20.081667] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-02T17:53:20.081746] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-02T17:53:20.279482] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-10-02T17:53:20.470625] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:21.073070] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-10-02T17:53:21.189076] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T17:53:21.815872] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T17:53:21.872967] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-02T17:53:22.672977] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-02T17:53:22.786771] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T17:53:23.473059] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-02T17:53:23.559856] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T17:53:24.184584] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T17:53:24.273020] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-02T17:53:25.063228] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T17:53:25.074703] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-02T17:53:25.873036] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-02T17:53:25.923617] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T17:53:26.673056] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-02T17:53:27.001101] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-02T17:53:27.306707] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T17:53:27.473001] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-02T17:53:27.945989] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T17:53:28.273034] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-02T17:53:28.651024] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T17:53:28.653006] [INFO ] [REMOTE ] CAE: Full fetch complete (56071 records). [2025-10-02T17:53:28.653143] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-02T17:53:29.092802] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-02T17:53:29.096100] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-02T17:53:29.097092] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-02T17:53:29.097883] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-02T17:53:29.097953] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-02T17:53:29.099551] [DEBUG] [LOCAL ] CAE: Trimmed 56071 records to 39353 (keeping 200 days of data) [2025-10-02T17:53:29.340921] [DEBUG] [LOCAL ] CAE: Primary data saved (39353 records). [2025-10-02T17:53:29.341075] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-02T17:53:29.341166] [INFO ] [MAIN ] Update Progress: 386/2370 symbols completed. CAE took 22.6s. Estimated remaining: 4h 34m 36s. Rate: 7.2 symbols/min [2025-10-02T17:53:29.528949] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:29.573827] [DEBUG] [LOCAL ] CAL: Loaded 43156 existing records from primary storage. [2025-10-02T17:53:29.574180] [INFO ] [MAIN ] CAL: Loaded 43156 existing records. [2025-10-02T17:53:29.785662] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:29.785928] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-02T17:53:29.785980] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-02T17:53:29.787507] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-02T17:53:29.787586] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-02T17:53:29.901259] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-02T17:53:29.979243] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T17:53:30.255029] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:30.672988] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-10-02T17:53:30.711397] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T17:53:31.473079] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-02T17:53:31.722506] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T17:53:32.273034] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-02T17:53:32.345219] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:53:33.073015] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-02T17:53:33.231083] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:53:33.873029] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-02T17:53:34.063948] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T17:53:34.137517] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T17:53:34.673015] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-02T17:53:35.472972] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-02T17:53:35.823435] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-02T17:53:35.872758] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T17:53:36.273036] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-02T17:53:37.073014] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-02T17:53:37.335504] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T17:53:37.872973] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-02T17:53:38.054368] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T17:53:38.602438] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T17:53:38.673003] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-02T17:53:39.472970] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-02T17:53:39.541985] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T17:53:40.273010] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-02T17:53:40.593042] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T17:53:41.073028] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-02T17:53:41.112801] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T17:53:41.634609] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T17:53:41.872997] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-02T17:53:42.672961] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-02T17:53:42.805185] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T17:53:43.185786] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T17:53:43.472999] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-02T17:53:44.273041] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-02T17:53:44.732197] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T17:53:45.072984] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-02T17:53:45.392069] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T17:53:45.469251] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T17:53:45.873004] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-02T17:53:46.673001] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-02T17:53:46.928184] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T17:53:47.243676] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T17:53:47.245704] [INFO ] [REMOTE ] CADE: Full fetch complete (69922 records). [2025-10-02T17:53:47.245813] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-02T17:53:47.478964] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-02T17:53:47.666589] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-02T17:53:47.666704] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-02T17:53:47.667531] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-02T17:53:47.667593] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-02T17:53:47.669586] [DEBUG] [LOCAL ] CADE: Trimmed 69922 records to 49221 (keeping 200 days of data) [2025-10-02T17:53:47.942781] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T17:53:48.026599] [DEBUG] [LOCAL ] CADE: Primary data saved (49221 records). [2025-10-02T17:53:48.026772] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-02T17:53:48.026864] [INFO ] [MAIN ] Update Progress: 387/2370 symbols completed. CADE took 41.5s. Estimated remaining: 4h 35m 21s. Rate: 7.2 symbols/min [2025-10-02T17:53:48.206876] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:48.245117] [DEBUG] [LOCAL ] CALX: Loaded 37899 existing records from primary storage. [2025-10-02T17:53:48.245414] [INFO ] [MAIN ] CALX: Loaded 37899 existing records. [2025-10-02T17:53:48.278094] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-02T17:53:48.438892] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:48.439134] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-02T17:53:48.439185] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-02T17:53:48.440477] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-10-02T17:53:48.440540] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-02T17:53:48.832683] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:49.072980] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-10-02T17:53:49.262854] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T17:53:49.438035] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T17:53:49.873017] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-02T17:53:50.503110] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T17:53:50.672992] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-02T17:53:51.396493] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T17:53:51.473040] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-02T17:53:52.124063] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T17:53:52.273038] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-02T17:53:52.883927] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T17:53:52.886029] [INFO ] [REMOTE ] CAH: Full fetch complete (74616 records). [2025-10-02T17:53:52.886140] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-02T17:53:53.078141] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-02T17:53:53.319875] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-02T17:53:53.319961] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-02T17:53:53.320759] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-02T17:53:53.320828] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-02T17:53:53.322365] [DEBUG] [LOCAL ] CAH: Trimmed 74616 records to 51794 (keeping 200 days of data) [2025-10-02T17:53:53.672117] [DEBUG] [LOCAL ] CAH: Primary data saved (51794 records). [2025-10-02T17:53:53.672260] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-02T17:53:53.672347] [INFO ] [MAIN ] Update Progress: 388/2370 symbols completed. CAH took 34.0s. Estimated remaining: 4h 34m 59s. Rate: 7.2 symbols/min [2025-10-02T17:53:53.854779] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:53.880006] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-02T17:53:53.881939] [DEBUG] [LOCAL ] CANG: Loaded 26966 existing records from primary storage. [2025-10-02T17:53:53.882959] [INFO ] [MAIN ] CANG: Loaded 26966 existing records. [2025-10-02T17:53:54.097158] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:54.097487] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-02T17:53:54.097627] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-02T17:53:54.098687] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-02T17:53:54.098750] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-02T17:53:54.501999] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:54.537209] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T17:53:54.553483] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T17:53:54.556862] [INFO ] [REMOTE ] CAL: Full fetch complete (61833 records). [2025-10-02T17:53:54.556983] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-02T17:53:54.674225] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-02T17:53:55.007898] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-02T17:53:55.008075] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-02T17:53:55.008993] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-02T17:53:55.009159] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-02T17:53:55.039454] [DEBUG] [LOCAL ] CAL: Trimmed 61833 records to 43440 (keeping 200 days of data) [2025-10-02T17:53:55.040366] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T17:53:55.332435] [DEBUG] [LOCAL ] CAL: Primary data saved (43440 records). [2025-10-02T17:53:55.332610] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-02T17:53:55.333251] [INFO ] [MAIN ] Update Progress: 389/2370 symbols completed. CAL took 26.0s. Estimated remaining: 4h 34m 17s. Rate: 7.2 symbols/min [2025-10-02T17:53:55.482892] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-02T17:53:55.518289] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:55.529315] [DEBUG] [LOCAL ] CAPL: Loaded 5747 existing records from primary storage. [2025-10-02T17:53:55.530183] [INFO ] [MAIN ] CAPL: Loaded 5747 existing records. [2025-10-02T17:53:55.731866] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:55.732074] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-02T17:53:55.732122] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-02T17:53:55.732475] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-10-02T17:53:55.732537] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-02T17:53:56.125621] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:56.273015] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-10-02T17:53:56.402773] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-02T17:53:56.404866] [INFO ] [REMOTE ] CAG: Full fetch complete (77652 records). [2025-10-02T17:53:56.404987] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-02T17:53:56.859113] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-02T17:53:56.859227] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-02T17:53:56.860116] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-02T17:53:56.860316] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-02T17:53:56.888263] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T17:53:56.896926] [DEBUG] [LOCAL ] CAG: Trimmed 77652 records to 54053 (keeping 200 days of data) [2025-10-02T17:53:57.090276] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-10-02T17:53:57.136898] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T17:53:57.263907] [DEBUG] [LOCAL ] CAG: Primary data saved (54053 records). [2025-10-02T17:53:57.264058] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-02T17:53:57.264152] [INFO ] [MAIN ] Update Progress: 390/2370 symbols completed. CAG took 39.2s. Estimated remaining: 4h 33m 36s. Rate: 7.2 symbols/min [2025-10-02T17:53:57.451026] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:53:57.508744] [DEBUG] [LOCAL ] CARR: Loaded 53594 existing records from primary storage. [2025-10-02T17:53:57.509108] [INFO ] [MAIN ] CARR: Loaded 53594 existing records. [2025-10-02T17:53:57.736155] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:53:57.736428] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-02T17:53:57.736477] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-02T17:53:57.739327] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-10-02T17:53:57.739393] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-02T17:53:57.878258] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-02T17:53:58.239803] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:53:58.673059] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-02T17:53:58.727278] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T17:53:59.191588] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T17:53:59.472987] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-02T17:53:59.549601] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:54:00.060519] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T17:54:00.273044] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-10-02T17:54:01.073013] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-02T17:54:01.873002] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-02T17:54:02.188688] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T17:54:02.326932] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T17:54:02.673025] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-02T17:54:02.846802] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T17:54:03.473013] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-02T17:54:04.145782] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T17:54:04.273079] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-02T17:54:04.900526] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T17:54:04.976365] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T17:54:05.073011] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-02T17:54:05.748390] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-02T17:54:05.873000] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-02T17:54:06.673001] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-02T17:54:07.278319] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:54:07.473012] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-02T17:54:08.273007] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-02T17:54:08.400045] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T17:54:09.014379] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-02T17:54:09.072970] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-02T17:54:09.564459] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T17:54:09.872999] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-02T17:54:10.166217] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T17:54:10.673059] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-02T17:54:11.237517] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:54:11.473035] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-02T17:54:12.045013] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T17:54:12.206408] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T17:54:12.273022] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-02T17:54:13.073011] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-02T17:54:13.491892] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T17:54:13.493482] [INFO ] [REMOTE ] CALX: Full fetch complete (54030 records). [2025-10-02T17:54:13.493580] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-02T17:54:13.880399] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-02T17:54:13.916710] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-02T17:54:13.916825] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-02T17:54:13.917760] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-02T17:54:13.917929] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-02T17:54:13.919561] [DEBUG] [LOCAL ] CALX: Trimmed 54030 records to 38123 (keeping 200 days of data) [2025-10-02T17:54:14.151528] [DEBUG] [LOCAL ] CALX: Primary data saved (38123 records). [2025-10-02T17:54:14.151706] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-02T17:54:14.151809] [INFO ] [MAIN ] Update Progress: 391/2370 symbols completed. CALX took 26.1s. Estimated remaining: 4h 34m 11s. Rate: 7.2 symbols/min [2025-10-02T17:54:14.335724] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:54:14.376194] [DEBUG] [LOCAL ] CARS: Loaded 39803 existing records from primary storage. [2025-10-02T17:54:14.376528] [INFO ] [MAIN ] CARS: Loaded 39803 existing records. [2025-10-02T17:54:14.585290] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:54:14.585626] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-02T17:54:14.585720] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-02T17:54:14.587124] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-10-02T17:54:14.587192] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-02T17:54:14.676145] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-02T17:54:14.709040] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T17:54:15.024311] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:54:15.056828] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T17:54:15.473024] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-10-02T17:54:15.867564] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T17:54:16.273006] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-02T17:54:16.927671] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T17:54:17.072981] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-02T17:54:17.124479] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T17:54:17.680337] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T17:54:17.873010] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-02T17:54:18.444904] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-02T17:54:18.673008] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-02T17:54:19.473019] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-02T17:54:20.058852] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T17:54:20.273005] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-02T17:54:20.914060] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T17:54:20.915015] [INFO ] [REMOTE ] CAPL: Full fetch complete (8829 records). [2025-10-02T17:54:20.915097] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-02T17:54:21.080059] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-02T17:54:21.333302] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-02T17:54:21.333554] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-02T17:54:21.333853] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-02T17:54:21.333933] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-02T17:54:21.334892] [DEBUG] [LOCAL ] CAPL: Trimmed 8829 records to 5818 (keeping 200 days of data) [2025-10-02T17:54:21.373461] [DEBUG] [LOCAL ] CAPL: Primary data saved (5818 records). [2025-10-02T17:54:21.373773] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-02T17:54:21.373889] [INFO ] [MAIN ] Update Progress: 392/2370 symbols completed. CAPL took 26.0s. Estimated remaining: 4h 33m 57s. Rate: 7.2 symbols/min [2025-10-02T17:54:21.562074] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-02T17:54:21.649224] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:54:21.706595] [DEBUG] [LOCAL ] CAT: Loaded 52920 existing records from primary storage. [2025-10-02T17:54:21.706993] [INFO ] [MAIN ] CAT: Loaded 52920 existing records. [2025-10-02T17:54:21.881704] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-02T17:54:21.914593] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:54:21.914825] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-02T17:54:21.914874] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-02T17:54:21.917111] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-02T17:54:21.917178] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-02T17:54:22.336891] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:54:22.565046] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T17:54:22.673019] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-10-02T17:54:23.473011] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-02T17:54:23.689523] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T17:54:24.273007] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-02T17:54:24.463576] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T17:54:24.743063] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T17:54:25.072975] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-02T17:54:25.114576] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T17:54:25.873027] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-02T17:54:26.393607] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T17:54:26.672985] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-02T17:54:26.834227] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T17:54:27.472992] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-02T17:54:28.273013] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-02T17:54:28.577621] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T17:54:28.579082] [INFO ] [REMOTE ] CANG: Full fetch complete (40533 records). [2025-10-02T17:54:28.579164] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-02T17:54:29.016369] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-02T17:54:29.051883] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-02T17:54:29.051980] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-02T17:54:29.052534] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-02T17:54:29.052576] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-02T17:54:29.053546] [DEBUG] [LOCAL ] CANG: Trimmed 40533 records to 27199 (keeping 200 days of data) [2025-10-02T17:54:29.097955] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-02T17:54:29.210916] [DEBUG] [LOCAL ] CANG: Primary data saved (27199 records). [2025-10-02T17:54:29.211066] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-02T17:54:29.211150] [INFO ] [MAIN ] Update Progress: 393/2370 symbols completed. CANG took 35.5s. Estimated remaining: 4h 33m 47s. Rate: 7.2 symbols/min [2025-10-02T17:54:29.392090] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:54:29.401559] [DEBUG] [LOCAL ] CATO: Loaded 7016 existing records from primary storage. [2025-10-02T17:54:29.401810] [INFO ] [MAIN ] CATO: Loaded 7016 existing records. [2025-10-02T17:54:29.599575] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:54:29.600111] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-02T17:54:29.600173] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-02T17:54:29.600562] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-02T17:54:29.600688] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-02T17:54:29.878865] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-02T17:54:30.012946] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:54:30.046683] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T17:54:30.673003] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-02T17:54:31.197752] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-02T17:54:31.245153] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T17:54:31.472987] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-02T17:54:32.272975] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-10-02T17:54:32.685068] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T17:54:33.019077] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T17:54:33.072994] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-02T17:54:33.119753] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T17:54:33.872993] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-02T17:54:34.603020] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T17:54:34.673009] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-02T17:54:35.377486] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-02T17:54:35.472997] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-02T17:54:36.272976] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-02T17:54:36.469482] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:54:36.686738] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-02T17:54:37.073004] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-02T17:54:37.743159] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-02T17:54:37.873030] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-02T17:54:38.663022] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T17:54:38.672950] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-02T17:54:39.027060] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T17:54:39.472988] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-02T17:54:39.750061] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T17:54:40.218163] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T17:54:40.272991] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-02T17:54:40.906807] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T17:54:41.072980] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-02T17:54:41.553701] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-02T17:54:41.872999] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-02T17:54:42.673038] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-02T17:54:43.472999] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-02T17:54:43.547614] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T17:54:43.550195] [INFO ] [REMOTE ] CARR: Full fetch complete (77607 records). [2025-10-02T17:54:43.550344] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-02T17:54:43.972541] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-02T17:54:43.972890] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-02T17:54:43.974096] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-02T17:54:43.974172] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-02T17:54:43.977063] [DEBUG] [LOCAL ] CARR: Trimmed 77607 records to 53984 (keeping 200 days of data) [2025-10-02T17:54:44.081694] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T17:54:44.285331] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-02T17:54:44.342069] [DEBUG] [LOCAL ] CARR: Primary data saved (53984 records). [2025-10-02T17:54:44.342226] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-02T17:54:44.342326] [INFO ] [MAIN ] Update Progress: 394/2370 symbols completed. CARR took 47.1s. Estimated remaining: 4h 34m 13s. Rate: 7.2 symbols/min [2025-10-02T17:54:44.528950] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:54:44.566947] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T17:54:44.628434] [DEBUG] [LOCAL ] CAVA: Loaded 53552 existing records from primary storage. [2025-10-02T17:54:44.628799] [INFO ] [MAIN ] CAVA: Loaded 53552 existing records. [2025-10-02T17:54:44.816003] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:54:44.816402] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-02T17:54:44.816466] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-02T17:54:44.818572] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-02T17:54:44.818636] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-02T17:54:45.073095] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-02T17:54:45.060246] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T17:54:45.225952] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:54:45.873007] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-02T17:54:46.664355] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T17:54:46.672962] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-02T17:54:47.473014] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-02T17:54:47.790158] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T17:54:47.952156] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-02T17:54:48.223760] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T17:54:48.272995] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-02T17:54:48.967151] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T17:54:48.968070] [INFO ] [REMOTE ] CATO: Full fetch complete (11518 records). [2025-10-02T17:54:48.968143] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-02T17:54:49.076723] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-02T17:54:49.362466] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-02T17:54:49.362581] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-02T17:54:49.362929] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-02T17:54:49.363001] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-02T17:54:49.363478] [DEBUG] [LOCAL ] CATO: Trimmed 11518 records to 7127 (keeping 200 days of data) [2025-10-02T17:54:49.404484] [DEBUG] [LOCAL ] CATO: Primary data saved (7127 records). [2025-10-02T17:54:49.404601] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-02T17:54:49.404711] [INFO ] [MAIN ] Update Progress: 395/2370 symbols completed. CATO took 20.2s. Estimated remaining: 4h 33m 48s. Rate: 7.2 symbols/min [2025-10-02T17:54:49.597479] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:54:49.662280] [DEBUG] [LOCAL ] CB: Loaded 49947 existing records from primary storage. [2025-10-02T17:54:49.662634] [INFO ] [MAIN ] CB: Loaded 49947 existing records. [2025-10-02T17:54:49.859048] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:54:49.859315] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-02T17:54:49.859378] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-02T17:54:49.861338] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-02T17:54:49.861415] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-02T17:54:49.883385] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-02T17:54:50.253992] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:54:50.673053] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-10-02T17:54:51.324006] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-02T17:54:51.472309] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T17:54:51.480513] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-02T17:54:52.132543] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T17:54:52.273043] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-10-02T17:54:53.073001] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-02T17:54:53.701856] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-02T17:54:53.873000] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-02T17:54:54.521515] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-10-02T17:54:54.535799] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T17:54:54.673008] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-02T17:54:55.473021] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-02T17:54:55.896909] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T17:54:56.154928] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T17:54:56.273060] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-02T17:54:57.073064] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-02T17:54:57.272580] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T17:54:57.873026] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-02T17:54:58.192446] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-02T17:54:58.194571] [INFO ] [REMOTE ] CAT: Full fetch complete (76685 records). [2025-10-02T17:54:58.194759] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-02T17:54:58.331502] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T17:54:58.354592] [INFO ] [REMOTE ] CARS: Full fetch complete (55453 records). [2025-10-02T17:54:58.383163] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-02T17:54:58.673670] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-02T17:54:58.881024] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-02T17:54:58.896833] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-02T17:54:58.897947] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-02T17:54:58.903203] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-02T17:54:59.023500] [DEBUG] [LOCAL ] CAT: Trimmed 76685 records to 53308 (keeping 200 days of data) [2025-10-02T17:54:59.211139] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-02T17:54:59.212518] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-02T17:54:59.213124] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-02T17:54:59.213203] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-02T17:54:59.219208] [DEBUG] [LOCAL ] CARS: Trimmed 55453 records to 40093 (keeping 200 days of data) [2025-10-02T17:54:59.707412] [DEBUG] [LOCAL ] CARS: Primary data saved (40093 records). [2025-10-02T17:54:59.708441] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-02T17:54:59.708918] [INFO ] [MAIN ] Update Progress: 396/2370 symbols completed. CARS took 45.6s. Estimated remaining: 4h 33m 50s. Rate: 7.2 symbols/min [2025-10-02T17:54:59.912412] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:54:59.925476] [DEBUG] [LOCAL ] CAT: Primary data saved (53308 records). [2025-10-02T17:54:59.925736] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-02T17:54:59.927180] [INFO ] [MAIN ] Update Progress: 397/2370 symbols completed. CAT took 38.6s. Estimated remaining: 4h 33m 1s. Rate: 7.2 symbols/min [2025-10-02T17:54:59.932501] [DEBUG] [LOCAL ] CBAN: Loaded 10857 existing records from primary storage. [2025-10-02T17:54:59.932779] [INFO ] [MAIN ] CBAN: Loaded 10857 existing records. [2025-10-02T17:55:00.132881] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:55:00.133519] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-02T17:55:00.172153] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-02T17:55:00.173291] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-02T17:55:00.174557] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-02T17:55:00.174433] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-10-02T17:55:00.245937] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-02T17:55:00.262789] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T17:55:00.325071] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-02T17:55:00.626869] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:01.072991] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-10-02T17:55:02.079876] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T17:55:02.082484] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-02T17:55:02.515498] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-02T17:55:02.663316] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-10-02T17:55:02.675430] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-02T17:55:02.687499] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T17:55:03.473006] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-02T17:55:04.273046] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-02T17:55:04.342351] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T17:55:04.986585] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-02T17:55:05.073016] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-02T17:55:05.873002] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-02T17:55:06.083937] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T17:55:06.448839] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-02T17:55:06.673043] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-02T17:55:07.474452] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-02T17:55:07.653689] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T17:55:07.654251] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-02T17:55:08.273030] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-02T17:55:09.072967] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-02T17:55:09.102360] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T17:55:09.582355] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-02T17:55:09.873023] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-02T17:55:10.559057] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T17:55:10.649529] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T17:55:10.672961] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-02T17:55:11.453676] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T17:55:11.472973] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-02T17:55:12.181114] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T17:55:12.273001] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-02T17:55:13.073060] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-02T17:55:13.872983] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-02T17:55:14.211709] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-02T17:55:14.642314] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T17:55:14.672962] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-02T17:55:15.075236] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T17:55:15.473045] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-02T17:55:16.015617] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T17:55:16.016464] [INFO ] [REMOTE ] CBAN: Full fetch complete (16082 records). [2025-10-02T17:55:16.016539] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-02T17:55:16.017038] [FATAL] [VALIDATOR ] CBAN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:55:16.017147] [FATAL] [MAIN ] CBAN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:55:16.017221] [WARN ] [MAIN ] CBAN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:55:16.017291] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-02T17:55:16.017356] [DEBUG] [LOCAL ] CBAN: No primary data file found to delete. [2025-10-02T17:55:16.017396] [INFO ] [LOCAL ] CBAN: Starting deletion of derivative data. [2025-10-02T17:55:16.017797] [DEBUG] [LOCAL ] CBAN: Deleted derivative data file. [2025-10-02T17:55:16.017892] [INFO ] [MAIN ] Update Progress: 398/2370 symbols completed. CBAN took 16.3s. Estimated remaining: 4h 33m 31s. Rate: 7.2 symbols/min [2025-10-02T17:55:16.273045] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-02T17:55:16.523727] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T17:55:17.073044] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-02T17:55:18.191102] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T17:55:18.202900] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-02T17:55:18.513273] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:55:18.673032] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-02T17:55:20.167724] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T17:55:20.169924] [INFO ] [REMOTE ] CB: Full fetch complete (72650 records). [2025-10-02T17:55:20.170023] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-02T17:55:20.677351] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-02T17:55:20.677238] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-10-02T17:55:20.677503] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-02T17:55:20.690236] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-02T17:55:20.690866] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-02T17:55:20.692765] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-02T17:55:20.694389] [DEBUG] [LOCAL ] CB: Trimmed 72650 records to 50296 (keeping 200 days of data) [2025-10-02T17:55:21.034451] [DEBUG] [LOCAL ] CB: Primary data saved (50296 records). [2025-10-02T17:55:21.034596] [INFO ] [MAIN ] CB: Full history saved. [2025-10-02T17:55:21.034738] [INFO ] [MAIN ] Update Progress: 399/2370 symbols completed. CB took 31.6s. Estimated remaining: 4h 33m 7s. Rate: 7.2 symbols/min [2025-10-02T17:55:22.763524] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-02T17:55:22.778046] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-02T17:55:24.641447] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-02T17:55:24.644236] [INFO ] [REMOTE ] CAVA: Full fetch complete (77298 records). [2025-10-02T17:55:24.644388] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-02T17:55:25.079997] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-02T17:55:25.080091] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-02T17:55:25.080921] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-02T17:55:25.081046] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-02T17:55:25.082633] [DEBUG] [LOCAL ] CAVA: Trimmed 77298 records to 53942 (keeping 200 days of data) [2025-10-02T17:55:25.428676] [DEBUG] [LOCAL ] CAVA: Primary data saved (53942 records). [2025-10-02T17:55:25.428848] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-02T17:55:25.429081] [INFO ] [MAIN ] Update Progress: 400/2370 symbols completed. CAVA took 41.1s. Estimated remaining: 4h 32m 39s. Rate: 7.2 symbols/min [2025-10-02T17:55:26.133390] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:55:26.126782] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:55:26.181822] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-02T17:55:26.235167] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-02T17:55:26.240701] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:55:26.255620] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-02T17:55:26.335515] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:55:26.335798] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-02T17:55:26.336596] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-02T17:55:26.337292] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-02T17:55:26.421918] [DEBUG] [LOCAL ] CBNA: Loaded 2915 existing records from primary storage. [2025-10-02T17:55:26.455283] [INFO ] [MAIN ] CBNA: Loaded 2915 existing records. [2025-10-02T17:55:26.589174] [DEBUG] [LOCAL ] CBL: Loaded 16243 existing records from primary storage. [2025-10-02T17:55:26.660062] [INFO ] [MAIN ] CBL: Loaded 16243 existing records. [2025-10-02T17:55:26.748479] [DEBUG] [LOCAL ] CBRE: Loaded 50580 existing records from primary storage. [2025-10-02T17:55:26.841596] [INFO ] [MAIN ] CBRE: Loaded 50580 existing records. [2025-10-02T17:55:27.117234] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:55:27.136963] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-02T17:55:27.190781] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-02T17:55:27.277399] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-02T17:55:27.314352] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-02T17:55:27.392577] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:27.436220] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-10-02T17:55:27.500169] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:55:27.581879] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-02T17:55:27.598380] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-02T17:55:27.608454] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-02T17:55:27.576420] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:55:27.608621] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-02T17:55:27.614268] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-02T17:55:27.678547] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-02T17:55:27.792122] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-02T17:55:27.843159] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:55:27.861371] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-02T17:55:27.885608] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-10-02T17:55:28.139025] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:55:28.181700] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-02T17:55:28.193576] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:55:28.209362] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-02T17:55:28.295941] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-02T17:55:28.301738] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-02T17:55:28.405973] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:28.353623] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-02T17:55:28.411673] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-10-02T17:55:28.412600] [INFO ] [MAIN ] Update Progress: 401/2370 symbols completed. CBO took 3.0s. Estimated remaining: 4h 32m 5s. Rate: 7.2 symbols/min [2025-10-02T17:55:28.678135] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:28.751824] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-10-02T17:55:28.969779] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:55:29.020554] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:29.021038] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-10-02T17:55:29.049891] [DEBUG] [LOCAL ] CBT: Loaded 30845 existing records from primary storage. [2025-10-02T17:55:29.050256] [INFO ] [MAIN ] CBT: Loaded 30845 existing records. [2025-10-02T17:55:29.255185] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:55:29.260843] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-02T17:55:29.260971] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-02T17:55:29.260717] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T17:55:29.262957] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-02T17:55:29.263044] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-02T17:55:29.263976] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-02T17:55:29.674210] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:29.674717] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-10-02T17:55:29.760053] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-02T17:55:29.761948] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-02T17:55:30.045505] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T17:55:30.050557] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-02T17:55:30.225725] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-02T17:55:30.227103] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-02T17:55:30.882632] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T17:55:30.893484] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-02T17:55:30.906458] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T17:55:30.907890] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-02T17:55:31.007163] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T17:55:31.012191] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-02T17:55:31.104613] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T17:55:31.111583] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-02T17:55:31.357567] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T17:55:31.472998] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-02T17:55:32.052357] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T17:55:32.060812] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T17:55:32.272967] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-02T17:55:32.355313] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T17:55:32.559016] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T17:55:32.606064] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-02T17:55:33.073004] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-02T17:55:33.873007] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-02T17:55:34.678124] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-02T17:55:34.696901] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T17:55:34.884804] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T17:55:35.159768] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-02T17:55:35.473004] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-02T17:55:36.026874] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T17:55:36.272994] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-02T17:55:37.072987] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-02T17:55:37.515693] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T17:55:37.872995] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-02T17:55:38.656631] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T17:55:38.672960] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-02T17:55:39.040005] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-02T17:55:39.472974] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-02T17:55:39.639493] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T17:55:40.273017] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-02T17:55:40.782791] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-02T17:55:40.804106] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T17:55:41.073063] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-02T17:55:41.873045] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-02T17:55:42.606778] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T17:55:42.673012] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-02T17:55:43.472987] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-02T17:55:43.796780] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T17:55:43.862230] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T17:55:44.178611] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T17:55:44.179409] [INFO ] [REMOTE ] CBNA: Full fetch complete (4581 records). [2025-10-02T17:55:44.179485] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-02T17:55:44.278102] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-02T17:55:44.591120] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-02T17:55:44.591202] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-02T17:55:44.591359] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-02T17:55:44.591403] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-02T17:55:44.591893] [DEBUG] [LOCAL ] CBNA: Trimmed 4581 records to 2927 (keeping 200 days of data) [2025-10-02T17:55:44.609554] [DEBUG] [LOCAL ] CBNA: Primary data saved (2927 records). [2025-10-02T17:55:44.609687] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-02T17:55:44.609785] [INFO ] [MAIN ] Update Progress: 402/2370 symbols completed. CBNA took 19.2s. Estimated remaining: 4h 32m 35s. Rate: 7.2 symbols/min [2025-10-02T17:55:44.800211] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:55:44.824078] [DEBUG] [LOCAL ] CBU: Loaded 22654 existing records from primary storage. [2025-10-02T17:55:44.824341] [INFO ] [MAIN ] CBU: Loaded 22654 existing records. [2025-10-02T17:55:45.028787] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:55:45.029053] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-02T17:55:45.029103] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-02T17:55:45.029783] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-02T17:55:45.029845] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-02T17:55:45.078196] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-02T17:55:45.440846] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:55:45.872971] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-10-02T17:55:46.097465] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T17:55:46.161402] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-02T17:55:46.673047] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-02T17:55:46.963410] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T17:55:47.473025] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-02T17:55:48.272990] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-02T17:55:48.321350] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T17:55:48.554674] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T17:55:49.073016] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-02T17:55:49.325830] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T17:55:49.872994] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-02T17:55:50.090801] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T17:55:50.672996] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-02T17:55:51.478172] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-02T17:55:51.509452] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T17:55:51.937301] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-02T17:55:52.273015] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-02T17:55:52.486336] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-02T17:55:53.073005] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-02T17:55:53.873003] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-02T17:55:54.003493] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T17:55:54.034077] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-02T17:55:54.673079] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-02T17:55:54.979233] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T17:55:55.473023] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-02T17:55:56.272976] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-02T17:55:56.389176] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T17:55:56.553999] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T17:55:57.073013] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-02T17:55:57.444981] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T17:55:57.873033] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-02T17:55:58.030778] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T17:55:58.672974] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-02T17:55:59.072050] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T17:55:59.473061] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-02T17:55:59.571689] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T17:55:59.573019] [INFO ] [REMOTE ] CBL: Full fetch complete (25495 records). [2025-10-02T17:55:59.573133] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-02T17:56:00.123271] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-02T17:56:00.123366] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-02T17:56:00.123905] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-02T17:56:00.123974] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-02T17:56:00.124916] [DEBUG] [LOCAL ] CBL: Trimmed 25495 records to 16371 (keeping 200 days of data) [2025-10-02T17:56:00.259996] [DEBUG] [LOCAL ] CBL: Primary data saved (16371 records). [2025-10-02T17:56:00.260185] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-02T17:56:00.260303] [INFO ] [MAIN ] Update Progress: 403/2370 symbols completed. CBL took 34.8s. Estimated remaining: 4h 33m 2s. Rate: 7.2 symbols/min [2025-10-02T17:56:00.278248] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-02T17:56:00.466152] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:00.466383] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-02T17:56:00.466439] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-02T17:56:00.466562] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-02T17:56:00.466604] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-02T17:56:00.466691] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-02T17:56:00.466763] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-02T17:56:00.873506] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:00.915345] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T17:56:01.072997] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-02T17:56:01.873059] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-10-02T17:56:01.974785] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T17:56:01.989898] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T17:56:01.989384] [INFO ] [REMOTE ] CBRE: Full fetch complete (73940 records). [2025-10-02T17:56:01.994157] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-02T17:56:02.092840] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:56:02.130214] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-10-02T17:56:02.134511] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:56:02.134962] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-02T17:56:02.145693] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:56:02.156023] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-02T17:56:02.183623] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-02T17:56:02.200473] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-02T17:56:02.209913] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-02T17:56:02.239617] [INFO ] [MAIN ] Update Progress: 404/2370 symbols completed. CBX took 2.0s. Estimated remaining: 4h 32m 23s. Rate: 7.2 symbols/min [2025-10-02T17:56:02.671000] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-02T17:56:02.674622] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:02.674819] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-02T17:56:02.675892] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-02T17:56:02.676317] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-02T17:56:02.672972] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-02T17:56:02.678977] [DEBUG] [LOCAL ] CBRE: Trimmed 73940 records to 50924 (keeping 200 days of data) [2025-10-02T17:56:02.821457] [DEBUG] [LOCAL ] CBZ: Loaded 33691 existing records from primary storage. [2025-10-02T17:56:02.831393] [INFO ] [MAIN ] CBZ: Loaded 33691 existing records. [2025-10-02T17:56:03.136025] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:03.140416] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-02T17:56:03.152504] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-02T17:56:03.154606] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-02T17:56:03.155807] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-02T17:56:03.474045] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-02T17:56:03.659793] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:03.666597] [DEBUG] [LOCAL ] CBRE: Primary data saved (50924 records). [2025-10-02T17:56:03.666738] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-02T17:56:03.666829] [INFO ] [MAIN ] Update Progress: 405/2370 symbols completed. CBRE took 38.2s. Estimated remaining: 4h 31m 42s. Rate: 7.2 symbols/min [2025-10-02T17:56:03.843609] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T17:56:03.865132] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:03.867293] [INFO ] [REMOTE ] CBT: Full fetch complete (45741 records). [2025-10-02T17:56:03.867428] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-02T17:56:04.282081] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-10-02T17:56:04.290918] [DEBUG] [LOCAL ] CC: Loaded 53000 existing records from primary storage. [2025-10-02T17:56:04.329126] [INFO ] [MAIN ] CC: Loaded 53000 existing records. [2025-10-02T17:56:04.347953] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-02T17:56:04.348079] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-02T17:56:04.348861] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-02T17:56:04.348948] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-02T17:56:04.471828] [DEBUG] [LOCAL ] CBT: Trimmed 45741 records to 31073 (keeping 200 days of data) [2025-10-02T17:56:04.665031] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:04.674066] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-02T17:56:04.674299] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-02T17:56:04.696189] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-02T17:56:04.696841] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-02T17:56:04.866400] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T17:56:05.080195] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-02T17:56:05.227347] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:05.230479] [DEBUG] [LOCAL ] CBT: Primary data saved (31073 records). [2025-10-02T17:56:05.230976] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-02T17:56:05.231095] [INFO ] [MAIN ] Update Progress: 406/2370 symbols completed. CBT took 36.8s. Estimated remaining: 4h 31m 1s. Rate: 7.2 symbols/min [2025-10-02T17:56:05.446519] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:05.501317] [DEBUG] [LOCAL ] CCI: Loaded 53139 existing records from primary storage. [2025-10-02T17:56:05.501902] [INFO ] [MAIN ] CCI: Loaded 53139 existing records. [2025-10-02T17:56:05.732003] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:05.732365] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-02T17:56:05.732471] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-02T17:56:05.740454] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-02T17:56:05.755047] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-02T17:56:05.781706] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T17:56:05.878143] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-02T17:56:06.200574] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:06.212552] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-02T17:56:06.673014] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-02T17:56:07.040479] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T17:56:07.473043] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-10-02T17:56:07.556391] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T17:56:08.273044] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-10-02T17:56:09.003008] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T17:56:09.073040] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-02T17:56:09.872998] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-02T17:56:10.236097] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T17:56:10.673011] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-02T17:56:10.797823] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T17:56:11.058002] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T17:56:11.473018] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-02T17:56:11.842310] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T17:56:11.843968] [INFO ] [REMOTE ] CBU: Full fetch complete (32339 records). [2025-10-02T17:56:11.844088] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-02T17:56:12.278173] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-02T17:56:12.330016] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-02T17:56:12.330114] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-02T17:56:12.330741] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-02T17:56:12.330841] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-02T17:56:12.332729] [DEBUG] [LOCAL ] CBU: Trimmed 32339 records to 22817 (keeping 200 days of data) [2025-10-02T17:56:12.482575] [DEBUG] [LOCAL ] CBU: Primary data saved (22817 records). [2025-10-02T17:56:12.482740] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-02T17:56:12.482836] [INFO ] [MAIN ] Update Progress: 407/2370 symbols completed. CBU took 27.9s. Estimated remaining: 4h 30m 47s. Rate: 7.2 symbols/min [2025-10-02T17:56:12.670999] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:12.671428] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-02T17:56:12.671528] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-02T17:56:12.671782] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-02T17:56:12.671835] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-02T17:56:12.671879] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-02T17:56:12.671912] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-02T17:56:12.837829] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T17:56:13.082951] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-02T17:56:13.117873] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:13.872999] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-10-02T17:56:14.245517] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-02T17:56:14.251986] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-02T17:56:14.528314] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T17:56:14.673032] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-02T17:56:15.473062] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-02T17:56:15.758925] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-02T17:56:16.062475] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:56:16.273057] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-02T17:56:17.073055] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-02T17:56:17.405495] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T17:56:17.873103] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-02T17:56:18.191892] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T17:56:18.673103] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-02T17:56:18.932953] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T17:56:18.994909] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-02T17:56:19.473040] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-02T17:56:19.886913] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-02T17:56:20.273084] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-02T17:56:21.073072] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-02T17:56:21.873049] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-02T17:56:22.037237] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:56:22.202527] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-02T17:56:22.485632] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T17:56:22.673027] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-02T17:56:23.473017] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-02T17:56:24.273008] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-02T17:56:24.556552] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T17:56:24.621898] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T17:56:25.073038] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-02T17:56:25.292297] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T17:56:25.429952] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-02T17:56:25.873001] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-02T17:56:26.310975] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-02T17:56:26.673004] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-02T17:56:27.473000] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-02T17:56:28.146769] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T17:56:28.273017] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-02T17:56:28.979938] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T17:56:29.073000] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-02T17:56:29.550603] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T17:56:29.872996] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-02T17:56:30.672996] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-02T17:56:30.958861] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T17:56:31.472996] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-02T17:56:31.552398] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T17:56:31.740527] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-02T17:56:31.871468] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T17:56:32.272996] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-02T17:56:33.073005] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-02T17:56:33.461890] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T17:56:33.462567] [INFO ] [REMOTE ] CCIA: Full fetch complete (2068 records). [2025-10-02T17:56:33.462663] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-02T17:56:33.676200] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T17:56:33.676496] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:56:33.676669] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:56:33.676884] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-02T17:56:33.677025] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-02T17:56:33.677197] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-02T17:56:33.677378] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-02T17:56:33.677469] [INFO ] [MAIN ] Update Progress: 408/2370 symbols completed. CCIA took 21.2s. Estimated remaining: 4h 31m 41s. Rate: 7.2 symbols/min [2025-10-02T17:56:33.871542] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:33.872992] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-02T17:56:33.914004] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T17:56:33.931786] [DEBUG] [LOCAL ] CCIF: Loaded 15750 existing records from primary storage. [2025-10-02T17:56:33.932035] [INFO ] [MAIN ] CCIF: Loaded 15750 existing records. [2025-10-02T17:56:34.121424] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:34.121638] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-02T17:56:34.121723] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-02T17:56:34.122387] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-02T17:56:34.122470] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-02T17:56:34.522453] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:34.673002] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-02T17:56:35.143509] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T17:56:35.145191] [INFO ] [REMOTE ] CBZ: Full fetch complete (45528 records). [2025-10-02T17:56:35.145303] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-02T17:56:35.478085] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-02T17:56:35.555140] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-02T17:56:35.555219] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-02T17:56:35.555874] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-02T17:56:35.555938] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-02T17:56:35.556979] [DEBUG] [LOCAL ] CBZ: Trimmed 45528 records to 33974 (keeping 200 days of data) [2025-10-02T17:56:35.760395] [DEBUG] [LOCAL ] CBZ: Primary data saved (33974 records). [2025-10-02T17:56:35.760562] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-02T17:56:35.760685] [INFO ] [MAIN ] Update Progress: 409/2370 symbols completed. CBZ took 33.5s. Estimated remaining: 4h 31m 3s. Rate: 7.2 symbols/min [2025-10-02T17:56:35.943860] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:35.996461] [DEBUG] [LOCAL ] CCJ: Loaded 53674 existing records from primary storage. [2025-10-02T17:56:35.996878] [INFO ] [MAIN ] CCJ: Loaded 53674 existing records. [2025-10-02T17:56:36.210301] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:36.210666] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-02T17:56:36.210747] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-02T17:56:36.212087] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-02T17:56:36.212242] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-02T17:56:36.277450] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-10-02T17:56:36.401618] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T17:56:36.636285] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:37.073073] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-10-02T17:56:37.296487] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T17:56:37.400676] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T17:56:37.873020] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-02T17:56:38.672973] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-02T17:56:38.998711] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T17:56:39.473006] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-02T17:56:39.746391] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T17:56:40.272970] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-02T17:56:40.624126] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T17:56:40.964892] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T17:56:41.072990] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-02T17:56:41.560956] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-02T17:56:41.872970] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-02T17:56:42.012986] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-02T17:56:42.672994] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-02T17:56:43.473008] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-02T17:56:43.728937] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T17:56:44.272996] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-02T17:56:44.378884] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T17:56:44.898954] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-10-02T17:56:45.072995] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-02T17:56:45.872980] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-02T17:56:46.145556] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T17:56:46.672996] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-02T17:56:46.882817] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T17:56:47.035254] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T17:56:47.473002] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-02T17:56:48.272977] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-02T17:56:48.347750] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T17:56:48.349939] [INFO ] [REMOTE ] CCI: Full fetch complete (76998 records). [2025-10-02T17:56:48.350043] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-02T17:56:48.788727] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-02T17:56:48.788897] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-02T17:56:48.789756] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-02T17:56:48.789823] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-02T17:56:48.791298] [DEBUG] [LOCAL ] CCI: Trimmed 76998 records to 53529 (keeping 200 days of data) [2025-10-02T17:56:49.096126] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-02T17:56:49.154870] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T17:56:49.191943] [DEBUG] [LOCAL ] CCI: Primary data saved (53529 records). [2025-10-02T17:56:49.192102] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-02T17:56:49.192192] [INFO ] [MAIN ] Update Progress: 410/2370 symbols completed. CCI took 44.0s. Estimated remaining: 4h 31m 19s. Rate: 7.2 symbols/min [2025-10-02T17:56:49.382133] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:49.428929] [DEBUG] [LOCAL ] CCK: Loaded 46232 existing records from primary storage. [2025-10-02T17:56:49.429247] [INFO ] [MAIN ] CCK: Loaded 46232 existing records. [2025-10-02T17:56:49.616259] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:49.616503] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-02T17:56:49.616564] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-02T17:56:49.617768] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-10-02T17:56:49.617831] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-02T17:56:49.881127] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-02T17:56:50.000171] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:50.276113] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T17:56:50.313938] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-02T17:56:50.673021] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-02T17:56:51.304209] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T17:56:51.306992] [INFO ] [REMOTE ] CC: Full fetch complete (75600 records). [2025-10-02T17:56:51.307129] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-02T17:56:51.480902] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-02T17:56:51.776477] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T17:56:51.803242] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-02T17:56:51.803370] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-02T17:56:51.804911] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-02T17:56:51.805001] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-02T17:56:51.807218] [DEBUG] [LOCAL ] CC: Trimmed 75600 records to 53386 (keeping 200 days of data) [2025-10-02T17:56:52.245414] [DEBUG] [LOCAL ] CC: Primary data saved (53386 records). [2025-10-02T17:56:52.245618] [INFO ] [MAIN ] CC: Full history saved. [2025-10-02T17:56:52.245814] [INFO ] [MAIN ] Update Progress: 411/2370 symbols completed. CC took 48.6s. Estimated remaining: 4h 30m 46s. Rate: 7.2 symbols/min [2025-10-02T17:56:52.281618] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-10-02T17:56:52.504955] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:56:52.576151] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-02T17:56:52.576624] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-02T17:56:52.790770] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:56:52.791045] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-02T17:56:52.791121] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-02T17:56:52.792848] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-02T17:56:52.792930] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-02T17:56:53.085342] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-02T17:56:53.224525] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:56:53.656587] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-02T17:56:53.743305] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T17:56:53.873006] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-10-02T17:56:54.088616] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T17:56:54.673004] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-02T17:56:55.473280] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-02T17:56:55.762503] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T17:56:56.212201] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-10-02T17:56:56.272968] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-02T17:56:56.777547] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T17:56:57.073039] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-02T17:56:57.873002] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-02T17:56:58.514728] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-10-02T17:56:58.678501] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-02T17:56:58.697849] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T17:56:58.837335] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T17:56:59.473009] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-02T17:57:00.273049] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-02T17:57:01.072982] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-02T17:57:01.364792] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-10-02T17:57:01.405811] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-02T17:57:01.873028] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-02T17:57:02.168344] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T17:57:02.169542] [INFO ] [REMOTE ] CCIF: Full fetch complete (21915 records). [2025-10-02T17:57:02.169616] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-02T17:57:02.617968] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-02T17:57:02.618224] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-02T17:57:02.618735] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-02T17:57:02.618849] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-02T17:57:02.619929] [DEBUG] [LOCAL ] CCIF: Trimmed 21915 records to 15844 (keeping 200 days of data) [2025-10-02T17:57:02.687180] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-02T17:57:02.724149] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-10-02T17:57:02.764782] [DEBUG] [LOCAL ] CCIF: Primary data saved (15844 records). [2025-10-02T17:57:02.764933] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-02T17:57:02.765045] [INFO ] [MAIN ] Update Progress: 412/2370 symbols completed. CCIF took 29.1s. Estimated remaining: 4h 30m 48s. Rate: 7.2 symbols/min [2025-10-02T17:57:02.957735] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:03.009955] [DEBUG] [LOCAL ] CCO: Loaded 47896 existing records from primary storage. [2025-10-02T17:57:03.010318] [INFO ] [MAIN ] CCO: Loaded 47896 existing records. [2025-10-02T17:57:03.206106] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:03.206366] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-02T17:57:03.206418] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-02T17:57:03.208168] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-02T17:57:03.208244] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-02T17:57:03.480583] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-02T17:57:03.596448] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:04.124977] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-02T17:57:04.255091] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T17:57:04.272966] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-02T17:57:05.073050] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-02T17:57:05.719560] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-02T17:57:05.873020] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-02T17:57:05.936492] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T17:57:06.673008] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-10-02T17:57:07.367497] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-02T17:57:07.473013] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-02T17:57:08.088155] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-02T17:57:08.279422] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-02T17:57:08.295481] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T17:57:08.755925] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T17:57:09.073027] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-02T17:57:09.873006] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-02T17:57:10.347577] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T17:57:10.672996] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-02T17:57:10.713454] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-02T17:57:11.473047] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-02T17:57:12.131936] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T17:57:12.258962] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T17:57:12.272953] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-02T17:57:13.073005] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-02T17:57:13.780044] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-02T17:57:13.873004] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-02T17:57:13.926807] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T17:57:14.672999] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-02T17:57:14.888849] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T17:57:14.890967] [INFO ] [REMOTE ] CCJ: Full fetch complete (77684 records). [2025-10-02T17:57:14.891088] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-02T17:57:15.314958] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-02T17:57:15.315061] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-02T17:57:15.316144] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-02T17:57:15.316215] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-02T17:57:15.317870] [DEBUG] [LOCAL ] CCJ: Trimmed 77684 records to 54063 (keeping 200 days of data) [2025-10-02T17:57:15.500178] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-02T17:57:15.659886] [DEBUG] [LOCAL ] CCJ: Primary data saved (54063 records). [2025-10-02T17:57:15.660082] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-02T17:57:15.662431] [INFO ] [MAIN ] Update Progress: 413/2370 symbols completed. CCJ took 39.9s. Estimated remaining: 4h 31m 2s. Rate: 7.2 symbols/min [2025-10-02T17:57:15.848851] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:15.862232] [DEBUG] [LOCAL ] CCRD: Loaded 9107 existing records from primary storage. [2025-10-02T17:57:15.862462] [INFO ] [MAIN ] CCRD: Loaded 9107 existing records. [2025-10-02T17:57:16.051879] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:16.052353] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-02T17:57:16.052439] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-02T17:57:16.052849] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-02T17:57:16.052921] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-02T17:57:16.471958] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:16.486823] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-10-02T17:57:16.493406] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T17:57:16.545591] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-10-02T17:57:17.072990] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-02T17:57:17.127266] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T17:57:17.165422] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T17:57:17.873009] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-02T17:57:18.673005] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-02T17:57:19.364884] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T17:57:19.369284] [INFO ] [REMOTE ] CCK: Full fetch complete (67577 records). [2025-10-02T17:57:19.369453] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-02T17:57:19.479339] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-02T17:57:19.699733] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-10-02T17:57:19.891707] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-02T17:57:19.891835] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-02T17:57:19.892787] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-02T17:57:19.892934] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-02T17:57:19.894573] [DEBUG] [LOCAL ] CCK: Trimmed 67577 records to 46518 (keeping 200 days of data) [2025-10-02T17:57:20.205930] [DEBUG] [LOCAL ] CCK: Primary data saved (46518 records). [2025-10-02T17:57:20.238787] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-02T17:57:20.240092] [INFO ] [MAIN ] Update Progress: 414/2370 symbols completed. CCK took 31.0s. Estimated remaining: 4h 30m 36s. Rate: 7.2 symbols/min [2025-10-02T17:57:20.239771] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T17:57:20.246716] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T17:57:20.278144] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-02T17:57:20.446197] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:20.480557] [DEBUG] [LOCAL ] CCS: Loaded 30499 existing records from primary storage. [2025-10-02T17:57:20.480860] [INFO ] [MAIN ] CCS: Loaded 30499 existing records. [2025-10-02T17:57:20.670512] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:20.670835] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-02T17:57:20.670897] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-02T17:57:20.671893] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-02T17:57:20.671955] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-02T17:57:21.081186] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-02T17:57:21.081062] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:21.873001] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-02T17:57:22.477451] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T17:57:22.672976] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-10-02T17:57:22.741619] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T17:57:22.848234] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-02T17:57:23.473012] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-02T17:57:24.088121] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:57:24.273003] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-02T17:57:24.822255] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T17:57:25.073025] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-02T17:57:25.615432] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-02T17:57:25.873015] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-02T17:57:26.450378] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-10-02T17:57:26.452523] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-10-02T17:57:26.452698] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-02T17:57:26.573264] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T17:57:26.678193] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-02T17:57:26.912068] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-02T17:57:26.912161] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-02T17:57:26.913206] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-02T17:57:26.913300] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-02T17:57:26.914926] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 54190 (keeping 200 days of data) [2025-10-02T17:57:27.279058] [DEBUG] [LOCAL ] CCL: Primary data saved (54190 records). [2025-10-02T17:57:27.279276] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-02T17:57:27.279452] [INFO ] [MAIN ] Update Progress: 415/2370 symbols completed. CCL took 35.0s. Estimated remaining: 4h 30m 22s. Rate: 7.2 symbols/min [2025-10-02T17:57:27.460030] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:27.474340] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-02T17:57:27.487076] [DEBUG] [LOCAL ] CCU: Loaded 23246 existing records from primary storage. [2025-10-02T17:57:27.487390] [INFO ] [MAIN ] CCU: Loaded 23246 existing records. [2025-10-02T17:57:27.676908] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:27.677123] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-02T17:57:27.677210] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-02T17:57:27.677873] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-02T17:57:27.677959] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-02T17:57:28.075128] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:28.210287] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T17:57:28.272977] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-02T17:57:28.359454] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T17:57:29.072970] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-02T17:57:29.087020] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T17:57:29.872994] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-10-02T17:57:30.672966] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-02T17:57:30.810918] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-02T17:57:31.090394] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T17:57:31.437322] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T17:57:31.472991] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-02T17:57:32.273001] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-02T17:57:33.052971] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:57:33.072953] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-02T17:57:33.197329] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T17:57:33.873011] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-02T17:57:34.406294] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T17:57:34.673001] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-02T17:57:35.418581] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T17:57:35.472985] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-02T17:57:35.648124] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T17:57:36.273005] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-02T17:57:36.564451] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T17:57:37.073006] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-02T17:57:37.401873] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T17:57:37.406342] [INFO ] [REMOTE ] CCO: Full fetch complete (66707 records). [2025-10-02T17:57:37.406485] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-02T17:57:37.824800] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-02T17:57:37.824896] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-02T17:57:37.825681] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-02T17:57:37.825748] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-02T17:57:37.827173] [DEBUG] [LOCAL ] CCO: Trimmed 66707 records to 48249 (keeping 200 days of data) [2025-10-02T17:57:37.885570] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-02T17:57:38.123545] [DEBUG] [LOCAL ] CCO: Primary data saved (48249 records). [2025-10-02T17:57:38.123785] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-02T17:57:38.123879] [INFO ] [MAIN ] Update Progress: 416/2370 symbols completed. CCO took 35.4s. Estimated remaining: 4h 30m 25s. Rate: 7.2 symbols/min [2025-10-02T17:57:38.310783] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:38.311101] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-02T17:57:38.311236] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-02T17:57:38.311400] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-02T17:57:38.311573] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-02T17:57:38.311698] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-02T17:57:38.311767] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-02T17:57:38.678456] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-02T17:57:38.736146] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:38.744771] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T17:57:38.761557] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T17:57:39.424385] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-02T17:57:39.472978] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-02T17:57:40.273044] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-10-02T17:57:40.696482] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-02T17:57:40.698585] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T17:57:41.073008] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-02T17:57:41.873033] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-02T17:57:41.881761] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T17:57:42.108136] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-02T17:57:42.673041] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-02T17:57:43.267889] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T17:57:43.268854] [INFO ] [REMOTE ] CCRD: Full fetch complete (11848 records). [2025-10-02T17:57:43.268931] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-02T17:57:43.480503] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-02T17:57:43.672350] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-02T17:57:43.672474] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-02T17:57:43.672881] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-02T17:57:43.672945] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-02T17:57:43.673500] [DEBUG] [LOCAL ] CCRD: Trimmed 11848 records to 9134 (keeping 200 days of data) [2025-10-02T17:57:43.732674] [DEBUG] [LOCAL ] CCRD: Primary data saved (9134 records). [2025-10-02T17:57:43.732828] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-02T17:57:43.733022] [INFO ] [MAIN ] Update Progress: 417/2370 symbols completed. CCRD took 28.1s. Estimated remaining: 4h 30m 4s. Rate: 7.2 symbols/min [2025-10-02T17:57:43.938794] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:44.011134] [DEBUG] [LOCAL ] CDE: Loaded 53642 existing records from primary storage. [2025-10-02T17:57:44.011565] [INFO ] [MAIN ] CDE: Loaded 53642 existing records. [2025-10-02T17:57:44.233843] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:44.234099] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-02T17:57:44.234158] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-02T17:57:44.236111] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-02T17:57:44.236223] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-02T17:57:44.278257] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-02T17:57:44.881984] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:44.933354] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T17:57:45.073012] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-02T17:57:45.282853] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-10-02T17:57:45.607916] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T17:57:45.873040] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-02T17:57:46.106079] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-02T17:57:46.673030] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-02T17:57:47.473001] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-02T17:57:48.089946] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T17:57:48.267497] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T17:57:48.273045] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-02T17:57:49.073057] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-02T17:57:49.622143] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T17:57:49.873024] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-02T17:57:50.056152] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T17:57:50.672999] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-02T17:57:51.031269] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T17:57:51.473048] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-02T17:57:51.755364] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T17:57:52.273049] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-02T17:57:52.688298] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-02T17:57:52.837448] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T17:57:53.073011] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-02T17:57:53.873028] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-10-02T17:57:54.088384] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T17:57:54.090229] [INFO ] [REMOTE ] CCS: Full fetch complete (45069 records). [2025-10-02T17:57:54.090331] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-02T17:57:54.519098] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-02T17:57:54.519247] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-02T17:57:54.519989] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-02T17:57:54.520059] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-02T17:57:54.521253] [DEBUG] [LOCAL ] CCS: Trimmed 45069 records to 30685 (keeping 200 days of data) [2025-10-02T17:57:54.680860] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-02T17:57:54.721996] [DEBUG] [LOCAL ] CCS: Primary data saved (30685 records). [2025-10-02T17:57:54.722141] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-02T17:57:54.722226] [INFO ] [MAIN ] Update Progress: 418/2370 symbols completed. CCS took 34.5s. Estimated remaining: 4h 30m 9s. Rate: 7.2 symbols/min [2025-10-02T17:57:54.914476] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:54.926874] [DEBUG] [LOCAL ] CDLR: Loaded 9854 existing records from primary storage. [2025-10-02T17:57:54.927131] [INFO ] [MAIN ] CDLR: Loaded 9854 existing records. [2025-10-02T17:57:55.120169] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:55.120385] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-02T17:57:55.120441] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-02T17:57:55.120878] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-02T17:57:55.120941] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-02T17:57:55.480920] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-02T17:57:55.534066] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:55.787909] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-02T17:57:55.938831] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T17:57:55.985638] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T17:57:56.273007] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-02T17:57:56.539433] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:57:56.539790] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-02T17:57:56.539880] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:57:56.539997] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-02T17:57:56.540079] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:57:56.540167] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-02T17:57:56.540242] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-02T17:57:56.540282] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-02T17:57:56.540344] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-02T17:57:56.540430] [INFO ] [MAIN ] Update Progress: 419/2370 symbols completed. CCZ took 18.4s. Estimated remaining: 4h 29m 30s. Rate: 7.2 symbols/min [2025-10-02T17:57:56.737950] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:57:56.781759] [DEBUG] [LOCAL ] CDP: Loaded 42586 existing records from primary storage. [2025-10-02T17:57:56.782130] [INFO ] [MAIN ] CDP: Loaded 42586 existing records. [2025-10-02T17:57:56.982225] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:57:56.982465] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-02T17:57:56.982515] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-02T17:57:56.983913] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-02T17:57:56.983982] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-02T17:57:57.078204] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-02T17:57:57.378520] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:57:57.872985] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-10-02T17:57:58.672999] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-02T17:57:58.817385] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T17:57:59.386623] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T17:57:59.473066] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-10-02T17:57:59.659095] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-02T17:58:00.024922] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-02T17:58:00.273043] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-02T17:58:01.073040] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-02T17:58:01.879394] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-02T17:58:01.886274] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T17:58:02.392029] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T17:58:02.568725] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T17:58:02.673080] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-02T17:58:03.417474] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T17:58:03.418625] [INFO ] [REMOTE ] CCU: Full fetch complete (32921 records). [2025-10-02T17:58:03.418809] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-02T17:58:03.419429] [FATAL] [VALIDATOR ] CCU: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:58:03.419571] [FATAL] [MAIN ] CCU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:58:03.419618] [WARN ] [MAIN ] CCU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:58:03.419698] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-02T17:58:03.419771] [DEBUG] [LOCAL ] CCU: No primary data file found to delete. [2025-10-02T17:58:03.419809] [INFO ] [LOCAL ] CCU: Starting deletion of derivative data. [2025-10-02T17:58:03.420237] [DEBUG] [LOCAL ] CCU: Deleted derivative data file. [2025-10-02T17:58:03.420351] [INFO ] [MAIN ] Update Progress: 420/2370 symbols completed. CCU took 36.1s. Estimated remaining: 4h 29m 15s. Rate: 7.2 symbols/min [2025-10-02T17:58:03.480949] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-02T17:58:03.614547] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:58:03.638720] [DEBUG] [LOCAL ] CDRE: Loaded 24990 existing records from primary storage. [2025-10-02T17:58:03.639005] [INFO ] [MAIN ] CDRE: Loaded 24990 existing records. [2025-10-02T17:58:03.838541] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:58:03.838799] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-02T17:58:03.838863] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-02T17:58:03.839715] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-02T17:58:03.839793] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-02T17:58:04.165266] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T17:58:04.251849] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:58:04.273028] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-02T17:58:05.072984] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-02T17:58:05.301167] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T17:58:05.873000] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-02T17:58:06.573041] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T17:58:06.646970] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-02T17:58:06.673060] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-02T17:58:07.473041] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-02T17:58:08.255529] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T17:58:08.272994] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-02T17:58:08.802813] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-02T17:58:08.832092] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-02T17:58:09.073007] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-02T17:58:09.873038] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-10-02T17:58:10.673003] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-02T17:58:10.733686] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T17:58:11.288341] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T17:58:11.473045] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-02T17:58:11.572095] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-02T17:58:12.273047] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-02T17:58:13.024954] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T17:58:13.073023] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-02T17:58:13.472184] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-02T17:58:13.591292] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T17:58:13.873004] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-02T17:58:14.672970] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-02T17:58:14.848576] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T17:58:15.473002] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-02T17:58:16.094763] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T17:58:16.273003] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-02T17:58:16.342316] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T17:58:16.804470] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T17:58:16.805506] [INFO ] [REMOTE ] CDLR: Full fetch complete (13334 records). [2025-10-02T17:58:16.805578] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-02T17:58:17.078284] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-02T17:58:17.208893] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-10-02T17:58:17.208975] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-10-02T17:58:17.209277] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-10-02T17:58:17.209316] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-10-02T17:58:17.209883] [DEBUG] [LOCAL ] CDLR: Trimmed 13334 records to 9932 (keeping 200 days of data) [2025-10-02T17:58:17.270957] [DEBUG] [LOCAL ] CDLR: Primary data saved (9932 records). [2025-10-02T17:58:17.271096] [INFO ] [MAIN ] CDLR: Full history saved. [2025-10-02T17:58:17.271209] [INFO ] [MAIN ] Update Progress: 421/2370 symbols completed. CDLR took 22.5s. Estimated remaining: 4h 29m 33s. Rate: 7.2 symbols/min [2025-10-02T17:58:17.456841] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:58:17.512024] [DEBUG] [LOCAL ] CE: Loaded 51501 existing records from primary storage. [2025-10-02T17:58:17.512395] [INFO ] [MAIN ] CE: Loaded 51501 existing records. [2025-10-02T17:58:17.708200] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:58:17.708446] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-02T17:58:17.708513] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-02T17:58:17.710346] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-02T17:58:17.710433] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-02T17:58:17.881617] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-02T17:58:18.118028] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:58:18.672980] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-02T17:58:19.004396] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T17:58:19.135976] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-02T17:58:19.472994] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-02T17:58:20.273050] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-10-02T17:58:20.439810] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T17:58:21.073019] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-02T17:58:21.537309] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T17:58:21.873008] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-02T17:58:22.107583] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T17:58:22.317724] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T17:58:22.672969] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-02T17:58:23.076220] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T17:58:23.472993] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-02T17:58:24.273026] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-02T17:58:24.473725] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T17:58:25.012702] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T17:58:25.073016] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-02T17:58:25.873001] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-02T17:58:25.999734] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T17:58:26.672996] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-02T17:58:26.872216] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T17:58:27.473002] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-02T17:58:28.193062] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-02T17:58:28.273002] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-02T17:58:28.309096] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-02T17:58:28.447633] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T17:58:29.073037] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-02T17:58:29.873024] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-02T17:58:30.299026] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-02T17:58:30.301964] [INFO ] [REMOTE ] CDE: Full fetch complete (77584 records). [2025-10-02T17:58:30.302154] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-02T17:58:30.433373] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T17:58:30.678132] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-02T17:58:30.788890] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-02T17:58:30.788991] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-02T17:58:30.789886] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-02T17:58:30.789959] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-02T17:58:30.791546] [DEBUG] [LOCAL ] CDE: Trimmed 77584 records to 54032 (keeping 200 days of data) [2025-10-02T17:58:31.120128] [DEBUG] [LOCAL ] CDE: Primary data saved (54032 records). [2025-10-02T17:58:31.120289] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-02T17:58:31.121698] [INFO ] [MAIN ] Update Progress: 422/2370 symbols completed. CDE took 47.4s. Estimated remaining: 4h 29m 50s. Rate: 7.2 symbols/min [2025-10-02T17:58:31.325580] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:58:31.334754] [DEBUG] [LOCAL ] CEE: Loaded 5946 existing records from primary storage. [2025-10-02T17:58:31.335029] [INFO ] [MAIN ] CEE: Loaded 5946 existing records. [2025-10-02T17:58:31.478121] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-02T17:58:31.537005] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:58:31.537664] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-02T17:58:31.537778] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-02T17:58:31.538499] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-02T17:58:31.538562] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-02T17:58:31.960857] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:58:31.994933] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-02T17:58:32.023229] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T17:58:32.273049] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-02T17:58:33.044824] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T17:58:33.073019] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-02T17:58:33.677207] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T17:58:33.873003] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-02T17:58:34.635507] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T17:58:34.673041] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-10-02T17:58:35.353545] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T17:58:35.473041] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-02T17:58:35.702340] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T17:58:35.847263] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-02T17:58:36.273019] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-02T17:58:37.072996] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-02T17:58:37.338604] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T17:58:37.873045] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-02T17:58:38.556391] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T17:58:38.673029] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-02T17:58:38.778731] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T17:58:38.780004] [INFO ] [REMOTE ] CDRE: Full fetch complete (35217 records). [2025-10-02T17:58:38.780087] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-02T17:58:39.189884] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-10-02T17:58:39.189976] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-10-02T17:58:39.190488] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-10-02T17:58:39.190535] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-10-02T17:58:39.191431] [DEBUG] [LOCAL ] CDRE: Trimmed 35217 records to 25140 (keeping 200 days of data) [2025-10-02T17:58:39.346944] [DEBUG] [LOCAL ] CDRE: Primary data saved (25140 records). [2025-10-02T17:58:39.347078] [INFO ] [MAIN ] CDRE: Full history saved. [2025-10-02T17:58:39.347164] [INFO ] [MAIN ] Update Progress: 423/2370 symbols completed. CDRE took 35.9s. Estimated remaining: 4h 29m 41s. Rate: 7.2 symbols/min [2025-10-02T17:58:39.478098] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-02T17:58:39.557417] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:58:39.584162] [DEBUG] [LOCAL ] CEPU: Loaded 25885 existing records from primary storage. [2025-10-02T17:58:39.584470] [INFO ] [MAIN ] CEPU: Loaded 25885 existing records. [2025-10-02T17:58:39.774894] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:58:39.775124] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-02T17:58:39.775187] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-02T17:58:39.775971] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-02T17:58:39.776034] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-02T17:58:39.898600] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T17:58:39.937324] [INFO ] [REMOTE ] CDP: Full fetch complete (61941 records). [2025-10-02T17:58:39.948861] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-02T17:58:40.276390] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-02T17:58:40.341693] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:58:40.637682] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-02T17:58:40.637811] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-02T17:58:40.638532] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-02T17:58:40.638596] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-02T17:58:40.639996] [DEBUG] [LOCAL ] CDP: Trimmed 61941 records to 42936 (keeping 200 days of data) [2025-10-02T17:58:40.911125] [DEBUG] [LOCAL ] CDP: Primary data saved (42936 records). [2025-10-02T17:58:40.911290] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-02T17:58:40.911479] [INFO ] [MAIN ] Update Progress: 424/2370 symbols completed. CDP took 44.4s. Estimated remaining: 4h 29m 2s. Rate: 7.2 symbols/min [2025-10-02T17:58:41.098704] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:58:41.097583] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-10-02T17:58:41.130106] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T17:58:41.189124] [DEBUG] [LOCAL ] CF: Loaded 52176 existing records from primary storage. [2025-10-02T17:58:41.189465] [INFO ] [MAIN ] CF: Loaded 52176 existing records. [2025-10-02T17:58:41.366751] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T17:58:41.411577] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:58:41.411864] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-02T17:58:41.411917] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-02T17:58:41.413437] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-02T17:58:41.413501] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-02T17:58:41.799957] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:58:41.872996] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-02T17:58:42.393494] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T17:58:42.673059] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-02T17:58:43.472973] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-10-02T17:58:43.625186] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T17:58:43.801526] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T17:58:44.272999] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-02T17:58:45.073008] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-02T17:58:45.140803] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T17:58:45.415300] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T17:58:45.873008] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-02T17:58:46.160951] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T17:58:46.673008] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-02T17:58:46.858023] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T17:58:47.388323] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T17:58:47.473003] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-02T17:58:48.273042] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-02T17:58:49.054843] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T17:58:49.072963] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-02T17:58:49.873002] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-02T17:58:50.081019] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-02T17:58:50.417796] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T17:58:50.672980] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-02T17:58:50.901063] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T17:58:51.192624] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-02T17:58:51.473040] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-02T17:58:52.272999] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-02T17:58:52.779635] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T17:58:52.888747] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-02T17:58:53.073070] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-02T17:58:53.873064] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-02T17:58:54.421739] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T17:58:54.423925] [INFO ] [REMOTE ] CE: Full fetch complete (74841 records). [2025-10-02T17:58:54.424084] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-02T17:58:54.678156] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-02T17:58:54.975292] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-02T17:58:54.975414] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-02T17:58:54.976964] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-02T17:58:54.977063] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-02T17:58:54.979169] [DEBUG] [LOCAL ] CE: Trimmed 74841 records to 51874 (keeping 200 days of data) [2025-10-02T17:58:55.461579] [DEBUG] [LOCAL ] CE: Primary data saved (51874 records). [2025-10-02T17:58:55.461769] [INFO ] [MAIN ] CE: Full history saved. [2025-10-02T17:58:55.461906] [INFO ] [MAIN ] Update Progress: 425/2370 symbols completed. CE took 38.2s. Estimated remaining: 4h 29m 22s. Rate: 7.2 symbols/min [2025-10-02T17:58:55.487352] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-02T17:58:55.699229] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:58:55.736472] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-02T17:58:55.768440] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T17:58:55.812011] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-10-02T17:58:55.812378] [INFO ] [MAIN ] CFG: Loaded 53624 existing records. [2025-10-02T17:58:56.031441] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:58:56.031638] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-02T17:58:56.031723] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-02T17:58:56.033261] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-02T17:58:56.033325] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-02T17:58:56.154986] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-02T17:58:56.278158] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-02T17:58:56.445586] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:58:57.073252] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-02T17:58:57.253721] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T17:58:57.872996] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-02T17:58:58.673025] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-10-02T17:58:58.862978] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T17:58:58.933447] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T17:58:59.473011] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-02T17:59:00.205328] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T17:59:00.272996] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-02T17:59:01.073029] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-02T17:59:01.656707] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-02T17:59:01.691923] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T17:59:01.873035] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-02T17:59:02.481758] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T17:59:02.673037] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-02T17:59:02.948787] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T17:59:02.950240] [INFO ] [REMOTE ] CEPU: Full fetch complete (39628 records). [2025-10-02T17:59:02.950325] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-02T17:59:03.364235] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-02T17:59:03.364326] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-02T17:59:03.365044] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-02T17:59:03.365142] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-02T17:59:03.366153] [DEBUG] [LOCAL ] CEPU: Trimmed 39628 records to 26149 (keeping 200 days of data) [2025-10-02T17:59:03.473082] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-02T17:59:03.528190] [DEBUG] [LOCAL ] CEPU: Primary data saved (26149 records). [2025-10-02T17:59:03.528328] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-02T17:59:03.528424] [INFO ] [MAIN ] Update Progress: 426/2370 symbols completed. CEPU took 24.2s. Estimated remaining: 4h 29m 13s. Rate: 7.2 symbols/min [2025-10-02T17:59:03.727113] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:03.727310] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-02T17:59:03.727349] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-02T17:59:03.727476] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-02T17:59:03.727521] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-02T17:59:03.727565] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-02T17:59:03.727600] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-02T17:59:04.043245] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T17:59:04.129728] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:04.272968] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-10-02T17:59:04.407943] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T17:59:04.494267] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T17:59:04.494572] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-10-02T17:59:04.494689] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T17:59:04.494753] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-02T17:59:04.494814] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T17:59:04.494888] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-02T17:59:04.494951] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-02T17:59:04.494987] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-02T17:59:04.495078] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-02T17:59:04.495150] [INFO ] [MAIN ] Update Progress: 427/2370 symbols completed. CFND took 1.0s. Estimated remaining: 4h 28m 31s. Rate: 7.2 symbols/min [2025-10-02T17:59:04.709116] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:04.747833] [DEBUG] [LOCAL ] CFR: Loaded 33188 existing records from primary storage. [2025-10-02T17:59:04.748158] [INFO ] [MAIN ] CFR: Loaded 33188 existing records. [2025-10-02T17:59:04.954328] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:59:04.954578] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-02T17:59:04.954635] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-02T17:59:04.955829] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-10-02T17:59:04.955893] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-02T17:59:05.073012] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-02T17:59:05.354592] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:05.873029] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-02T17:59:06.673000] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-10-02T17:59:06.914460] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T17:59:07.279239] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T17:59:07.473070] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-02T17:59:08.157691] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T17:59:08.273015] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-02T17:59:09.073013] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-02T17:59:09.287425] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T17:59:09.709083] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T17:59:09.873003] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-02T17:59:10.568990] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T17:59:10.673005] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-02T17:59:11.381302] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T17:59:11.473023] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-02T17:59:11.693582] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T17:59:12.273005] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-02T17:59:12.773054] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T17:59:12.773855] [INFO ] [REMOTE ] CEE: Full fetch complete (10190 records). [2025-10-02T17:59:12.773933] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-02T17:59:13.075734] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-02T17:59:13.204009] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-02T17:59:13.204155] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-02T17:59:13.204515] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-02T17:59:13.204675] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-02T17:59:13.205868] [DEBUG] [LOCAL ] CEE: Trimmed 10190 records to 5968 (keeping 200 days of data) [2025-10-02T17:59:13.241773] [DEBUG] [LOCAL ] CEE: Primary data saved (5968 records). [2025-10-02T17:59:13.242045] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-02T17:59:13.242163] [INFO ] [MAIN ] Update Progress: 428/2370 symbols completed. CEE took 42.1s. Estimated remaining: 4h 28m 25s. Rate: 7.2 symbols/min [2025-10-02T17:59:13.448897] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-02T17:59:13.477831] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:13.533058] [DEBUG] [LOCAL ] CGAU: Loaded 42721 existing records from primary storage. [2025-10-02T17:59:13.533386] [INFO ] [MAIN ] CGAU: Loaded 42721 existing records. [2025-10-02T17:59:13.722938] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:59:13.723171] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-02T17:59:13.723227] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-02T17:59:13.724440] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-02T17:59:13.724503] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-02T17:59:13.881690] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-02T17:59:14.147678] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:14.509365] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T17:59:14.673018] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-02T17:59:15.473007] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-02T17:59:15.580430] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T17:59:16.190408] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T17:59:16.273023] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-02T17:59:17.072997] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-02T17:59:17.271031] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T17:59:17.872994] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-10-02T17:59:17.975880] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T17:59:18.566121] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T17:59:18.672993] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-02T17:59:19.473109] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T17:59:19.473229] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-02T17:59:19.895109] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T17:59:20.273009] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-02T17:59:20.846823] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T17:59:20.849255] [INFO ] [REMOTE ] CF: Full fetch complete (75261 records). [2025-10-02T17:59:20.849405] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-02T17:59:21.078106] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-02T17:59:21.280008] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-02T17:59:21.280123] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-02T17:59:21.281026] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-02T17:59:21.281095] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-02T17:59:21.282697] [DEBUG] [LOCAL ] CF: Trimmed 75261 records to 52560 (keeping 200 days of data) [2025-10-02T17:59:21.628309] [DEBUG] [LOCAL ] CF: Primary data saved (52560 records). [2025-10-02T17:59:21.628521] [INFO ] [MAIN ] CF: Full history saved. [2025-10-02T17:59:21.628679] [INFO ] [MAIN ] Update Progress: 429/2370 symbols completed. CF took 40.7s. Estimated remaining: 4h 28m 17s. Rate: 7.2 symbols/min [2025-10-02T17:59:21.821006] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T17:59:21.868343] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:21.871800] [DEBUG] [LOCAL ] CGV: Loaded 1400 existing records from primary storage. [2025-10-02T17:59:21.871962] [INFO ] [MAIN ] CGV: Loaded 1400 existing records. [2025-10-02T17:59:21.883714] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-02T17:59:22.076360] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:59:22.076574] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-02T17:59:22.076626] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-02T17:59:22.076893] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-02T17:59:22.076956] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-02T17:59:22.475536] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:22.672992] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-02T17:59:23.017077] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-02T17:59:23.047120] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T17:59:23.472994] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-02T17:59:23.978521] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T17:59:24.273003] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-10-02T17:59:24.802294] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-02T17:59:25.073027] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-02T17:59:25.123486] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T17:59:25.471637] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T17:59:25.873011] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-02T17:59:26.673028] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-02T17:59:27.224407] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T17:59:27.473036] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-02T17:59:27.940189] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-02T17:59:28.273018] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-02T17:59:28.651408] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T17:59:29.072999] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-02T17:59:29.776349] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T17:59:29.873029] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-02T17:59:30.512606] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T17:59:30.673049] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-02T17:59:31.193422] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T17:59:31.473001] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-02T17:59:32.155352] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T17:59:32.273019] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-02T17:59:32.514394] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T17:59:32.515914] [INFO ] [REMOTE ] CFR: Full fetch complete (48520 records). [2025-10-02T17:59:32.516045] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-02T17:59:32.943948] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-02T17:59:32.944051] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-02T17:59:32.944749] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-02T17:59:32.944818] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-02T17:59:32.946051] [DEBUG] [LOCAL ] CFR: Trimmed 48520 records to 33393 (keeping 200 days of data) [2025-10-02T17:59:33.075756] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-02T17:59:33.171404] [DEBUG] [LOCAL ] CFR: Primary data saved (33393 records). [2025-10-02T17:59:33.171553] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-02T17:59:33.171661] [INFO ] [MAIN ] Update Progress: 430/2370 symbols completed. CFR took 28.7s. Estimated remaining: 4h 28m 24s. Rate: 7.2 symbols/min [2025-10-02T17:59:33.347773] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:33.347998] [DEBUG] [LOCAL ] CHCT: No existing data file found in primary storage. [2025-10-02T17:59:33.348056] [WARN ] [MAIN ] CHCT: No existing data found, performing full refresh instead. [2025-10-02T17:59:33.348175] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-02T17:59:33.348216] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-02T17:59:33.348257] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-02T17:59:33.348290] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-02T17:59:33.765194] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:33.770820] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T17:59:33.773140] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-10-02T17:59:33.773250] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-02T17:59:33.880115] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-10-02T17:59:34.209501] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-02T17:59:34.209746] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-02T17:59:34.210636] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-02T17:59:34.210786] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-02T17:59:34.224454] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 54014 (keeping 200 days of data) [2025-10-02T17:59:34.250355] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T17:59:34.600137] [DEBUG] [LOCAL ] CFG: Primary data saved (54014 records). [2025-10-02T17:59:34.600288] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-02T17:59:34.600373] [INFO ] [MAIN ] Update Progress: 431/2370 symbols completed. CFG took 39.1s. Estimated remaining: 4h 27m 44s. Rate: 7.2 symbols/min [2025-10-02T17:59:34.678186] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-02T17:59:34.813025] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:34.871305] [DEBUG] [LOCAL ] CHD: Loaded 52113 existing records from primary storage. [2025-10-02T17:59:34.871623] [INFO ] [MAIN ] CHD: Loaded 52113 existing records. [2025-10-02T17:59:35.085885] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:59:35.089044] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-02T17:59:35.089196] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-02T17:59:35.088743] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T17:59:35.092625] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-02T17:59:35.100957] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-10-02T17:59:35.101188] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-02T17:59:35.473630] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-02T17:59:35.488636] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:36.273005] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-02T17:59:36.331230] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T17:59:37.073031] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-10-02T17:59:37.745578] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T17:59:37.873010] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-02T17:59:38.315314] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T17:59:38.672974] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-02T17:59:38.791692] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T17:59:39.473004] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-02T17:59:39.694000] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T17:59:40.273044] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-02T17:59:40.690514] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-02T17:59:41.043444] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T17:59:41.072979] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-02T17:59:41.873009] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-02T17:59:42.201190] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-02T17:59:42.458290] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T17:59:42.673006] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-02T17:59:43.473039] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-02T17:59:43.889553] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-02T17:59:44.046825] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T17:59:44.273033] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-02T17:59:45.072992] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-02T17:59:45.154131] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T17:59:45.873021] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-02T17:59:46.672973] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-02T17:59:46.732989] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T17:59:47.040291] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-02T17:59:47.268861] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T17:59:47.473066] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-02T17:59:48.273068] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-02T17:59:49.072969] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-02T17:59:49.231367] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T17:59:49.489456] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T17:59:49.872995] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-02T17:59:50.204690] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-02T17:59:50.384838] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T17:59:50.673004] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-02T17:59:51.473017] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-02T17:59:51.555030] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T17:59:51.840512] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-02T17:59:52.272997] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-02T17:59:53.073026] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-02T17:59:53.519582] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T17:59:53.520368] [INFO ] [REMOTE ] CGV: Full fetch complete (2276 records). [2025-10-02T17:59:53.520448] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-02T17:59:53.879103] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-02T17:59:53.916516] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-02T17:59:53.916778] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-02T17:59:53.916940] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-02T17:59:53.917020] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-02T17:59:53.917828] [DEBUG] [LOCAL ] CGV: Trimmed 2276 records to 1408 (keeping 200 days of data) [2025-10-02T17:59:53.928049] [DEBUG] [LOCAL ] CGV: Primary data saved (1408 records). [2025-10-02T17:59:53.928196] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-02T17:59:53.928772] [INFO ] [MAIN ] Update Progress: 432/2370 symbols completed. CGV took 32.3s. Estimated remaining: 4h 28m 26s. Rate: 7.2 symbols/min [2025-10-02T17:59:54.080022] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T17:59:54.166736] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:54.183761] [DEBUG] [LOCAL ] CHE: Loaded 15044 existing records from primary storage. [2025-10-02T17:59:54.184032] [INFO ] [MAIN ] CHE: Loaded 15044 existing records. [2025-10-02T17:59:54.377969] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:59:54.378244] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-02T17:59:54.378295] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-02T17:59:54.378855] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-02T17:59:54.378916] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-02T17:59:54.681200] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-02T17:59:54.777134] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:55.071031] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-02T17:59:55.473049] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-10-02T17:59:56.191755] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T17:59:56.273034] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-02T17:59:56.290891] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T17:59:57.073022] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-02T17:59:57.873022] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-02T17:59:58.090408] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T17:59:58.334547] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T17:59:58.336113] [INFO ] [REMOTE ] CGAU: Full fetch complete (60568 records). [2025-10-02T17:59:58.336216] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-02T17:59:58.336982] [FATAL] [VALIDATOR ] CGAU: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T17:59:58.337076] [FATAL] [MAIN ] CGAU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T17:59:58.337123] [WARN ] [MAIN ] CGAU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T17:59:58.337175] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-02T17:59:58.337236] [DEBUG] [LOCAL ] CGAU: No primary data file found to delete. [2025-10-02T17:59:58.337273] [INFO ] [LOCAL ] CGAU: Starting deletion of derivative data. [2025-10-02T17:59:58.337731] [DEBUG] [LOCAL ] CGAU: Deleted derivative data file. [2025-10-02T17:59:58.338145] [INFO ] [MAIN ] Update Progress: 433/2370 symbols completed. CGAU took 45.1s. Estimated remaining: 4h 27m 60s. Rate: 7.2 symbols/min [2025-10-02T17:59:58.525208] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T17:59:58.577011] [DEBUG] [LOCAL ] CHGG: Loaded 47653 existing records from primary storage. [2025-10-02T17:59:58.577325] [INFO ] [MAIN ] CHGG: Loaded 47653 existing records. [2025-10-02T17:59:58.682356] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-02T17:59:58.779527] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T17:59:58.780037] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-02T17:59:58.780102] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-02T17:59:58.781335] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-02T17:59:58.781399] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-02T17:59:58.927351] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T17:59:59.204464] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T17:59:59.473047] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-02T18:00:00.273040] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-10-02T18:00:00.591248] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T18:00:00.857419] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T18:00:01.073017] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-02T18:00:01.873016] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-02T18:00:01.970365] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T18:00:02.673026] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-02T18:00:02.802873] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-02T18:00:03.473011] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-02T18:00:03.734845] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T18:00:03.861862] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-02T18:00:04.273035] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-02T18:00:04.395400] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T18:00:05.073013] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-02T18:00:05.873021] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-02T18:00:05.925674] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T18:00:05.929179] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T18:00:05.930980] [INFO ] [REMOTE ] CHCT: Full fetch complete (34788 records). [2025-10-02T18:00:05.931153] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-02T18:00:05.931469] [INFO ] [REMOTE ] CHD: Full fetch complete (74420 records). [2025-10-02T18:00:05.931887] [FATAL] [VALIDATOR ] CHCT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:00:05.932105] [FATAL] [MAIN ] CHCT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:00:05.932045] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-02T18:00:05.932318] [WARN ] [MAIN ] CHCT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:00:05.932398] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-02T18:00:05.932547] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-02T18:00:05.932608] [INFO ] [LOCAL ] CHCT: Starting deletion of derivative data. [2025-10-02T18:00:05.932739] [DEBUG] [LOCAL ] CHCT: No derivative data file found to delete. [2025-10-02T18:00:05.960316] [INFO ] [MAIN ] Update Progress: 434/2370 symbols completed. CHCT took 32.8s. Estimated remaining: 4h 27m 49s. Rate: 7.2 symbols/min [2025-10-02T18:00:06.343833] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:06.598259] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-02T18:00:06.598387] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-02T18:00:06.599335] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-02T18:00:06.599423] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-02T18:00:06.601113] [DEBUG] [LOCAL ] CHD: Trimmed 74420 records to 52490 (keeping 200 days of data) [2025-10-02T18:00:06.679860] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-02T18:00:06.707252] [DEBUG] [LOCAL ] CHH: Loaded 32022 existing records from primary storage. [2025-10-02T18:00:06.709638] [INFO ] [MAIN ] CHH: Loaded 32022 existing records. [2025-10-02T18:00:06.951068] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:00:06.952474] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-02T18:00:06.953018] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-02T18:00:06.955477] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-02T18:00:06.955979] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-02T18:00:07.067930] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T18:00:07.473355] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-02T18:00:07.516721] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:07.629259] [DEBUG] [LOCAL ] CHD: Primary data saved (52490 records). [2025-10-02T18:00:07.629418] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-02T18:00:07.629505] [INFO ] [MAIN ] Update Progress: 435/2370 symbols completed. CHD took 33.0s. Estimated remaining: 4h 27m 11s. Rate: 7.2 symbols/min [2025-10-02T18:00:07.831025] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:07.853134] [DEBUG] [LOCAL ] CHMI: Loaded 21894 existing records from primary storage. [2025-10-02T18:00:07.853404] [INFO ] [MAIN ] CHMI: Loaded 21894 existing records. [2025-10-02T18:00:08.083671] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:00:08.083916] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-02T18:00:08.083969] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-02T18:00:08.084769] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-10-02T18:00:08.084833] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-02T18:00:08.299014] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-10-02T18:00:08.502535] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:08.550234] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T18:00:08.553445] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T18:00:09.073013] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-02T18:00:09.549120] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T18:00:09.872982] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-02T18:00:10.141638] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T18:00:10.673001] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-02T18:00:11.283485] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T18:00:11.473009] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-02T18:00:11.688757] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T18:00:12.273027] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-02T18:00:12.838114] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T18:00:13.002067] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T18:00:13.073027] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-02T18:00:13.872997] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-02T18:00:14.224282] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T18:00:14.673017] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-02T18:00:15.472982] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-10-02T18:00:15.609586] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T18:00:16.273027] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-02T18:00:16.832579] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T18:00:17.073029] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-02T18:00:17.416114] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (2.74 seconds). [2025-10-02T18:00:17.417416] [INFO ] [REMOTE ] CHE: Full fetch complete (20052 records). [2025-10-02T18:00:17.417507] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-02T18:00:17.849832] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-02T18:00:17.849999] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-02T18:00:17.850497] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-02T18:00:17.850587] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-02T18:00:17.851788] [DEBUG] [LOCAL ] CHE: Trimmed 20052 records to 15178 (keeping 200 days of data) [2025-10-02T18:00:17.895862] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-02T18:00:17.985625] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T18:00:18.019800] [DEBUG] [LOCAL ] CHE: Primary data saved (15178 records). [2025-10-02T18:00:18.020001] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-02T18:00:18.020197] [INFO ] [MAIN ] Update Progress: 436/2370 symbols completed. CHE took 24.1s. Estimated remaining: 4h 27m 12s. Rate: 7.2 symbols/min [2025-10-02T18:00:18.224247] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:18.232433] [DEBUG] [LOCAL ] CHN: Loaded 4818 existing records from primary storage. [2025-10-02T18:00:18.232847] [INFO ] [MAIN ] CHN: Loaded 4818 existing records. [2025-10-02T18:00:18.427726] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:00:18.428028] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-02T18:00:18.428133] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-02T18:00:18.428540] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-10-02T18:00:18.428637] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-02T18:00:18.556894] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T18:00:18.678091] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-02T18:00:18.870619] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:19.061086] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T18:00:19.472994] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-10-02T18:00:20.095752] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T18:00:20.272981] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-02T18:00:20.424555] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T18:00:21.072999] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-02T18:00:21.863390] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T18:00:21.873904] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-02T18:00:22.538744] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T18:00:22.672988] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-02T18:00:23.290678] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T18:00:23.472998] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-02T18:00:23.738037] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:00:24.095831] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T18:00:24.273010] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-02T18:00:24.883191] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T18:00:25.073037] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-02T18:00:25.873029] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-02T18:00:26.145857] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T18:00:26.466693] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T18:00:26.673056] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-02T18:00:27.473206] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-02T18:00:28.272995] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-02T18:00:28.748892] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-02T18:00:28.791584] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T18:00:29.073036] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-02T18:00:29.444400] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T18:00:29.873014] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-02T18:00:30.295516] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-02T18:00:30.628833] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T18:00:30.673002] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-02T18:00:31.473010] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-02T18:00:32.168503] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T18:00:32.272997] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-10-02T18:00:32.886860] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T18:00:33.073030] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-02T18:00:33.510315] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T18:00:33.873016] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-02T18:00:34.291120] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T18:00:34.673002] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-10-02T18:00:35.096161] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T18:00:35.473031] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-02T18:00:35.805863] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T18:00:35.808037] [INFO ] [REMOTE ] CHGG: Full fetch complete (70453 records). [2025-10-02T18:00:35.808203] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-10-02T18:00:36.232845] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-10-02T18:00:36.232965] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-10-02T18:00:36.233860] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-10-02T18:00:36.233930] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-10-02T18:00:36.235518] [DEBUG] [LOCAL ] CHGG: Trimmed 70453 records to 47996 (keeping 200 days of data) [2025-10-02T18:00:36.292580] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-02T18:00:36.490452] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T18:00:36.563548] [DEBUG] [LOCAL ] CHGG: Primary data saved (47996 records). [2025-10-02T18:00:36.563768] [INFO ] [MAIN ] CHGG: Full history saved. [2025-10-02T18:00:36.565523] [INFO ] [MAIN ] Update Progress: 437/2370 symbols completed. CHGG took 38.2s. Estimated remaining: 4h 27m 49s. Rate: 7.2 symbols/min [2025-10-02T18:00:37.063048] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T18:00:37.073013] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-02T18:00:37.873051] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-02T18:00:38.213301] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T18:00:38.478931] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-02T18:00:38.673012] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-02T18:00:39.473071] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-02T18:00:39.993165] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T18:00:39.999963] [INFO ] [REMOTE ] CHN: Full fetch complete (7446 records). [2025-10-02T18:00:40.000115] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-02T18:00:40.041509] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:00:40.279156] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-02T18:00:40.541157] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-02T18:00:40.541244] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-02T18:00:40.541522] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-02T18:00:40.541618] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-02T18:00:40.542665] [DEBUG] [LOCAL ] CHN: Trimmed 7446 records to 4849 (keeping 200 days of data) [2025-10-02T18:00:40.581192] [DEBUG] [LOCAL ] CHN: Primary data saved (4849 records). [2025-10-02T18:00:40.581379] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-02T18:00:40.581603] [INFO ] [MAIN ] Update Progress: 438/2370 symbols completed. CHN took 22.6s. Estimated remaining: 4h 27m 22s. Rate: 7.2 symbols/min [2025-10-02T18:00:41.073068] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-02T18:00:41.552162] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T18:00:41.873008] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-02T18:00:42.203815] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T18:00:42.673010] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-02T18:00:43.084928] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T18:00:43.086866] [INFO ] [REMOTE ] CHH: Full fetch complete (46571 records). [2025-10-02T18:00:43.086997] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-02T18:00:43.545971] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-02T18:00:43.546782] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-02T18:00:43.547617] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T18:00:43.548452] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-02T18:00:43.553562] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-02T18:00:43.554341] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-02T18:00:43.557062] [DEBUG] [LOCAL ] CHH: Trimmed 46571 records to 32209 (keeping 200 days of data) [2025-10-02T18:00:43.789703] [DEBUG] [LOCAL ] CHH: Primary data saved (32209 records). [2025-10-02T18:00:43.789900] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-02T18:00:43.790047] [INFO ] [MAIN ] Update Progress: 439/2370 symbols completed. CHH took 37.8s. Estimated remaining: 4h 26m 51s. Rate: 7.2 symbols/min [2025-10-02T18:00:44.640040] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T18:00:44.644759] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-02T18:00:45.614771] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T18:00:45.620832] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-02T18:00:46.311856] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T18:00:46.313440] [INFO ] [REMOTE ] CHMI: Full fetch complete (31812 records). [2025-10-02T18:00:46.313553] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-02T18:00:46.731888] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-02T18:00:46.731976] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-02T18:00:46.732512] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-02T18:00:46.732566] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-02T18:00:46.733462] [DEBUG] [LOCAL ] CHMI: Trimmed 31812 records to 22017 (keeping 200 days of data) [2025-10-02T18:00:46.882894] [DEBUG] [LOCAL ] CHMI: Primary data saved (22017 records). [2025-10-02T18:00:46.883080] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-02T18:00:46.883214] [INFO ] [MAIN ] Update Progress: 440/2370 symbols completed. CHMI took 39.3s. Estimated remaining: 4h 26m 20s. Rate: 7.2 symbols/min [2025-10-02T18:00:47.525055] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:47.601913] [DEBUG] [LOCAL ] CI: No existing data file found in primary storage. [2025-10-02T18:00:47.742538] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:47.741225] [WARN ] [MAIN ] CI: No existing data found, performing full refresh instead. [2025-10-02T18:00:47.731904] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:47.760422] [DEBUG] [LOCAL ] CHT: No existing data file found in primary storage. [2025-10-02T18:00:47.760237] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-02T18:00:47.765281] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:00:47.765393] [WARN ] [MAIN ] CHT: No existing data found, performing full refresh instead. [2025-10-02T18:00:47.760946] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-02T18:00:47.765817] [DEBUG] [LOCAL ] CI: No primary data file found to delete. [2025-10-02T18:00:47.765886] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-02T18:00:47.782809] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-02T18:00:47.796442] [DEBUG] [LOCAL ] CHWY: No existing data file found in primary storage. [2025-10-02T18:00:47.796795] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-02T18:00:47.796900] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-02T18:00:47.796962] [WARN ] [MAIN ] CHWY: No existing data found, performing full refresh instead. [2025-10-02T18:00:47.797095] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-02T18:00:47.797237] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-02T18:00:47.850111] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-02T18:00:47.962484] [DEBUG] [LOCAL ] CHWY: No primary data file found to delete. [2025-10-02T18:00:48.001701] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-02T18:00:48.318792] [DEBUG] [LOCAL ] CHPT: Loaded 48646 existing records from primary storage. [2025-10-02T18:00:48.353995] [INFO ] [MAIN ] CHPT: Loaded 48646 existing records. [2025-10-02T18:00:49.006535] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:49.043301] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-10-02T18:00:49.109018] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:49.120867] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-10-02T18:00:49.211481] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:00:49.238335] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-02T18:00:49.246860] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-02T18:00:49.253714] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-02T18:00:49.258988] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-02T18:00:49.467524] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:49.468604] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-10-02T18:00:49.762692] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:00:49.763024] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-10-02T18:00:50.136097] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T18:00:50.140541] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-02T18:00:50.785117] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:00:50.797017] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-02T18:00:51.111565] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T18:00:51.115485] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-02T18:00:51.711778] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-02T18:00:51.723725] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-02T18:00:51.984123] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-02T18:00:52.067535] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T18:00:52.272973] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-02T18:00:52.365272] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T18:00:53.072996] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-02T18:00:53.227430] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T18:00:53.329414] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T18:00:53.873037] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-02T18:00:54.594421] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T18:00:54.673052] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-02T18:00:55.473028] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-02T18:00:55.549207] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T18:00:56.273020] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-02T18:00:56.346106] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T18:00:57.073013] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-02T18:00:57.430823] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-02T18:00:57.873016] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-02T18:00:58.361071] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T18:00:58.672966] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-02T18:00:58.961033] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T18:00:59.053999] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T18:00:59.473012] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-02T18:01:00.272986] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-02T18:01:00.444224] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T18:01:01.073010] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-02T18:01:01.593841] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-02T18:01:01.873195] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-02T18:01:02.587229] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-02T18:01:02.673023] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-02T18:01:03.352363] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-02T18:01:03.473017] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-02T18:01:03.700527] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T18:01:04.273043] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-02T18:01:04.904212] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-02T18:01:05.073027] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-02T18:01:05.566268] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-02T18:01:05.872982] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-02T18:01:06.235734] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T18:01:06.673002] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-02T18:01:07.338674] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-02T18:01:07.472989] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-02T18:01:07.879723] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T18:01:08.273016] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-02T18:01:08.509872] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T18:01:09.073046] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-02T18:01:09.406704] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T18:01:09.669897] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-02T18:01:09.873003] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-02T18:01:10.334877] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:01:10.672996] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-02T18:01:11.473051] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-02T18:01:11.649977] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T18:01:11.831752] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-02T18:01:12.273016] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-02T18:01:13.072970] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-02T18:01:13.145071] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T18:01:13.269235] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T18:01:13.872996] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-02T18:01:14.672972] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-02T18:01:14.754766] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T18:01:14.760178] [INFO ] [REMOTE ] CI: Full fetch complete (72358 records). [2025-10-02T18:01:14.760366] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-02T18:01:15.198519] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-02T18:01:15.198605] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-02T18:01:15.199384] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-02T18:01:15.199452] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-02T18:01:15.200882] [DEBUG] [LOCAL ] CI: Trimmed 72358 records to 50086 (keeping 200 days of data) [2025-10-02T18:01:15.487261] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-02T18:01:15.527770] [DEBUG] [LOCAL ] CI: Primary data saved (50086 records). [2025-10-02T18:01:15.527900] [INFO ] [MAIN ] CI: Full history saved. [2025-10-02T18:01:15.528040] [INFO ] [MAIN ] Update Progress: 441/2370 symbols completed. CI took 28.6s. Estimated remaining: 4h 27m 41s. Rate: 7.2 symbols/min [2025-10-02T18:01:15.716684] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:15.735154] [DEBUG] [LOCAL ] CIA: Loaded 17039 existing records from primary storage. [2025-10-02T18:01:15.735410] [INFO ] [MAIN ] CIA: Loaded 17039 existing records. [2025-10-02T18:01:15.942439] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:01:15.942844] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-02T18:01:15.942928] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-02T18:01:15.954142] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-02T18:01:15.975181] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-02T18:01:16.053778] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-02T18:01:16.284572] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-02T18:01:16.391146] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:16.495331] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T18:01:17.072994] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-10-02T18:01:17.179421] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-10-02T18:01:17.872997] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-02T18:01:18.084104] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T18:01:18.274621] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-02T18:01:18.277019] [INFO ] [REMOTE ] CHWY: Full fetch complete (77633 records). [2025-10-02T18:01:18.277195] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-02T18:01:18.686706] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-02T18:01:18.729955] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-02T18:01:18.730045] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-02T18:01:18.730922] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-02T18:01:18.730990] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-02T18:01:18.732811] [DEBUG] [LOCAL ] CHWY: Trimmed 77633 records to 54044 (keeping 200 days of data) [2025-10-02T18:01:19.085483] [DEBUG] [LOCAL ] CHWY: Primary data saved (54044 records). [2025-10-02T18:01:19.085976] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-02T18:01:19.086121] [INFO ] [MAIN ] Update Progress: 442/2370 symbols completed. CHWY took 32.2s. Estimated remaining: 4h 27m 12s. Rate: 7.2 symbols/min [2025-10-02T18:01:19.273113] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:19.273639] [DEBUG] [LOCAL ] CIB: No existing data file found in primary storage. [2025-10-02T18:01:19.273899] [WARN ] [MAIN ] CIB: No existing data found, performing full refresh instead. [2025-10-02T18:01:19.274123] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-02T18:01:19.274187] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-02T18:01:19.274272] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-02T18:01:19.274344] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-02T18:01:19.503521] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-02T18:01:19.697114] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T18:01:19.733437] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:19.963998] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T18:01:20.273027] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-10-02T18:01:20.609869] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T18:01:21.072963] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-02T18:01:21.208133] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-10-02T18:01:21.873035] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-02T18:01:22.092531] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-02T18:01:22.673049] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-02T18:01:22.701747] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T18:01:22.704086] [INFO ] [REMOTE ] CHT: Full fetch complete (27487 records). [2025-10-02T18:01:22.704209] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-02T18:01:23.145414] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-10-02T18:01:23.145504] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-10-02T18:01:23.146022] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-10-02T18:01:23.146088] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-10-02T18:01:23.146993] [DEBUG] [LOCAL ] CHT: Trimmed 27487 records to 19829 (keeping 200 days of data) [2025-10-02T18:01:23.293395] [DEBUG] [LOCAL ] CHT: Primary data saved (19829 records). [2025-10-02T18:01:23.293546] [INFO ] [MAIN ] CHT: Full history saved. [2025-10-02T18:01:23.293625] [INFO ] [MAIN ] Update Progress: 443/2370 symbols completed. CHT took 36.4s. Estimated remaining: 4h 26m 45s. Rate: 7.2 symbols/min [2025-10-02T18:01:23.477527] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:23.477708] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-02T18:01:23.476829] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-02T18:01:23.478676] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-02T18:01:23.478844] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-02T18:01:23.478911] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-02T18:01:23.479015] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-02T18:01:23.479078] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-02T18:01:23.898075] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:24.095836] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T18:01:24.272995] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-10-02T18:01:24.795496] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-10-02T18:01:24.890899] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T18:01:25.073008] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-02T18:01:25.496233] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-02T18:01:25.872995] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-02T18:01:26.673089] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-02T18:01:26.804364] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T18:01:26.936098] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-02T18:01:27.473071] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-02T18:01:27.746696] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-02T18:01:28.272997] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-02T18:01:28.707938] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-02T18:01:29.073038] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-02T18:01:29.873019] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-02T18:01:30.326220] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T18:01:30.673003] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-02T18:01:31.130012] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T18:01:31.131428] [INFO ] [REMOTE ] CHPT: Full fetch complete (72386 records). [2025-10-02T18:01:31.131526] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-02T18:01:31.132229] [FATAL] [VALIDATOR ] CHPT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:01:31.132319] [FATAL] [MAIN ] CHPT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:01:31.132364] [WARN ] [MAIN ] CHPT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:01:31.132425] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-02T18:01:31.132529] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-10-02T18:01:31.132600] [INFO ] [LOCAL ] CHPT: Starting deletion of derivative data. [2025-10-02T18:01:31.133330] [DEBUG] [LOCAL ] CHPT: Deleted derivative data file. [2025-10-02T18:01:31.133473] [INFO ] [MAIN ] Update Progress: 444/2370 symbols completed. CHPT took 44.2s. Estimated remaining: 4h 26m 35s. Rate: 7.2 symbols/min [2025-10-02T18:01:31.322663] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:31.381491] [DEBUG] [LOCAL ] CIEN: Loaded 52071 existing records from primary storage. [2025-10-02T18:01:31.381864] [INFO ] [MAIN ] CIEN: Loaded 52071 existing records. [2025-10-02T18:01:31.478183] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-02T18:01:31.596851] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:01:31.597113] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-02T18:01:31.597187] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-02T18:01:31.598474] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-02T18:01:31.598538] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-02T18:01:32.041376] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:32.157965] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T18:01:32.273086] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-02T18:01:32.622526] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T18:01:32.626367] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-02T18:01:33.073054] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-10-02T18:01:33.873033] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-02T18:01:34.601686] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T18:01:34.673040] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-02T18:01:35.194236] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-02T18:01:35.239487] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T18:01:35.473052] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-02T18:01:35.717055] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-10-02T18:01:36.272994] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-02T18:01:36.633689] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-02T18:01:37.073025] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-02T18:01:37.873010] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-02T18:01:38.350324] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T18:01:38.673003] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-02T18:01:39.472984] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-02T18:01:39.555889] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-02T18:01:39.681961] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-02T18:01:40.273024] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-02T18:01:40.800624] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T18:01:41.073005] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-02T18:01:41.410026] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-02T18:01:41.687852] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T18:01:41.873037] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-02T18:01:42.263203] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T18:01:42.264066] [INFO ] [REMOTE ] CICB: Full fetch complete (2059 records). [2025-10-02T18:01:42.264142] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-02T18:01:42.470130] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-02T18:01:42.470331] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:01:42.470382] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:01:42.470464] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-02T18:01:42.470544] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-02T18:01:42.470583] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-02T18:01:42.470624] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-02T18:01:42.470721] [INFO ] [MAIN ] Update Progress: 445/2370 symbols completed. CICB took 19.2s. Estimated remaining: 4h 26m 40s. Rate: 7.2 symbols/min [2025-10-02T18:01:42.665789] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:42.672412] [DEBUG] [LOCAL ] CIF: Loaded 4204 existing records from primary storage. [2025-10-02T18:01:42.672623] [INFO ] [MAIN ] CIF: Loaded 4204 existing records. [2025-10-02T18:01:42.678291] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-02T18:01:42.875858] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:01:42.876090] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-02T18:01:42.876138] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-02T18:01:42.876439] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-02T18:01:42.876504] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-02T18:01:43.269441] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:43.473024] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-10-02T18:01:44.165807] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-02T18:01:44.272971] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-02T18:01:44.328118] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:01:44.747765] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T18:01:45.073045] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-02T18:01:45.873027] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-02T18:01:46.355942] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-02T18:01:46.673000] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-02T18:01:47.216694] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:01:47.473212] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-02T18:01:48.096819] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T18:01:48.149700] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:01:48.273044] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-02T18:01:49.073004] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-02T18:01:49.306317] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T18:01:49.873018] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-02T18:01:50.280985] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T18:01:50.537528] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T18:01:50.673054] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-02T18:01:51.473043] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-02T18:01:52.203165] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T18:01:52.272986] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-02T18:01:52.346338] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-02T18:01:53.073049] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-02T18:01:53.773387] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-02T18:01:53.873030] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-02T18:01:54.045962] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T18:01:54.520421] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T18:01:54.673008] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-02T18:01:55.473032] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-02T18:01:55.633163] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:01:55.634583] [INFO ] [REMOTE ] CIB: Full fetch complete (44321 records). [2025-10-02T18:01:55.634747] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-02T18:01:55.635676] [FATAL] [VALIDATOR ] CIB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:01:55.635782] [FATAL] [MAIN ] CIB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:01:55.635829] [WARN ] [MAIN ] CIB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:01:55.635905] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-02T18:01:55.635980] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-02T18:01:55.636019] [INFO ] [LOCAL ] CIB: Starting deletion of derivative data. [2025-10-02T18:01:55.636090] [DEBUG] [LOCAL ] CIB: No derivative data file found to delete. [2025-10-02T18:01:55.636175] [INFO ] [MAIN ] Update Progress: 446/2370 symbols completed. CIB took 36.5s. Estimated remaining: 4h 26m 52s. Rate: 7.2 symbols/min [2025-10-02T18:01:55.839896] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:55.889025] [DEBUG] [LOCAL ] CIG: Loaded 43824 existing records from primary storage. [2025-10-02T18:01:55.889374] [INFO ] [MAIN ] CIG: Loaded 43824 existing records. [2025-10-02T18:01:56.099599] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:01:56.099863] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-02T18:01:56.099913] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-02T18:01:56.101695] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-02T18:01:56.101761] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-02T18:01:56.283557] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-02T18:01:56.334922] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T18:01:56.390228] [INFO ] [REMOTE ] CIA: Full fetch complete (23642 records). [2025-10-02T18:01:56.407320] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-02T18:01:56.669624] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:57.005553] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-02T18:01:57.006614] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-02T18:01:57.007365] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-02T18:01:57.006533] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T18:01:57.007474] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-02T18:01:57.011038] [DEBUG] [LOCAL ] CIA: Trimmed 23642 records to 17134 (keeping 200 days of data) [2025-10-02T18:01:57.084015] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-02T18:01:57.118902] [DEBUG] [LOCAL ] CIA: Primary data saved (17134 records). [2025-10-02T18:01:57.119075] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-02T18:01:57.119167] [INFO ] [MAIN ] Update Progress: 447/2370 symbols completed. CIA took 41.6s. Estimated remaining: 4h 26m 15s. Rate: 7.2 symbols/min [2025-10-02T18:01:57.307147] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:01:57.325788] [DEBUG] [LOCAL ] CII: Loaded 15206 existing records from primary storage. [2025-10-02T18:01:57.326040] [INFO ] [MAIN ] CII: Loaded 15206 existing records. [2025-10-02T18:01:57.536704] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:01:57.537006] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-02T18:01:57.537067] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-02T18:01:57.537741] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-02T18:01:57.537806] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-02T18:01:57.885479] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-02T18:01:57.934803] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:01:58.336342] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T18:01:58.673048] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-02T18:01:58.902704] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T18:01:59.179129] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T18:01:59.473003] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-10-02T18:02:00.273002] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-10-02T18:02:01.072999] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-02T18:02:01.587679] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-02T18:02:01.744223] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T18:02:01.873005] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-02T18:02:02.673030] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-02T18:02:02.917257] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T18:02:03.032091] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T18:02:03.414690] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T18:02:03.473029] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-02T18:02:04.273025] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-02T18:02:04.953712] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T18:02:05.073001] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-02T18:02:05.545296] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-10-02T18:02:05.873029] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-02T18:02:06.581046] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T18:02:06.673019] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-02T18:02:06.703599] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T18:02:07.472993] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-02T18:02:08.087930] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:02:08.089699] [INFO ] [REMOTE ] CIEN: Full fetch complete (75191 records). [2025-10-02T18:02:08.089849] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-02T18:02:08.090856] [FATAL] [VALIDATOR ] CIEN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:02:08.090958] [FATAL] [MAIN ] CIEN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:02:08.091003] [WARN ] [MAIN ] CIEN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:02:08.091072] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-02T18:02:08.091139] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-10-02T18:02:08.091177] [INFO ] [LOCAL ] CIEN: Starting deletion of derivative data. [2025-10-02T18:02:08.091715] [DEBUG] [LOCAL ] CIEN: Deleted derivative data file. [2025-10-02T18:02:08.092065] [INFO ] [MAIN ] Update Progress: 448/2370 symbols completed. CIEN took 37.0s. Estimated remaining: 4h 26m 18s. Rate: 7.2 symbols/min [2025-10-02T18:02:08.284428] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-02T18:02:08.289015] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:08.289990] [DEBUG] [LOCAL ] CIM: No existing data file found in primary storage. [2025-10-02T18:02:08.290052] [WARN ] [MAIN ] CIM: No existing data found, performing full refresh instead. [2025-10-02T18:02:08.290240] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-02T18:02:08.290309] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-02T18:02:08.290370] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-10-02T18:02:08.290415] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-02T18:02:08.751077] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:08.918352] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T18:02:09.072979] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-02T18:02:09.105297] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-02T18:02:09.873004] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-02T18:02:10.673013] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-02T18:02:10.687245] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T18:02:10.724091] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:02:11.472999] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-10-02T18:02:12.080430] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T18:02:12.273000] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-02T18:02:12.743637] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T18:02:13.073003] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-02T18:02:13.873027] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-02T18:02:14.024776] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:02:14.433138] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T18:02:14.534142] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T18:02:14.535055] [INFO ] [REMOTE ] CIF: Full fetch complete (6615 records). [2025-10-02T18:02:14.535132] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-02T18:02:14.689038] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-02T18:02:14.951863] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-02T18:02:14.951967] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-02T18:02:14.952194] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-02T18:02:14.952246] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-02T18:02:14.952748] [DEBUG] [LOCAL ] CIF: Trimmed 6615 records to 4220 (keeping 200 days of data) [2025-10-02T18:02:14.981576] [DEBUG] [LOCAL ] CIF: Primary data saved (4220 records). [2025-10-02T18:02:14.981743] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-02T18:02:14.981841] [INFO ] [MAIN ] Update Progress: 449/2370 symbols completed. CIF took 32.5s. Estimated remaining: 4h 26m 3s. Rate: 7.2 symbols/min [2025-10-02T18:02:15.176554] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:15.181947] [DEBUG] [LOCAL ] CIMN: Loaded 2682 existing records from primary storage. [2025-10-02T18:02:15.182214] [INFO ] [MAIN ] CIMN: Loaded 2682 existing records. [2025-10-02T18:02:15.380447] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:02:15.380690] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-02T18:02:15.380752] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-02T18:02:15.380989] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-10-02T18:02:15.381054] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-02T18:02:15.481707] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-02T18:02:15.783904] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-02T18:02:15.824673] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:16.273015] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-10-02T18:02:16.923932] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T18:02:17.055322] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T18:02:17.072984] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-02T18:02:17.873000] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-02T18:02:18.210037] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-02T18:02:18.682471] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-02T18:02:18.688892] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T18:02:19.473039] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-02T18:02:19.759613] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T18:02:20.273034] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-02T18:02:21.072978] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-02T18:02:21.179090] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T18:02:21.310007] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T18:02:21.740763] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-02T18:02:21.873003] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-02T18:02:22.673026] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-02T18:02:23.169265] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T18:02:23.354327] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T18:02:23.472988] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-02T18:02:24.023835] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T18:02:24.273010] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-02T18:02:24.846799] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T18:02:25.073040] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-02T18:02:25.873042] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-02T18:02:25.966627] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T18:02:26.153473] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-02T18:02:26.673037] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-02T18:02:27.472975] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-02T18:02:28.001079] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T18:02:28.272997] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-02T18:02:28.349311] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T18:02:29.073006] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-02T18:02:29.518442] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T18:02:29.873048] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-02T18:02:30.569581] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T18:02:30.673036] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-02T18:02:30.767624] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-02T18:02:31.473038] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-02T18:02:31.831740] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-02T18:02:31.838813] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:02:31.840280] [INFO ] [REMOTE ] CIG: Full fetch complete (60883 records). [2025-10-02T18:02:31.840372] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-02T18:02:31.841532] [FATAL] [VALIDATOR ] CIG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:02:31.841622] [FATAL] [MAIN ] CIG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:02:31.841712] [WARN ] [MAIN ] CIG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:02:31.841789] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-02T18:02:31.841871] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-10-02T18:02:31.841928] [INFO ] [LOCAL ] CIG: Starting deletion of derivative data. [2025-10-02T18:02:31.842211] [DEBUG] [LOCAL ] CIG: Deleted derivative data file. [2025-10-02T18:02:31.842324] [INFO ] [MAIN ] Update Progress: 450/2370 symbols completed. CIG took 36.2s. Estimated remaining: 4h 26m 32s. Rate: 7.2 symbols/min [2025-10-02T18:02:32.039442] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:32.039639] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-02T18:02:32.039721] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-02T18:02:32.039843] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-02T18:02:32.039886] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-02T18:02:32.039930] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-02T18:02:32.039963] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-02T18:02:32.281893] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-02T18:02:32.516050] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:33.073036] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-02T18:02:33.121503] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T18:02:33.386502] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-02T18:02:33.873024] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-02T18:02:34.673077] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-10-02T18:02:35.384870] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T18:02:35.473000] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-02T18:02:35.506700] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T18:02:36.272974] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-02T18:02:36.508355] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:02:36.625330] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-02T18:02:36.626141] [INFO ] [REMOTE ] CIMN: Full fetch complete (3910 records). [2025-10-02T18:02:36.626214] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-02T18:02:37.018942] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-02T18:02:37.019048] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-02T18:02:37.019236] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-02T18:02:37.019281] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-02T18:02:37.019877] [DEBUG] [LOCAL ] CIMN: Trimmed 3910 records to 2697 (keeping 200 days of data) [2025-10-02T18:02:37.038242] [DEBUG] [LOCAL ] CIMN: Primary data saved (2697 records). [2025-10-02T18:02:37.038378] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-02T18:02:37.038465] [INFO ] [MAIN ] Update Progress: 451/2370 symbols completed. CIMN took 22.1s. Estimated remaining: 4h 26m 10s. Rate: 7.2 symbols/min [2025-10-02T18:02:37.078106] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-02T18:02:37.228508] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:37.228820] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-02T18:02:37.228893] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-02T18:02:37.229041] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-02T18:02:37.229143] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-02T18:02:37.229197] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-02T18:02:37.229232] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-02T18:02:37.662391] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:37.873024] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-10-02T18:02:38.078134] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:02:38.078588] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-10-02T18:02:38.078738] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:02:38.078811] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-02T18:02:38.078891] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:02:38.078984] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-02T18:02:38.079091] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-02T18:02:38.079158] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-02T18:02:38.079245] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-02T18:02:38.079375] [INFO ] [MAIN ] Update Progress: 452/2370 symbols completed. CIMP took 1.0s. Estimated remaining: 4h 25m 31s. Rate: 7.2 symbols/min [2025-10-02T18:02:38.278918] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:38.279238] [DEBUG] [LOCAL ] CINT: No existing data file found in primary storage. [2025-10-02T18:02:38.279311] [WARN ] [MAIN ] CINT: No existing data found, performing full refresh instead. [2025-10-02T18:02:38.279482] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-02T18:02:38.279549] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-02T18:02:38.279726] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-10-02T18:02:38.279856] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-02T18:02:38.667602] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T18:02:38.673037] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-02T18:02:38.722012] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:39.366042] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T18:02:39.367084] [INFO ] [REMOTE ] CII: Full fetch complete (22909 records). [2025-10-02T18:02:39.367166] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-02T18:02:39.367676] [FATAL] [VALIDATOR ] CII: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:02:39.367768] [FATAL] [MAIN ] CII: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:02:39.367815] [WARN ] [MAIN ] CII: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:02:39.367856] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-02T18:02:39.367953] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-10-02T18:02:39.368117] [INFO ] [LOCAL ] CII: Starting deletion of derivative data. [2025-10-02T18:02:39.368510] [DEBUG] [LOCAL ] CII: Deleted derivative data file. [2025-10-02T18:02:39.368630] [INFO ] [MAIN ] Update Progress: 453/2370 symbols completed. CII took 42.2s. Estimated remaining: 4h 24m 53s. Rate: 7.2 symbols/min [2025-10-02T18:02:39.478147] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-10-02T18:02:39.558670] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:39.579878] [DEBUG] [LOCAL ] CIO: Loaded 20291 existing records from primary storage. [2025-10-02T18:02:39.580154] [INFO ] [MAIN ] CIO: Loaded 20291 existing records. [2025-10-02T18:02:39.813662] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:02:39.814065] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-02T18:02:39.814131] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-02T18:02:39.815146] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-02T18:02:39.815209] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-02T18:02:40.196298] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:40.208676] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:02:40.273016] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-02T18:02:40.637352] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-02T18:02:41.073053] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-02T18:02:41.873040] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-02T18:02:42.327826] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:02:42.356848] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T18:02:42.673045] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-02T18:02:43.473012] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-10-02T18:02:44.048549] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T18:02:44.273047] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-02T18:02:44.688209] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T18:02:44.704848] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-02T18:02:45.073017] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-02T18:02:45.747749] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-02T18:02:45.873027] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-02T18:02:46.672997] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-02T18:02:46.827332] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T18:02:47.473068] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-02T18:02:47.887940] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T18:02:47.891033] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-02T18:02:47.894838] [INFO ] [REMOTE ] CIM: Full fetch complete (54940 records). [2025-10-02T18:02:47.895041] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-02T18:02:48.273228] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-02T18:02:48.396219] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-02T18:02:48.396325] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-02T18:02:48.397106] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-02T18:02:48.397300] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-02T18:02:48.398981] [DEBUG] [LOCAL ] CIM: Trimmed 54940 records to 37813 (keeping 200 days of data) [2025-10-02T18:02:48.633776] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-02T18:02:48.669772] [DEBUG] [LOCAL ] CIM: Primary data saved (37813 records). [2025-10-02T18:02:48.669997] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-02T18:02:48.670160] [INFO ] [MAIN ] Update Progress: 454/2370 symbols completed. CIM took 40.6s. Estimated remaining: 4h 24m 49s. Rate: 7.2 symbols/min [2025-10-02T18:02:48.861911] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:02:48.862090] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-02T18:02:48.862130] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-02T18:02:48.862246] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-02T18:02:48.862343] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-02T18:02:48.862396] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-02T18:02:48.862447] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-02T18:02:49.078240] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-02T18:02:49.265148] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:02:49.873045] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-10-02T18:02:50.202528] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T18:02:50.673044] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-02T18:02:51.294325] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T18:02:51.450219] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T18:02:51.473010] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-02T18:02:52.273007] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-02T18:02:52.593904] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T18:02:53.072993] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-02T18:02:53.075302] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:02:53.872990] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-02T18:02:54.028744] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T18:02:54.672988] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-02T18:02:54.748691] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-02T18:02:55.473059] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-02T18:02:55.750102] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T18:02:55.985137] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-02T18:02:56.273066] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-02T18:02:57.073055] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-02T18:02:57.283287] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T18:02:57.873008] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-02T18:02:58.025427] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T18:02:58.506286] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T18:02:58.672998] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-02T18:02:59.473041] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-02T18:03:00.103980] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T18:03:00.137342] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T18:03:00.273000] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-02T18:03:00.940926] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T18:03:01.072999] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-02T18:03:01.873020] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-02T18:03:02.038022] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-02T18:03:02.673008] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-02T18:03:03.094390] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T18:03:03.132908] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T18:03:03.134181] [INFO ] [REMOTE ] CIMO: Full fetch complete (5269 records). [2025-10-02T18:03:03.134273] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-02T18:03:03.134864] [FATAL] [VALIDATOR ] CIMO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:03:03.134962] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:03:03.135007] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:03:03.135129] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-02T18:03:03.135223] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-02T18:03:03.135274] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-02T18:03:03.135334] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-02T18:03:03.135416] [INFO ] [MAIN ] Update Progress: 455/2370 symbols completed. CIMO took 31.3s. Estimated remaining: 4h 25m 6s. Rate: 7.2 symbols/min [2025-10-02T18:03:03.341938] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:03.416989] [DEBUG] [LOCAL ] CIVI: Loaded 52597 existing records from primary storage. [2025-10-02T18:03:03.417436] [INFO ] [MAIN ] CIVI: Loaded 52597 existing records. [2025-10-02T18:03:03.478165] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-02T18:03:03.624621] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:03:03.624882] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-02T18:03:03.624933] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-02T18:03:03.626475] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-02T18:03:03.626579] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-02T18:03:04.042032] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:04.273044] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-10-02T18:03:05.066368] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:03:05.074369] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-02T18:03:05.872974] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-02T18:03:06.106709] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T18:03:06.164390] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T18:03:06.673001] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-02T18:03:06.982416] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T18:03:07.472998] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-02T18:03:08.153627] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T18:03:08.272992] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-02T18:03:08.718968] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T18:03:09.073044] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-02T18:03:09.615514] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T18:03:09.873012] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-02T18:03:10.062711] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T18:03:10.676387] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T18:03:10.676143] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-02T18:03:10.679263] [INFO ] [REMOTE ] CINT: Full fetch complete (26684 records). [2025-10-02T18:03:10.679354] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-02T18:03:11.130684] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-02T18:03:11.130823] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-02T18:03:11.131420] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-02T18:03:11.131489] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-02T18:03:11.132509] [DEBUG] [LOCAL ] CINT: Trimmed 26684 records to 18940 (keeping 200 days of data) [2025-10-02T18:03:11.257843] [DEBUG] [LOCAL ] CINT: Primary data saved (18940 records). [2025-10-02T18:03:11.258007] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-02T18:03:11.258140] [INFO ] [MAIN ] Update Progress: 456/2370 symbols completed. CINT took 33.2s. Estimated remaining: 4h 24m 57s. Rate: 7.2 symbols/min [2025-10-02T18:03:11.450135] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:11.450344] [DEBUG] [LOCAL ] CL: No existing data file found in primary storage. [2025-10-02T18:03:11.450417] [WARN ] [MAIN ] CL: No existing data found, performing full refresh instead. [2025-10-02T18:03:11.450592] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-02T18:03:11.450681] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-02T18:03:11.450746] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-02T18:03:11.450784] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-02T18:03:11.478126] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-02T18:03:11.867256] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:11.985112] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T18:03:12.272973] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-02T18:03:12.431225] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T18:03:13.073037] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-10-02T18:03:13.873007] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-02T18:03:14.253179] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T18:03:14.616379] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T18:03:14.643632] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T18:03:14.672960] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-02T18:03:15.473039] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-02T18:03:15.977961] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T18:03:16.273043] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-02T18:03:16.602111] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T18:03:17.073029] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-02T18:03:17.582389] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T18:03:17.873052] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-02T18:03:18.673009] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-02T18:03:19.127432] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T18:03:19.370967] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T18:03:19.473045] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-02T18:03:19.875595] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T18:03:20.273006] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-02T18:03:21.073053] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-02T18:03:21.684031] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T18:03:21.747500] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-10-02T18:03:21.872983] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-02T18:03:22.124781] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T18:03:22.127780] [INFO ] [REMOTE ] CION: Full fetch complete (41069 records). [2025-10-02T18:03:22.127910] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-02T18:03:22.556588] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-02T18:03:22.556725] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-02T18:03:22.557332] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-02T18:03:22.557383] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-02T18:03:22.558512] [DEBUG] [LOCAL ] CION: Trimmed 41069 records to 29036 (keeping 200 days of data) [2025-10-02T18:03:22.674816] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-02T18:03:22.770203] [DEBUG] [LOCAL ] CION: Primary data saved (29036 records). [2025-10-02T18:03:22.770352] [INFO ] [MAIN ] CION: Full history saved. [2025-10-02T18:03:22.770443] [INFO ] [MAIN ] Update Progress: 457/2370 symbols completed. CION took 34.1s. Estimated remaining: 4h 25m 2s. Rate: 7.2 symbols/min [2025-10-02T18:03:22.961773] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:22.962055] [DEBUG] [LOCAL ] CLB: No existing data file found in primary storage. [2025-10-02T18:03:22.962114] [WARN ] [MAIN ] CLB: No existing data found, performing full refresh instead. [2025-10-02T18:03:22.962233] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-02T18:03:22.962276] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-02T18:03:22.962321] [DEBUG] [LOCAL ] CLB: No primary data file found to delete. [2025-10-02T18:03:22.962355] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-02T18:03:23.362597] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:23.473051] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-10-02T18:03:23.920354] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-10-02T18:03:24.273047] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-02T18:03:24.434628] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T18:03:24.828068] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T18:03:25.072993] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-02T18:03:25.873024] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-02T18:03:26.134844] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:03:26.184939] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T18:03:26.673024] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-02T18:03:27.444679] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T18:03:27.472967] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-02T18:03:28.322863] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-02T18:03:28.347766] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T18:03:29.072980] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-02T18:03:29.245234] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T18:03:29.686999] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T18:03:29.873062] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-02T18:03:30.585638] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T18:03:30.673056] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-02T18:03:31.473004] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-02T18:03:31.662963] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T18:03:31.778484] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T18:03:32.273034] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-02T18:03:33.073009] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-02T18:03:33.424403] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T18:03:33.426919] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T18:03:33.440278] [INFO ] [REMOTE ] CIO: Full fetch complete (29159 records). [2025-10-02T18:03:33.440824] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-02T18:03:33.861306] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-02T18:03:33.861442] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-02T18:03:33.862219] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-02T18:03:33.862296] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-02T18:03:33.863689] [DEBUG] [LOCAL ] CIO: Trimmed 29159 records to 20557 (keeping 200 days of data) [2025-10-02T18:03:33.873070] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-02T18:03:34.059043] [DEBUG] [LOCAL ] CIO: Primary data saved (20557 records). [2025-10-02T18:03:34.059216] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-02T18:03:34.059337] [INFO ] [MAIN ] Update Progress: 458/2370 symbols completed. CIO took 54.7s. Estimated remaining: 4h 25m 7s. Rate: 7.2 symbols/min [2025-10-02T18:03:34.232110] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T18:03:34.403322] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:34.427950] [DEBUG] [LOCAL ] CLCO: Loaded 12678 existing records from primary storage. [2025-10-02T18:03:34.428424] [INFO ] [MAIN ] CLCO: Loaded 12678 existing records. [2025-10-02T18:03:34.670673] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:03:34.670941] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-02T18:03:34.670999] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-02T18:03:34.671526] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-02T18:03:34.671593] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-02T18:03:34.684432] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-02T18:03:35.104897] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:35.158144] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T18:03:35.160521] [INFO ] [REMOTE ] CIVI: Full fetch complete (75709 records). [2025-10-02T18:03:35.160725] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-02T18:03:35.478154] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-02T18:03:35.613957] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-02T18:03:35.614056] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-02T18:03:35.614976] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-02T18:03:35.615050] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-02T18:03:35.617070] [DEBUG] [LOCAL ] CIVI: Trimmed 75709 records to 52985 (keeping 200 days of data) [2025-10-02T18:03:35.995042] [DEBUG] [LOCAL ] CIVI: Primary data saved (52985 records). [2025-10-02T18:03:35.995457] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-02T18:03:35.995554] [INFO ] [MAIN ] Update Progress: 459/2370 symbols completed. CIVI took 32.9s. Estimated remaining: 4h 24m 32s. Rate: 7.2 symbols/min [2025-10-02T18:03:36.196732] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:36.196971] [DEBUG] [LOCAL ] CLDT: No existing data file found in primary storage. [2025-10-02T18:03:36.197017] [WARN ] [MAIN ] CLDT: No existing data found, performing full refresh instead. [2025-10-02T18:03:36.197164] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-02T18:03:36.197207] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-02T18:03:36.197252] [DEBUG] [LOCAL ] CLDT: No primary data file found to delete. [2025-10-02T18:03:36.197286] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-02T18:03:36.282619] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-10-02T18:03:36.657605] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:36.928864] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-02T18:03:37.073054] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-02T18:03:37.196667] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T18:03:37.429147] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T18:03:37.873028] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-02T18:03:38.672997] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-02T18:03:38.775263] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T18:03:39.109796] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T18:03:39.378116] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-02T18:03:39.472996] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-02T18:03:40.273015] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-02T18:03:40.639443] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T18:03:41.073047] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-10-02T18:03:41.626062] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T18:03:41.627816] [INFO ] [REMOTE ] CL: Full fetch complete (77229 records). [2025-10-02T18:03:41.627965] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-02T18:03:41.629525] [FATAL] [VALIDATOR ] CL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:03:41.629683] [FATAL] [MAIN ] CL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:03:41.629752] [WARN ] [MAIN ] CL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:03:41.629831] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-02T18:03:41.629899] [DEBUG] [LOCAL ] CL: No primary data file found to delete. [2025-10-02T18:03:41.629940] [INFO ] [LOCAL ] CL: Starting deletion of derivative data. [2025-10-02T18:03:41.629982] [DEBUG] [LOCAL ] CL: No derivative data file found to delete. [2025-10-02T18:03:41.630110] [INFO ] [MAIN ] Update Progress: 460/2370 symbols completed. CL took 30.4s. Estimated remaining: 4h 24m 12s. Rate: 7.2 symbols/min [2025-10-02T18:03:41.826275] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:41.883664] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-02T18:03:41.887314] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-02T18:03:41.887756] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-02T18:03:42.105092] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:03:42.105458] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-02T18:03:42.105700] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-02T18:03:42.107307] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-02T18:03:42.107380] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-02T18:03:42.496402] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T18:03:42.563969] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:42.673019] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-02T18:03:42.930870] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T18:03:43.472977] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-02T18:03:43.749145] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T18:03:44.272992] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-10-02T18:03:44.440014] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T18:03:45.073018] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-02T18:03:45.872996] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-02T18:03:46.063824] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T18:03:46.250774] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T18:03:46.673028] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-02T18:03:47.316337] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:03:47.473041] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-02T18:03:47.754591] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T18:03:48.273001] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-02T18:03:49.072996] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-02T18:03:49.525861] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-02T18:03:49.611535] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T18:03:49.873063] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-02T18:03:50.337496] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:03:50.673053] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-02T18:03:50.698052] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T18:03:51.473022] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-02T18:03:51.884865] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T18:03:51.886364] [INFO ] [REMOTE ] CLB: Full fetch complete (46714 records). [2025-10-02T18:03:51.886483] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-02T18:03:52.278105] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-02T18:03:52.325339] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-02T18:03:52.325410] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-02T18:03:52.326025] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-02T18:03:52.326185] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-02T18:03:52.327365] [DEBUG] [LOCAL ] CLB: Trimmed 46714 records to 33203 (keeping 200 days of data) [2025-10-02T18:03:52.566568] [DEBUG] [LOCAL ] CLB: Primary data saved (33203 records). [2025-10-02T18:03:52.566787] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-02T18:03:52.566877] [INFO ] [MAIN ] Update Progress: 461/2370 symbols completed. CLB took 29.8s. Estimated remaining: 4h 24m 15s. Rate: 7.2 symbols/min [2025-10-02T18:03:52.762387] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:03:52.796414] [DEBUG] [LOCAL ] CLH: Loaded 27798 existing records from primary storage. [2025-10-02T18:03:52.796787] [INFO ] [MAIN ] CLH: Loaded 27798 existing records. [2025-10-02T18:03:52.990234] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:03:52.990464] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-02T18:03:52.990515] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-02T18:03:52.991466] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-02T18:03:52.991528] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-02T18:03:53.078131] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-02T18:03:53.413422] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:03:53.443971] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T18:03:53.796173] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T18:03:53.872995] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-02T18:03:53.958171] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-02T18:03:54.672997] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-10-02T18:03:55.473004] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-02T18:03:55.633537] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T18:03:55.992623] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T18:03:56.273008] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-02T18:03:56.382694] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T18:03:57.073052] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-02T18:03:57.873223] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-02T18:03:58.177041] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T18:03:58.593153] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-10-02T18:03:58.654100] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T18:03:58.673017] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-02T18:03:59.403240] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T18:03:59.472985] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-02T18:04:00.134765] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T18:04:00.273003] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-02T18:04:01.073009] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-02T18:04:01.729106] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T18:04:01.872967] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-02T18:04:02.218022] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T18:04:02.673010] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-02T18:04:03.472953] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-02T18:04:03.526690] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T18:04:03.634165] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T18:04:04.272997] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-02T18:04:04.547332] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T18:04:05.028351] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T18:04:05.029722] [INFO ] [REMOTE ] CLCO: Full fetch complete (22777 records). [2025-10-02T18:04:05.029816] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-02T18:04:05.078188] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-02T18:04:05.472047] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-02T18:04:05.472137] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-02T18:04:05.472596] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-02T18:04:05.472686] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-02T18:04:05.473541] [DEBUG] [LOCAL ] CLCO: Trimmed 22777 records to 12817 (keeping 200 days of data) [2025-10-02T18:04:05.562988] [DEBUG] [LOCAL ] CLCO: Primary data saved (12817 records). [2025-10-02T18:04:05.563136] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-02T18:04:05.563224] [INFO ] [MAIN ] Update Progress: 462/2370 symbols completed. CLCO took 31.5s. Estimated remaining: 4h 24m 26s. Rate: 7.2 symbols/min [2025-10-02T18:04:05.767073] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:05.767259] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-10-02T18:04:05.767299] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-10-02T18:04:05.767416] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-02T18:04:05.767458] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-02T18:04:05.767500] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-02T18:04:05.767533] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-02T18:04:05.878245] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-02T18:04:06.163011] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:04:06.369380] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T18:04:06.678142] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-02T18:04:06.689705] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T18:04:07.472991] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-02T18:04:08.135085] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T18:04:08.273049] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-02T18:04:08.324082] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T18:04:08.325486] [INFO ] [REMOTE ] CLDT: Full fetch complete (37075 records). [2025-10-02T18:04:08.325573] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-02T18:04:08.750266] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-02T18:04:08.750347] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-02T18:04:08.750906] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-02T18:04:08.750969] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-02T18:04:08.751924] [DEBUG] [LOCAL ] CLDT: Trimmed 37075 records to 25578 (keeping 200 days of data) [2025-10-02T18:04:08.903943] [DEBUG] [LOCAL ] CLDT: Primary data saved (25578 records). [2025-10-02T18:04:08.904155] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-02T18:04:08.904243] [INFO ] [MAIN ] Update Progress: 463/2370 symbols completed. CLDT took 32.9s. Estimated remaining: 4h 23m 57s. Rate: 7.2 symbols/min [2025-10-02T18:04:09.079630] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-10-02T18:04:09.098730] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:09.158694] [DEBUG] [LOCAL ] CLS: Loaded 53619 existing records from primary storage. [2025-10-02T18:04:09.159032] [INFO ] [MAIN ] CLS: Loaded 53619 existing records. [2025-10-02T18:04:09.355548] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:04:09.355776] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-02T18:04:09.355828] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-02T18:04:09.357307] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-02T18:04:09.357368] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-02T18:04:09.750457] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:04:09.872994] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-10-02T18:04:10.141433] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T18:04:10.279985] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T18:04:10.673023] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-02T18:04:11.472986] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-02T18:04:12.089206] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T18:04:12.273006] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-02T18:04:12.724569] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.85 seconds). [2025-10-02T18:04:12.770611] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-02T18:04:13.073035] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-02T18:04:13.690426] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T18:04:13.873028] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-02T18:04:14.672999] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-02T18:04:15.072053] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-02T18:04:15.472968] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-02T18:04:15.840515] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T18:04:15.996175] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-02T18:04:16.273251] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-02T18:04:16.330556] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T18:04:17.073002] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-02T18:04:17.873026] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-02T18:04:18.315211] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-02T18:04:18.356515] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T18:04:18.673040] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-02T18:04:18.852319] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T18:04:19.472992] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-02T18:04:20.273050] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-02T18:04:21.021425] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-10-02T18:04:21.072987] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-02T18:04:21.452947] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T18:04:21.622317] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-02T18:04:21.873023] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-02T18:04:22.673044] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-02T18:04:23.472984] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-02T18:04:23.486564] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T18:04:23.495194] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-02T18:04:23.528840] [INFO ] [REMOTE ] CLF: Full fetch complete (77809 records). [2025-10-02T18:04:23.530847] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-10-02T18:04:23.529497] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-02T18:04:23.988504] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-02T18:04:23.988592] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-02T18:04:23.989459] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-02T18:04:23.989526] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-02T18:04:23.991075] [DEBUG] [LOCAL ] CLF: Trimmed 77809 records to 54131 (keeping 200 days of data) [2025-10-02T18:04:24.292609] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-02T18:04:24.352603] [DEBUG] [LOCAL ] CLF: Primary data saved (54131 records). [2025-10-02T18:04:24.352783] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-02T18:04:24.352875] [INFO ] [MAIN ] Update Progress: 464/2370 symbols completed. CLF took 42.7s. Estimated remaining: 4h 24m 18s. Rate: 7.2 symbols/min [2025-10-02T18:04:24.552840] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:24.604443] [DEBUG] [LOCAL ] CLVT: Loaded 51961 existing records from primary storage. [2025-10-02T18:04:24.604929] [INFO ] [MAIN ] CLVT: Loaded 51961 existing records. [2025-10-02T18:04:24.813623] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:04:24.813916] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-02T18:04:24.814000] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-02T18:04:24.815461] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-02T18:04:24.815530] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-02T18:04:24.942901] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T18:04:25.080419] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-02T18:04:25.312757] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T18:04:25.319320] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:04:25.873015] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-10-02T18:04:26.388675] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T18:04:26.673092] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-02T18:04:27.344593] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T18:04:27.473010] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-02T18:04:28.273009] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-02T18:04:28.607943] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T18:04:28.809073] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T18:04:29.073034] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-02T18:04:29.188214] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T18:04:29.873017] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-02T18:04:30.221925] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T18:04:30.223537] [INFO ] [REMOTE ] CLH: Full fetch complete (41812 records). [2025-10-02T18:04:30.223671] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-02T18:04:30.684165] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-02T18:04:30.680633] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-02T18:04:30.684427] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-02T18:04:30.685531] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-02T18:04:30.685632] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-02T18:04:30.688149] [DEBUG] [LOCAL ] CLH: Trimmed 41812 records to 28009 (keeping 200 days of data) [2025-10-02T18:04:30.794128] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T18:04:30.885788] [DEBUG] [LOCAL ] CLH: Primary data saved (28009 records). [2025-10-02T18:04:30.885939] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-02T18:04:30.886027] [INFO ] [MAIN ] Update Progress: 465/2370 symbols completed. CLH took 38.3s. Estimated remaining: 4h 24m 3s. Rate: 7.2 symbols/min [2025-10-02T18:04:31.070066] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:31.092042] [DEBUG] [LOCAL ] CLW: Loaded 21778 existing records from primary storage. [2025-10-02T18:04:31.092310] [INFO ] [MAIN ] CLW: Loaded 21778 existing records. [2025-10-02T18:04:31.289068] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:04:31.289326] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-02T18:04:31.289375] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-02T18:04:31.289947] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-02T18:04:31.290010] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-02T18:04:31.480392] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-02T18:04:31.748514] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:04:32.199453] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T18:04:32.272974] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-02T18:04:32.362158] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T18:04:33.073021] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-02T18:04:33.873013] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-02T18:04:34.357139] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T18:04:34.358280] [INFO ] [REMOTE ] CLPR: Full fetch complete (17520 records). [2025-10-02T18:04:34.358552] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-02T18:04:34.359199] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:04:34.359286] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:04:34.359354] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:04:34.359428] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-02T18:04:34.359493] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-10-02T18:04:34.359530] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-10-02T18:04:34.359572] [DEBUG] [LOCAL ] CLPR: No derivative data file found to delete. [2025-10-02T18:04:34.359630] [INFO ] [MAIN ] Update Progress: 466/2370 symbols completed. CLPR took 28.8s. Estimated remaining: 4h 23m 34s. Rate: 7.2 symbols/min [2025-10-02T18:04:34.564138] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:34.621702] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:04:34.639043] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-02T18:04:34.672980] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-10-02T18:04:34.714857] [DEBUG] [LOCAL ] CLX: Loaded 51491 existing records from primary storage. [2025-10-02T18:04:34.715178] [INFO ] [MAIN ] CLX: Loaded 51491 existing records. [2025-10-02T18:04:34.920294] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:04:34.920512] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-02T18:04:34.920561] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-02T18:04:34.922128] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-10-02T18:04:34.922192] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-02T18:04:35.358335] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:04:35.473005] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-02T18:04:36.126765] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T18:04:36.273036] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-02T18:04:37.073025] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-02T18:04:37.575231] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T18:04:37.878101] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-10-02T18:04:37.907943] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-10-02T18:04:38.672988] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-02T18:04:38.803667] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:04:39.472988] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-02T18:04:39.805286] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T18:04:40.272997] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-02T18:04:40.953559] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:04:41.047337] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-10-02T18:04:41.072973] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-02T18:04:41.467572] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-02T18:04:41.873005] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-02T18:04:42.649278] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T18:04:42.672985] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-02T18:04:42.708790] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T18:04:43.473012] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-02T18:04:44.272987] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-02T18:04:44.377465] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T18:04:45.073003] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-02T18:04:45.737000] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T18:04:45.835519] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T18:04:45.872996] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-02T18:04:46.551976] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:04:46.673006] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-02T18:04:47.473003] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-02T18:04:47.792920] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-02T18:04:47.794582] [INFO ] [REMOTE ] CLS: Full fetch complete (77077 records). [2025-10-02T18:04:47.794722] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-02T18:04:47.795536] [FATAL] [VALIDATOR ] CLS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:04:47.795631] [FATAL] [MAIN ] CLS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:04:47.795715] [WARN ] [MAIN ] CLS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:04:47.795766] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-02T18:04:47.795825] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-10-02T18:04:47.795864] [INFO ] [LOCAL ] CLS: Starting deletion of derivative data. [2025-10-02T18:04:47.796315] [DEBUG] [LOCAL ] CLS: Deleted derivative data file. [2025-10-02T18:04:47.796426] [INFO ] [MAIN ] Update Progress: 467/2370 symbols completed. CLS took 38.9s. Estimated remaining: 4h 23m 47s. Rate: 7.2 symbols/min [2025-10-02T18:04:47.990284] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:48.037815] [DEBUG] [LOCAL ] CM: Loaded 48556 existing records from primary storage. [2025-10-02T18:04:48.038175] [INFO ] [MAIN ] CM: Loaded 48556 existing records. [2025-10-02T18:04:48.235519] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:04:48.235935] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-02T18:04:48.236056] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-02T18:04:48.237604] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-02T18:04:48.237698] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-02T18:04:48.274180] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-02T18:04:48.643323] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-02T18:04:48.673893] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:04:49.073009] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-02T18:04:49.408957] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-02T18:04:49.512472] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T18:04:49.873029] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-02T18:04:50.673041] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-02T18:04:50.848170] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T18:04:51.004110] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T18:04:51.473059] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-10-02T18:04:52.272977] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-02T18:04:52.497351] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T18:04:53.055305] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T18:04:53.072960] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-02T18:04:53.872996] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-02T18:04:54.190704] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T18:04:54.216180] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:04:54.673017] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-02T18:04:55.472970] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-02T18:04:55.697914] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T18:04:55.732822] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T18:04:56.272990] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-02T18:04:57.072996] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-02T18:04:57.430617] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-02T18:04:57.489426] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-02T18:04:57.872990] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-02T18:04:58.372974] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T18:04:58.672979] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-02T18:04:58.818861] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T18:04:58.820263] [INFO ] [REMOTE ] CLW: Full fetch complete (34977 records). [2025-10-02T18:04:58.820354] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-02T18:04:59.242228] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-02T18:04:59.242437] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-02T18:04:59.243029] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-02T18:04:59.243094] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-02T18:04:59.244043] [DEBUG] [LOCAL ] CLW: Trimmed 34977 records to 21887 (keeping 200 days of data) [2025-10-02T18:04:59.370093] [DEBUG] [LOCAL ] CLW: Primary data saved (21887 records). [2025-10-02T18:04:59.370232] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-02T18:04:59.370351] [INFO ] [MAIN ] Update Progress: 468/2370 symbols completed. CLW took 28.5s. Estimated remaining: 4h 23m 52s. Rate: 7.2 symbols/min [2025-10-02T18:04:59.474309] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-02T18:04:59.550222] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:04:59.604027] [DEBUG] [LOCAL ] CMA: Loaded 49871 existing records from primary storage. [2025-10-02T18:04:59.604436] [INFO ] [MAIN ] CMA: Loaded 49871 existing records. [2025-10-02T18:04:59.795759] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:04:59.796023] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-02T18:04:59.796073] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-02T18:04:59.797538] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-02T18:04:59.797602] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-02T18:05:00.200292] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:00.273026] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-02T18:05:00.551101] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-02T18:05:01.073010] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-02T18:05:01.360001] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T18:05:01.800366] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T18:05:01.872991] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-02T18:05:02.673053] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-02T18:05:03.436978] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-02T18:05:03.472996] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-02T18:05:03.704360] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T18:05:04.169230] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:05:04.171497] [INFO ] [REMOTE ] CLVT: Full fetch complete (75241 records). [2025-10-02T18:05:04.171687] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-02T18:05:04.281396] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-02T18:05:04.624100] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-02T18:05:04.624221] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-02T18:05:04.625271] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-02T18:05:04.625361] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-02T18:05:04.626997] [DEBUG] [LOCAL ] CLVT: Trimmed 75241 records to 52342 (keeping 200 days of data) [2025-10-02T18:05:04.948124] [DEBUG] [LOCAL ] CLVT: Primary data saved (52342 records). [2025-10-02T18:05:04.948306] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-02T18:05:04.948410] [INFO ] [MAIN ] Update Progress: 469/2370 symbols completed. CLVT took 40.6s. Estimated remaining: 4h 23m 32s. Rate: 7.2 symbols/min [2025-10-02T18:05:05.078136] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-10-02T18:05:05.139430] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:05.164098] [DEBUG] [LOCAL ] CMBT: Loaded 23471 existing records from primary storage. [2025-10-02T18:05:05.164513] [INFO ] [MAIN ] CMBT: Loaded 23471 existing records. [2025-10-02T18:05:05.379632] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:05.380115] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-02T18:05:05.380326] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-02T18:05:05.381111] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-02T18:05:05.381175] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-02T18:05:05.756633] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-10-02T18:05:05.836634] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:05.872967] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-10-02T18:05:06.025603] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T18:05:06.673010] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-02T18:05:06.954816] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T18:05:07.093801] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T18:05:07.473036] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-02T18:05:08.065320] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T18:05:08.273057] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-02T18:05:08.717960] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T18:05:08.864840] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-02T18:05:09.073003] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-02T18:05:09.873002] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-02T18:05:10.672996] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-02T18:05:10.774368] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T18:05:10.800909] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T18:05:11.473028] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-02T18:05:12.136819] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T18:05:12.139120] [INFO ] [REMOTE ] CLX: Full fetch complete (73078 records). [2025-10-02T18:05:12.139242] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-02T18:05:12.285849] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-02T18:05:12.575140] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-02T18:05:12.575230] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-02T18:05:12.576024] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-02T18:05:12.576091] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-02T18:05:12.577678] [DEBUG] [LOCAL ] CLX: Trimmed 73078 records to 51852 (keeping 200 days of data) [2025-10-02T18:05:12.941978] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T18:05:12.971124] [DEBUG] [LOCAL ] CLX: Primary data saved (51852 records). [2025-10-02T18:05:12.971297] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-02T18:05:12.971406] [INFO ] [MAIN ] Update Progress: 470/2370 symbols completed. CLX took 38.6s. Estimated remaining: 4h 23m 23s. Rate: 7.2 symbols/min [2025-10-02T18:05:13.077588] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-02T18:05:13.174712] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:13.218764] [DEBUG] [LOCAL ] CMC: Loaded 45589 existing records from primary storage. [2025-10-02T18:05:13.219087] [INFO ] [MAIN ] CMC: Loaded 45589 existing records. [2025-10-02T18:05:13.435099] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:13.445270] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-02T18:05:13.446023] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-02T18:05:13.446345] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T18:05:13.449972] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-02T18:05:13.450565] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-02T18:05:13.877226] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-02T18:05:13.877111] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:14.673061] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-10-02T18:05:15.046256] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T18:05:15.473025] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-02T18:05:15.620816] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T18:05:16.098059] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T18:05:16.273018] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-02T18:05:16.648938] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T18:05:17.073006] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-02T18:05:17.817264] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T18:05:17.873027] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-02T18:05:18.087568] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T18:05:18.673133] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-02T18:05:19.437826] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T18:05:19.473058] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-02T18:05:19.541421] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T18:05:20.272991] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-02T18:05:20.977833] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T18:05:21.073050] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-02T18:05:21.497350] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T18:05:21.501297] [INFO ] [REMOTE ] CM: Full fetch complete (69394 records). [2025-10-02T18:05:21.501493] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-02T18:05:21.878199] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-02T18:05:21.982789] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-02T18:05:21.982896] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-02T18:05:21.983916] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-02T18:05:21.984018] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-02T18:05:21.986014] [DEBUG] [LOCAL ] CM: Trimmed 69394 records to 48929 (keeping 200 days of data) [2025-10-02T18:05:22.315777] [DEBUG] [LOCAL ] CM: Primary data saved (48929 records). [2025-10-02T18:05:22.315922] [INFO ] [MAIN ] CM: Full history saved. [2025-10-02T18:05:22.316053] [INFO ] [MAIN ] Update Progress: 471/2370 symbols completed. CM took 34.5s. Estimated remaining: 4h 23m 19s. Rate: 7.2 symbols/min [2025-10-02T18:05:22.519007] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:22.527218] [DEBUG] [LOCAL ] CMCM: Loaded 4726 existing records from primary storage. [2025-10-02T18:05:22.527585] [INFO ] [MAIN ] CMCM: Loaded 4726 existing records. [2025-10-02T18:05:22.676390] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-02T18:05:22.746484] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:22.747605] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-02T18:05:22.747949] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-02T18:05:22.748365] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-02T18:05:22.748484] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-02T18:05:22.980558] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-02T18:05:23.011885] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T18:05:23.223865] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:23.472983] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-10-02T18:05:24.183485] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T18:05:24.272976] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-02T18:05:24.367291] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T18:05:25.073035] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-02T18:05:25.549246] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-02T18:05:25.769389] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T18:05:25.873016] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-02T18:05:26.532024] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-02T18:05:26.673011] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-02T18:05:27.473027] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-02T18:05:28.272978] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-02T18:05:28.551489] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T18:05:28.680185] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-02T18:05:29.072968] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-02T18:05:29.265277] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:05:29.873041] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-02T18:05:30.678136] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-02T18:05:30.696303] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T18:05:31.032816] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T18:05:31.266930] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-02T18:05:31.472999] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-02T18:05:32.273014] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-02T18:05:33.073024] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-02T18:05:33.151813] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T18:05:33.873048] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-02T18:05:33.936328] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T18:05:34.667170] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T18:05:34.674037] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-02T18:05:35.375846] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-02T18:05:35.420393] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T18:05:35.472978] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-02T18:05:36.273019] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-02T18:05:36.978348] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T18:05:37.073073] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-02T18:05:37.472386] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T18:05:37.473924] [INFO ] [REMOTE ] CMA: Full fetch complete (72738 records). [2025-10-02T18:05:37.474097] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-02T18:05:37.474998] [FATAL] [VALIDATOR ] CMA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:05:37.475096] [FATAL] [MAIN ] CMA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:05:37.475141] [WARN ] [MAIN ] CMA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:05:37.475201] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-02T18:05:37.475294] [DEBUG] [LOCAL ] CMA: No primary data file found to delete. [2025-10-02T18:05:37.475351] [INFO ] [LOCAL ] CMA: Starting deletion of derivative data. [2025-10-02T18:05:37.475760] [DEBUG] [LOCAL ] CMA: Deleted derivative data file. [2025-10-02T18:05:37.477330] [INFO ] [MAIN ] Update Progress: 472/2370 symbols completed. CMA took 38.1s. Estimated remaining: 4h 23m 38s. Rate: 7.2 symbols/min [2025-10-02T18:05:37.668272] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:37.668517] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-02T18:05:37.668574] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-02T18:05:37.668716] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-02T18:05:37.668767] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-02T18:05:37.668813] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-02T18:05:37.668858] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-02T18:05:37.881072] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-02T18:05:38.074556] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:38.672999] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-10-02T18:05:38.893096] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:05:38.893633] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-10-02T18:05:38.893913] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:05:38.896631] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T18:05:38.894483] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-02T18:05:38.908533] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:05:38.909193] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-02T18:05:38.909306] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-02T18:05:38.909795] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-02T18:05:38.909870] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-02T18:05:38.909947] [INFO ] [MAIN ] Update Progress: 473/2370 symbols completed. CMDB took 1.4s. Estimated remaining: 4h 23m 2s. Rate: 7.2 symbols/min [2025-10-02T18:05:39.094290] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:39.167164] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-10-02T18:05:39.167492] [INFO ] [MAIN ] CMG: Loaded 53721 existing records. [2025-10-02T18:05:39.414715] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:39.414959] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-02T18:05:39.415089] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-02T18:05:39.416875] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-02T18:05:39.417010] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-02T18:05:39.478122] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-02T18:05:39.580268] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T18:05:39.850498] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:40.272998] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-02T18:05:41.073009] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-02T18:05:41.143904] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T18:05:41.146087] [INFO ] [REMOTE ] CMBT: Full fetch complete (30527 records). [2025-10-02T18:05:41.146182] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-02T18:05:41.578454] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-02T18:05:41.578580] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-02T18:05:41.579188] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-02T18:05:41.579306] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-02T18:05:41.580626] [DEBUG] [LOCAL ] CMBT: Trimmed 30527 records to 23828 (keeping 200 days of data) [2025-10-02T18:05:41.709020] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:05:41.725799] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T18:05:41.783520] [DEBUG] [LOCAL ] CMBT: Primary data saved (23828 records). [2025-10-02T18:05:41.783690] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-02T18:05:41.783816] [INFO ] [MAIN ] Update Progress: 474/2370 symbols completed. CMBT took 36.8s. Estimated remaining: 4h 22m 32s. Rate: 7.2 symbols/min [2025-10-02T18:05:41.878119] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-10-02T18:05:41.972944] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:42.013939] [DEBUG] [LOCAL ] CMI: Loaded 41704 existing records from primary storage. [2025-10-02T18:05:42.014258] [INFO ] [MAIN ] CMI: Loaded 41704 existing records. [2025-10-02T18:05:42.206755] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:42.207000] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-02T18:05:42.207094] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-02T18:05:42.208412] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-02T18:05:42.208477] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-02T18:05:42.607872] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:42.673030] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-02T18:05:43.473048] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-10-02T18:05:43.489380] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T18:05:44.239381] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-10-02T18:05:44.272955] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-02T18:05:44.785756] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T18:05:45.073020] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-02T18:05:45.766816] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T18:05:45.873011] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-02T18:05:46.335207] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-02T18:05:46.647046] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T18:05:46.672995] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-02T18:05:47.473011] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-02T18:05:47.997281] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T18:05:47.998388] [INFO ] [REMOTE ] CMCM: Full fetch complete (6955 records). [2025-10-02T18:05:47.998480] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-02T18:05:48.278140] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-02T18:05:48.409187] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-02T18:05:48.409272] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-02T18:05:48.409465] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-02T18:05:48.409508] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-02T18:05:48.409967] [DEBUG] [LOCAL ] CMCM: Trimmed 6955 records to 4758 (keeping 200 days of data) [2025-10-02T18:05:48.437761] [DEBUG] [LOCAL ] CMCM: Primary data saved (4758 records). [2025-10-02T18:05:48.437880] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-02T18:05:48.437962] [INFO ] [MAIN ] Update Progress: 475/2370 symbols completed. CMCM took 26.1s. Estimated remaining: 4h 22m 17s. Rate: 7.2 symbols/min [2025-10-02T18:05:48.629087] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:48.672006] [DEBUG] [LOCAL ] CMP: Loaded 36257 existing records from primary storage. [2025-10-02T18:05:48.672403] [INFO ] [MAIN ] CMP: Loaded 36257 existing records. [2025-10-02T18:05:48.868124] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:48.868585] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-02T18:05:48.868778] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-02T18:05:48.879205] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-02T18:05:48.893795] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-02T18:05:48.978429] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-02T18:05:49.078083] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-02T18:05:49.316115] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:49.648526] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T18:05:49.872995] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-10-02T18:05:50.672993] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-02T18:05:51.084351] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-02T18:05:51.322206] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T18:05:51.472999] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-02T18:05:51.976693] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T18:05:52.272999] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-02T18:05:52.813312] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T18:05:53.072990] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-02T18:05:53.649190] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T18:05:53.873022] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-02T18:05:54.498398] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:05:54.673011] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-02T18:05:55.473015] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-02T18:05:55.595057] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T18:05:56.075699] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T18:05:56.272993] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-02T18:05:56.688115] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T18:05:56.693191] [INFO ] [REMOTE ] CMC: Full fetch complete (67009 records). [2025-10-02T18:05:56.693476] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-02T18:05:57.078294] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-02T18:05:57.162434] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-10-02T18:05:57.162544] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-10-02T18:05:57.163950] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-10-02T18:05:57.164025] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-10-02T18:05:57.165980] [DEBUG] [LOCAL ] CMC: Trimmed 67009 records to 45898 (keeping 200 days of data) [2025-10-02T18:05:57.459334] [DEBUG] [LOCAL ] CMC: Primary data saved (45898 records). [2025-10-02T18:05:57.459479] [INFO ] [MAIN ] CMC: Full history saved. [2025-10-02T18:05:57.459596] [INFO ] [MAIN ] Update Progress: 476/2370 symbols completed. CMC took 44.5s. Estimated remaining: 4h 22m 12s. Rate: 7.2 symbols/min [2025-10-02T18:05:57.646175] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:05:57.687282] [DEBUG] [LOCAL ] CMPO: Loaded 39242 existing records from primary storage. [2025-10-02T18:05:57.687595] [INFO ] [MAIN ] CMPO: Loaded 39242 existing records. [2025-10-02T18:05:57.878479] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-02T18:05:57.882909] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:05:57.884360] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-02T18:05:57.884424] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-02T18:05:57.885833] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-02T18:05:57.885908] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-02T18:05:58.285714] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:05:58.551434] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-02T18:05:58.635975] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T18:05:58.672964] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-02T18:05:59.300578] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T18:05:59.473033] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-10-02T18:06:00.252397] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T18:06:00.272971] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-02T18:06:00.937402] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:06:01.073023] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-02T18:06:01.873041] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-02T18:06:02.111381] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T18:06:02.673017] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-02T18:06:02.735275] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T18:06:03.382721] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T18:06:03.473045] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-02T18:06:04.273068] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-02T18:06:04.576361] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T18:06:04.930397] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-02T18:06:05.073027] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-02T18:06:05.564240] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T18:06:05.873032] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-02T18:06:06.637227] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T18:06:06.673018] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-02T18:06:07.473025] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-02T18:06:07.522030] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T18:06:08.213784] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T18:06:08.273038] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-02T18:06:09.073007] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-02T18:06:09.760854] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-02T18:06:09.799571] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T18:06:09.873047] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-02T18:06:10.586117] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T18:06:10.673045] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-02T18:06:11.473020] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-02T18:06:11.946007] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-02T18:06:11.947046] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T18:06:12.273031] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-02T18:06:13.077619] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-02T18:06:13.083467] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T18:06:13.873024] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-02T18:06:14.631826] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-10-02T18:06:14.672989] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-02T18:06:14.789433] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T18:06:15.016980] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T18:06:15.018566] [INFO ] [REMOTE ] CMP: Full fetch complete (52536 records). [2025-10-02T18:06:15.018720] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-02T18:06:15.439939] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-02T18:06:15.440336] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-02T18:06:15.441174] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-02T18:06:15.441260] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-02T18:06:15.442613] [DEBUG] [LOCAL ] CMP: Trimmed 52536 records to 36460 (keeping 200 days of data) [2025-10-02T18:06:15.497138] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-10-02T18:06:15.673155] [DEBUG] [LOCAL ] CMP: Primary data saved (36460 records). [2025-10-02T18:06:15.673412] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-02T18:06:15.673513] [INFO ] [MAIN ] Update Progress: 477/2370 symbols completed. CMP took 27.2s. Estimated remaining: 4h 22m 43s. Rate: 7.2 symbols/min [2025-10-02T18:06:15.909786] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T18:06:16.272997] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-02T18:06:17.073003] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-02T18:06:17.766278] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-10-02T18:06:17.872990] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-10-02T18:06:17.933760] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T18:06:18.177682] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T18:06:18.673033] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-02T18:06:19.473001] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-02T18:06:19.710958] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T18:06:20.166791] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T18:06:20.273009] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-10-02T18:06:20.789809] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T18:06:20.792201] [INFO ] [REMOTE ] CMI: Full fetch complete (60087 records). [2025-10-02T18:06:20.792312] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-02T18:06:21.079035] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-02T18:06:21.215955] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-02T18:06:21.216054] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-02T18:06:21.216842] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-02T18:06:21.216911] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-02T18:06:21.219044] [DEBUG] [LOCAL ] CMI: Trimmed 60087 records to 42060 (keeping 200 days of data) [2025-10-02T18:06:21.496302] [DEBUG] [LOCAL ] CMI: Primary data saved (42060 records). [2025-10-02T18:06:21.496460] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-02T18:06:21.496550] [INFO ] [MAIN ] Update Progress: 478/2370 symbols completed. CMI took 39.7s. Estimated remaining: 4h 22m 24s. Rate: 7.2 symbols/min [2025-10-02T18:06:22.393352] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T18:06:22.395277] [INFO ] [REMOTE ] CMPO: Full fetch complete (59000 records). [2025-10-02T18:06:22.395410] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-02T18:06:22.521202] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-02T18:06:22.544710] [INFO ] [REMOTE ] CMG: Full fetch complete (77795 records). [2025-10-02T18:06:22.555205] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-10-02T18:06:23.185336] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-02T18:06:23.209490] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-02T18:06:23.223908] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-02T18:06:23.243096] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-02T18:06:23.310411] [DEBUG] [LOCAL ] CMPO: Trimmed 59000 records to 39512 (keeping 200 days of data) [2025-10-02T18:06:23.355827] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-10-02T18:06:23.355928] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-10-02T18:06:23.356687] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-10-02T18:06:23.356755] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-10-02T18:06:23.444547] [DEBUG] [LOCAL ] CMG: Trimmed 77795 records to 54111 (keeping 200 days of data) [2025-10-02T18:06:23.721831] [DEBUG] [LOCAL ] CMPO: Primary data saved (39512 records). [2025-10-02T18:06:23.729810] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-02T18:06:23.730279] [INFO ] [MAIN ] Update Progress: 479/2370 symbols completed. CMPO took 26.3s. Estimated remaining: 4h 21m 52s. Rate: 7.2 symbols/min [2025-10-02T18:06:23.950938] [DEBUG] [LOCAL ] CMG: Primary data saved (54111 records). [2025-10-02T18:06:23.951103] [INFO ] [MAIN ] CMG: Full history saved. [2025-10-02T18:06:23.952251] [INFO ] [MAIN ] Update Progress: 480/2370 symbols completed. CMG took 45.0s. Estimated remaining: 4h 21m 12s. Rate: 7.2 symbols/min [2025-10-02T18:06:24.659912] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:24.818201] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:24.819259] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:24.825313] [DEBUG] [LOCAL ] CMS: No existing data file found in primary storage. [2025-10-02T18:06:24.828463] [WARN ] [MAIN ] CMS: No existing data found, performing full refresh instead. [2025-10-02T18:06:24.828135] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:24.830444] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-02T18:06:24.830559] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-02T18:06:24.832316] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-02T18:06:24.832496] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-02T18:06:24.894333] [DEBUG] [LOCAL ] CMSC: Loaded 5075 existing records from primary storage. [2025-10-02T18:06:24.925598] [DEBUG] [LOCAL ] CMSA: Loaded 3509 existing records from primary storage. [2025-10-02T18:06:24.926110] [INFO ] [MAIN ] CMSC: Loaded 5075 existing records. [2025-10-02T18:06:24.932168] [INFO ] [MAIN ] CMSA: Loaded 3509 existing records. [2025-10-02T18:06:25.160851] [DEBUG] [LOCAL ] CMRE: Loaded 35458 existing records from primary storage. [2025-10-02T18:06:25.275357] [INFO ] [MAIN ] CMRE: Loaded 35458 existing records. [2025-10-02T18:06:25.719296] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:06:25.747903] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-02T18:06:25.808559] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-02T18:06:25.933747] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:06:25.938178] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:06:25.942575] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-02T18:06:25.942750] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-02T18:06:25.945000] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-02T18:06:25.945262] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-02T18:06:25.963683] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-02T18:06:25.945116] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-10-02T18:06:25.963754] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-10-02T18:06:25.964150] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-02T18:06:25.964072] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-02T18:06:25.967188] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-02T18:06:25.974473] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:26.076899] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-10-02T18:06:27.221029] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:27.303218] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-10-02T18:06:27.317259] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:27.327036] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-10-02T18:06:27.368880] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:27.369980] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-10-02T18:06:28.078428] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T18:06:28.081453] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-02T18:06:28.119559] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T18:06:28.122465] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-02T18:06:28.297349] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-10-02T18:06:28.310817] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-02T18:06:28.541912] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T18:06:28.543947] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-02T18:06:28.660691] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T18:06:28.666853] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-02T18:06:28.715297] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-02T18:06:28.966213] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-02T18:06:29.073060] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-02T18:06:29.523001] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:06:29.751263] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T18:06:29.872971] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-02T18:06:29.906758] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T18:06:30.673022] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-02T18:06:31.220320] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-02T18:06:31.248574] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T18:06:31.473025] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-02T18:06:32.273016] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-02T18:06:33.072981] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-02T18:06:33.165618] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T18:06:33.652129] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T18:06:33.667059] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T18:06:33.873015] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-02T18:06:34.572039] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T18:06:34.673001] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-02T18:06:35.112675] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-02T18:06:35.473032] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-02T18:06:36.273003] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-02T18:06:36.675976] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T18:06:36.879515] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T18:06:37.073019] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-02T18:06:37.791432] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T18:06:37.873018] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-02T18:06:38.602207] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T18:06:38.673001] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-02T18:06:39.194373] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T18:06:39.473011] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-02T18:06:40.272993] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-02T18:06:41.073033] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-02T18:06:41.430990] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T18:06:41.873228] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-02T18:06:41.876016] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T18:06:42.245398] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T18:06:42.318103] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-02T18:06:42.673002] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-02T18:06:43.473003] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-02T18:06:43.847159] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T18:06:44.273013] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-02T18:06:44.778534] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-02T18:06:44.779341] [INFO ] [REMOTE ] CMSA: Full fetch complete (5158 records). [2025-10-02T18:06:44.779415] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-02T18:06:45.078542] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-02T18:06:45.185378] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-02T18:06:45.185513] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-02T18:06:45.185789] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-02T18:06:45.185874] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-02T18:06:45.186527] [DEBUG] [LOCAL ] CMSA: Trimmed 5158 records to 3530 (keeping 200 days of data) [2025-10-02T18:06:45.209228] [DEBUG] [LOCAL ] CMSA: Primary data saved (3530 records). [2025-10-02T18:06:45.209349] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-02T18:06:45.209431] [INFO ] [MAIN ] Update Progress: 481/2370 symbols completed. CMSA took 21.2s. Estimated remaining: 4h 21m 54s. Rate: 7.2 symbols/min [2025-10-02T18:06:45.393860] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:45.430777] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T18:06:45.447398] [DEBUG] [LOCAL ] CMSD: Loaded 8099 existing records from primary storage. [2025-10-02T18:06:45.448333] [INFO ] [MAIN ] CMSD: Loaded 8099 existing records. [2025-10-02T18:06:45.638033] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:06:45.638252] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-02T18:06:45.638304] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-02T18:06:45.638788] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-02T18:06:45.638854] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-02T18:06:45.878229] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-02T18:06:46.030724] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:46.273960] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T18:06:46.533175] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T18:06:46.672986] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-02T18:06:47.102502] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-02T18:06:47.472999] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-02T18:06:48.273007] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-02T18:06:48.610776] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T18:06:48.643617] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-02T18:06:49.073006] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-02T18:06:49.872998] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-02T18:06:50.544513] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T18:06:50.673003] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-10-02T18:06:51.472997] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-02T18:06:51.758928] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T18:06:51.970419] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-02T18:06:52.273013] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-02T18:06:52.595446] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T18:06:52.597216] [INFO ] [REMOTE ] CMRE: Full fetch complete (50008 records). [2025-10-02T18:06:52.597321] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-02T18:06:53.046073] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-02T18:06:53.046169] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-02T18:06:53.046829] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-02T18:06:53.046896] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-02T18:06:53.048154] [DEBUG] [LOCAL ] CMRE: Trimmed 50008 records to 35698 (keeping 200 days of data) [2025-10-02T18:06:53.104404] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-02T18:06:53.278093] [DEBUG] [LOCAL ] CMRE: Primary data saved (35698 records). [2025-10-02T18:06:53.278273] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-02T18:06:53.278410] [INFO ] [MAIN ] Update Progress: 482/2370 symbols completed. CMRE took 29.3s. Estimated remaining: 4h 21m 45s. Rate: 7.2 symbols/min [2025-10-02T18:06:53.469521] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:53.505403] [DEBUG] [LOCAL ] CMTG: Loaded 36836 existing records from primary storage. [2025-10-02T18:06:53.505732] [INFO ] [MAIN ] CMTG: Loaded 36836 existing records. [2025-10-02T18:06:53.724898] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:06:53.725324] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-02T18:06:53.725400] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-02T18:06:53.726452] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-10-02T18:06:53.726534] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-02T18:06:53.890885] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-02T18:06:53.916190] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T18:06:54.084891] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T18:06:54.238435] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:54.672962] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-02T18:06:54.756180] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-02T18:06:55.126619] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T18:06:55.127444] [INFO ] [REMOTE ] CMSC: Full fetch complete (7189 records). [2025-10-02T18:06:55.127514] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-02T18:06:55.478183] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-02T18:06:55.522878] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-10-02T18:06:55.522974] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-10-02T18:06:55.523272] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-10-02T18:06:55.523342] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-10-02T18:06:55.523949] [DEBUG] [LOCAL ] CMSC: Trimmed 7189 records to 5108 (keeping 200 days of data) [2025-10-02T18:06:55.559059] [DEBUG] [LOCAL ] CMSC: Primary data saved (5108 records). [2025-10-02T18:06:55.559210] [INFO ] [MAIN ] CMSC: Full history saved. [2025-10-02T18:06:55.559306] [INFO ] [MAIN ] Update Progress: 483/2370 symbols completed. CMSC took 31.6s. Estimated remaining: 4h 21m 13s. Rate: 7.2 symbols/min [2025-10-02T18:06:55.746466] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:06:55.746636] [DEBUG] [LOCAL ] CMU: No existing data file found in primary storage. [2025-10-02T18:06:55.746745] [WARN ] [MAIN ] CMU: No existing data found, performing full refresh instead. [2025-10-02T18:06:55.746873] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-02T18:06:55.746920] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-02T18:06:55.746966] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-02T18:06:55.747003] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-02T18:06:56.129317] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:06:56.272995] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-02T18:06:56.706563] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T18:06:57.073010] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-10-02T18:06:57.413848] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-02T18:06:57.873008] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-10-02T18:06:57.879697] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T18:06:58.673004] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-02T18:06:59.277042] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T18:06:59.449312] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T18:06:59.472985] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-02T18:07:00.273016] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-02T18:07:00.893184] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T18:07:00.908627] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T18:07:01.072996] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-02T18:07:01.873060] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-02T18:07:02.473499] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:07:02.672994] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-02T18:07:03.353173] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T18:07:03.472966] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-02T18:07:03.554299] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T18:07:04.273010] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-02T18:07:05.072990] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-02T18:07:05.184033] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T18:07:05.805592] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-02T18:07:05.873036] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-02T18:07:06.196035] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T18:07:06.673047] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-02T18:07:07.380361] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T18:07:07.472999] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-02T18:07:07.966748] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T18:07:07.969145] [INFO ] [REMOTE ] CMS: Full fetch complete (76023 records). [2025-10-02T18:07:07.969297] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-02T18:07:08.280144] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-02T18:07:08.311053] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T18:07:08.436147] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-10-02T18:07:08.436294] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-10-02T18:07:08.437412] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-10-02T18:07:08.437507] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-10-02T18:07:08.439157] [DEBUG] [LOCAL ] CMS: Trimmed 76023 records to 52995 (keeping 200 days of data) [2025-10-02T18:07:08.841084] [DEBUG] [LOCAL ] CMS: Primary data saved (52995 records). [2025-10-02T18:07:08.841268] [INFO ] [MAIN ] CMS: Full history saved. [2025-10-02T18:07:08.841362] [INFO ] [MAIN ] Update Progress: 484/2370 symbols completed. CMS took 44.9s. Estimated remaining: 4h 21m 24s. Rate: 7.2 symbols/min [2025-10-02T18:07:09.049169] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:07:09.054055] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T18:07:09.075161] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-02T18:07:09.091312] [DEBUG] [LOCAL ] CNA: Loaded 32776 existing records from primary storage. [2025-10-02T18:07:09.091701] [INFO ] [MAIN ] CNA: Loaded 32776 existing records. [2025-10-02T18:07:09.331768] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:07:09.332010] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-02T18:07:09.332060] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-02T18:07:09.333019] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-02T18:07:09.333083] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-02T18:07:09.767760] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:07:09.844031] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-02T18:07:09.872972] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-02T18:07:10.669997] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-02T18:07:10.673053] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-02T18:07:11.392306] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T18:07:11.473006] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-02T18:07:12.053144] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T18:07:12.273011] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-02T18:07:13.073038] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-02T18:07:13.728813] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T18:07:13.770371] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T18:07:13.873000] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-02T18:07:14.673008] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-10-02T18:07:15.248827] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T18:07:15.473034] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-02T18:07:15.951573] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T18:07:16.144395] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T18:07:16.272994] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-02T18:07:16.775448] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T18:07:16.776478] [INFO ] [REMOTE ] CMSD: Full fetch complete (12404 records). [2025-10-02T18:07:16.776560] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-02T18:07:17.081753] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-02T18:07:17.175845] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-02T18:07:17.175939] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-02T18:07:17.176320] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-02T18:07:17.176365] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-02T18:07:17.176898] [DEBUG] [LOCAL ] CMSD: Trimmed 12404 records to 8137 (keeping 200 days of data) [2025-10-02T18:07:17.229839] [DEBUG] [LOCAL ] CMSD: Primary data saved (8137 records). [2025-10-02T18:07:17.230003] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-02T18:07:17.230097] [INFO ] [MAIN ] Update Progress: 485/2370 symbols completed. CMSD took 32.0s. Estimated remaining: 4h 21m 16s. Rate: 7.2 symbols/min [2025-10-02T18:07:17.424477] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:07:17.481349] [DEBUG] [LOCAL ] CNC: Loaded 53739 existing records from primary storage. [2025-10-02T18:07:17.481726] [INFO ] [MAIN ] CNC: Loaded 53739 existing records. [2025-10-02T18:07:17.675491] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:07:17.675781] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-02T18:07:17.675846] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-02T18:07:17.677346] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-02T18:07:17.677439] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-02T18:07:17.874632] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-02T18:07:18.079190] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:07:18.476929] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T18:07:18.673056] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-02T18:07:19.169920] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T18:07:19.309293] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T18:07:19.473071] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-02T18:07:20.273075] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-10-02T18:07:20.797134] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T18:07:21.073038] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-02T18:07:21.872967] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-02T18:07:22.142521] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T18:07:22.372594] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T18:07:22.543234] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-02T18:07:22.673086] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-02T18:07:23.473133] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-02T18:07:23.735279] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T18:07:24.273017] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-02T18:07:24.861369] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T18:07:25.072983] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-02T18:07:25.348940] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T18:07:25.873042] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-02T18:07:26.017790] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-02T18:07:26.673045] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-02T18:07:27.330191] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T18:07:27.437315] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T18:07:27.473034] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-02T18:07:28.273046] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-02T18:07:28.924581] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T18:07:29.073037] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-02T18:07:29.848799] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T18:07:29.872989] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-02T18:07:30.054049] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T18:07:30.056142] [INFO ] [REMOTE ] CMTG: Full fetch complete (53590 records). [2025-10-02T18:07:30.056277] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-02T18:07:30.553053] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-10-02T18:07:30.553159] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-10-02T18:07:30.553898] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-10-02T18:07:30.553961] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-10-02T18:07:30.555240] [DEBUG] [LOCAL ] CMTG: Trimmed 53590 records to 37088 (keeping 200 days of data) [2025-10-02T18:07:30.673295] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-02T18:07:30.771587] [DEBUG] [LOCAL ] CMTG: Primary data saved (37088 records). [2025-10-02T18:07:30.771770] [INFO ] [MAIN ] CMTG: Full history saved. [2025-10-02T18:07:30.771877] [INFO ] [MAIN ] Update Progress: 486/2370 symbols completed. CMTG took 37.5s. Estimated remaining: 4h 21m 28s. Rate: 7.2 symbols/min [2025-10-02T18:07:30.960361] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:07:30.973131] [DEBUG] [LOCAL ] CNF: Loaded 10716 existing records from primary storage. [2025-10-02T18:07:30.973362] [INFO ] [MAIN ] CNF: Loaded 10716 existing records. [2025-10-02T18:07:31.171825] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:07:31.172180] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-02T18:07:31.172261] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-02T18:07:31.172805] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-02T18:07:31.172868] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-02T18:07:31.478189] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-02T18:07:31.609070] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:07:31.756523] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T18:07:31.990793] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-02T18:07:32.117874] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:07:32.273011] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-02T18:07:33.073095] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-02T18:07:33.560799] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T18:07:33.561700] [INFO ] [REMOTE ] CMU: Full fetch complete (9671 records). [2025-10-02T18:07:33.561819] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-02T18:07:33.878442] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-10-02T18:07:33.972942] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-10-02T18:07:33.973050] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-10-02T18:07:33.973378] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-10-02T18:07:33.973555] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-10-02T18:07:33.974193] [DEBUG] [LOCAL ] CMU: Trimmed 9671 records to 6891 (keeping 200 days of data) [2025-10-02T18:07:34.019475] [DEBUG] [LOCAL ] CMU: Primary data saved (6891 records). [2025-10-02T18:07:34.019736] [INFO ] [MAIN ] CMU: Full history saved. [2025-10-02T18:07:34.019890] [INFO ] [MAIN ] Update Progress: 487/2370 symbols completed. CMU took 38.5s. Estimated remaining: 4h 21m 0s. Rate: 7.2 symbols/min [2025-10-02T18:07:34.208231] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-10-02T18:07:34.253269] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:07:34.312469] [DEBUG] [LOCAL ] CNH: Loaded 53555 existing records from primary storage. [2025-10-02T18:07:34.312856] [INFO ] [MAIN ] CNH: Loaded 53555 existing records. [2025-10-02T18:07:34.519264] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:07:34.519492] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-02T18:07:34.519544] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-02T18:07:34.521290] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-10-02T18:07:34.521377] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-02T18:07:34.678145] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-02T18:07:34.952617] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:07:35.190253] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T18:07:35.473004] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-10-02T18:07:36.273038] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-10-02T18:07:36.580103] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T18:07:36.913624] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-10-02T18:07:37.073005] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-02T18:07:37.367409] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T18:07:37.488994] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-02T18:07:37.873009] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-02T18:07:38.308934] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-02T18:07:38.673051] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-10-02T18:07:39.473005] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-02T18:07:39.564165] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T18:07:39.565862] [INFO ] [REMOTE ] CNA: Full fetch complete (45557 records). [2025-10-02T18:07:39.566002] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-10-02T18:07:40.011375] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-10-02T18:07:40.011472] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-10-02T18:07:40.012130] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-10-02T18:07:40.012198] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-10-02T18:07:40.013608] [DEBUG] [LOCAL ] CNA: Trimmed 45557 records to 33010 (keeping 200 days of data) [2025-10-02T18:07:40.227435] [DEBUG] [LOCAL ] CNA: Primary data saved (33010 records). [2025-10-02T18:07:40.227583] [INFO ] [MAIN ] CNA: Full history saved. [2025-10-02T18:07:40.227691] [INFO ] [MAIN ] Update Progress: 488/2370 symbols completed. CNA took 31.4s. Estimated remaining: 4h 20m 44s. Rate: 7.2 symbols/min [2025-10-02T18:07:40.278118] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-02T18:07:40.424263] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:07:40.480572] [DEBUG] [LOCAL ] CNI: Loaded 51668 existing records from primary storage. [2025-10-02T18:07:40.480935] [INFO ] [MAIN ] CNI: Loaded 51668 existing records. [2025-10-02T18:07:40.676222] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:07:40.676453] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-02T18:07:40.676514] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-02T18:07:40.678289] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-02T18:07:40.678351] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-02T18:07:41.074781] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-02T18:07:41.090869] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:07:41.137789] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T18:07:41.212014] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T18:07:41.873014] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-02T18:07:42.673016] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-02T18:07:42.990029] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-02T18:07:43.255488] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T18:07:43.472997] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-02T18:07:43.580862] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T18:07:44.262789] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T18:07:44.272981] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-02T18:07:45.073000] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-10-02T18:07:45.872984] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-02T18:07:46.192946] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T18:07:46.672994] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-02T18:07:46.764747] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T18:07:46.974594] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T18:07:47.472997] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-02T18:07:48.147891] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-02T18:07:48.272960] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-02T18:07:48.604619] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T18:07:49.072977] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-02T18:07:49.272470] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T18:07:49.872993] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-02T18:07:50.673046] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-02T18:07:50.972701] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T18:07:51.473032] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-02T18:07:51.678862] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T18:07:51.872901] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T18:07:52.273024] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-02T18:07:53.039833] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T18:07:53.072987] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-02T18:07:53.872986] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-02T18:07:54.115843] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T18:07:54.672992] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-02T18:07:54.724018] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:07:55.473038] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-02T18:07:56.176927] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T18:07:56.178027] [INFO ] [REMOTE ] CNF: Full fetch complete (12940 records). [2025-10-02T18:07:56.178117] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-02T18:07:56.178693] [FATAL] [VALIDATOR ] CNF: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:07:56.178782] [FATAL] [MAIN ] CNF: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:07:56.178836] [WARN ] [MAIN ] CNF: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:07:56.178922] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-02T18:07:56.179016] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-10-02T18:07:56.179086] [INFO ] [LOCAL ] CNF: Starting deletion of derivative data. [2025-10-02T18:07:56.179593] [DEBUG] [LOCAL ] CNF: Deleted derivative data file. [2025-10-02T18:07:56.179739] [INFO ] [MAIN ] Update Progress: 489/2370 symbols completed. CNF took 25.4s. Estimated remaining: 4h 21m 5s. Rate: 7.2 symbols/min [2025-10-02T18:07:56.281859] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-02T18:07:56.379825] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:07:56.455664] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T18:07:56.505497] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-02T18:07:56.556578] [DEBUG] [LOCAL ] CNK: Loaded 52876 existing records from primary storage. [2025-10-02T18:07:56.556948] [INFO ] [MAIN ] CNK: Loaded 52876 existing records. [2025-10-02T18:07:56.752491] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:07:56.752743] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-02T18:07:56.752796] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-02T18:07:56.754365] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-02T18:07:56.754426] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-02T18:07:57.078135] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-02T18:07:57.146189] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:07:57.872975] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-02T18:07:58.433942] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-02T18:07:58.672968] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-02T18:07:58.740584] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T18:07:59.473053] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-02T18:08:00.000475] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T18:08:00.273057] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-02T18:08:00.587554] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T18:08:01.034504] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T18:08:01.073015] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-10-02T18:08:01.873013] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-02T18:08:02.631465] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-02T18:08:02.673024] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-02T18:08:02.948584] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T18:08:03.472986] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-02T18:08:03.734229] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-02T18:08:04.273088] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-02T18:08:04.594856] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-02T18:08:04.596994] [INFO ] [REMOTE ] CNC: Full fetch complete (77674 records). [2025-10-02T18:08:04.597110] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-02T18:08:05.051086] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-02T18:08:05.051188] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-02T18:08:05.052138] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-02T18:08:05.052242] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-02T18:08:05.053801] [DEBUG] [LOCAL ] CNC: Trimmed 77674 records to 54129 (keeping 200 days of data) [2025-10-02T18:08:05.114435] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-02T18:08:05.197326] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T18:08:05.437918] [DEBUG] [LOCAL ] CNC: Primary data saved (54129 records). [2025-10-02T18:08:05.438095] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-02T18:08:05.438220] [INFO ] [MAIN ] Update Progress: 490/2370 symbols completed. CNC took 48.2s. Estimated remaining: 4h 21m 0s. Rate: 7.2 symbols/min [2025-10-02T18:08:05.638748] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:05.689889] [DEBUG] [LOCAL ] CNM: Loaded 50990 existing records from primary storage. [2025-10-02T18:08:05.690255] [INFO ] [MAIN ] CNM: Loaded 50990 existing records. [2025-10-02T18:08:05.897151] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:08:05.889692] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-02T18:08:05.898610] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-02T18:08:05.898713] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-02T18:08:05.900178] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-02T18:08:05.900241] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-02T18:08:06.312819] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T18:08:06.369223] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:06.672994] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-10-02T18:08:06.985993] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T18:08:07.126046] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T18:08:07.473029] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-02T18:08:08.273011] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-02T18:08:08.665930] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-02T18:08:08.983802] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T18:08:08.985927] [INFO ] [REMOTE ] CNH: Full fetch complete (77534 records). [2025-10-02T18:08:08.986053] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-02T18:08:09.078213] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-02T18:08:09.443937] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-02T18:08:09.444098] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-02T18:08:09.445071] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-02T18:08:09.445150] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-02T18:08:09.446916] [DEBUG] [LOCAL ] CNH: Trimmed 77534 records to 53944 (keeping 200 days of data) [2025-10-02T18:08:09.805489] [DEBUG] [LOCAL ] CNH: Primary data saved (53944 records). [2025-10-02T18:08:09.805694] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-02T18:08:09.807005] [INFO ] [MAIN ] Update Progress: 491/2370 symbols completed. CNH took 35.8s. Estimated remaining: 4h 20m 37s. Rate: 7.2 symbols/min [2025-10-02T18:08:09.877411] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-02T18:08:10.004346] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:10.039930] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:08:10.079741] [DEBUG] [LOCAL ] CNMD: Loaded 32280 existing records from primary storage. [2025-10-02T18:08:10.080044] [INFO ] [MAIN ] CNMD: Loaded 32280 existing records. [2025-10-02T18:08:10.275367] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:08:10.275607] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-02T18:08:10.275687] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-02T18:08:10.276635] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-02T18:08:10.276743] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-02T18:08:10.670199] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:10.672955] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-10-02T18:08:10.853845] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T18:08:11.333505] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-02T18:08:11.472967] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-02T18:08:11.630464] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T18:08:12.273020] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-02T18:08:13.073021] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-02T18:08:13.145771] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T18:08:13.826702] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:08:13.873023] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-02T18:08:14.409160] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T18:08:14.673023] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-02T18:08:15.473053] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-02T18:08:15.628937] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T18:08:16.062928] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:08:16.273073] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-02T18:08:16.765577] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T18:08:16.767226] [INFO ] [REMOTE ] CNI: Full fetch complete (74244 records). [2025-10-02T18:08:16.767381] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-02T18:08:16.768508] [FATAL] [VALIDATOR ] CNI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:08:16.768632] [FATAL] [MAIN ] CNI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:08:16.768729] [WARN ] [MAIN ] CNI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:08:16.768812] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-02T18:08:16.768922] [DEBUG] [LOCAL ] CNI: No primary data file found to delete. [2025-10-02T18:08:16.769018] [INFO ] [LOCAL ] CNI: Starting deletion of derivative data. [2025-10-02T18:08:16.769304] [DEBUG] [LOCAL ] CNI: Deleted derivative data file. [2025-10-02T18:08:16.769415] [INFO ] [MAIN ] Update Progress: 492/2370 symbols completed. CNI took 36.5s. Estimated remaining: 4h 20m 23s. Rate: 7.2 symbols/min [2025-10-02T18:08:16.966713] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:17.004807] [DEBUG] [LOCAL ] CNNE: Loaded 36373 existing records from primary storage. [2025-10-02T18:08:17.005140] [INFO ] [MAIN ] CNNE: Loaded 36373 existing records. [2025-10-02T18:08:17.078106] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-02T18:08:17.214017] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:08:17.214241] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-02T18:08:17.214289] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-02T18:08:17.215403] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-10-02T18:08:17.215465] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-02T18:08:17.633715] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:17.857466] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T18:08:17.872955] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-02T18:08:18.673035] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-02T18:08:18.843906] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T18:08:19.213602] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:08:19.473055] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-02T18:08:19.638971] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T18:08:20.273055] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-02T18:08:21.072986] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-02T18:08:21.258348] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:08:21.872988] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-10-02T18:08:21.990493] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T18:08:22.298637] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T18:08:22.672991] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-02T18:08:23.086030] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T18:08:23.473109] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-02T18:08:24.252284] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T18:08:24.272995] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-02T18:08:24.564434] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T18:08:25.073009] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-02T18:08:25.641807] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T18:08:25.873019] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-02T18:08:26.573272] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T18:08:26.672968] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-02T18:08:26.774161] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T18:08:27.473001] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-02T18:08:28.272984] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-02T18:08:28.429165] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T18:08:28.912187] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:08:29.073040] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-02T18:08:29.873003] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-02T18:08:30.061463] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T18:08:30.444138] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:08:30.673029] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-02T18:08:31.473009] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-02T18:08:31.534242] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T18:08:31.610570] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-02T18:08:32.273003] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-02T18:08:32.546226] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T18:08:33.072995] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-02T18:08:33.708204] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T18:08:33.873009] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-02T18:08:34.651076] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T18:08:34.672959] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-02T18:08:35.210951] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T18:08:35.473011] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-02T18:08:36.273072] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-02T18:08:36.364829] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T18:08:36.366950] [INFO ] [REMOTE ] CNMD: Full fetch complete (47321 records). [2025-10-02T18:08:36.379468] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-02T18:08:36.407669] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T18:08:36.833784] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-10-02T18:08:36.833873] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-10-02T18:08:36.834561] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-10-02T18:08:36.834627] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-10-02T18:08:36.835748] [DEBUG] [LOCAL ] CNMD: Trimmed 47321 records to 32498 (keeping 200 days of data) [2025-10-02T18:08:37.051117] [DEBUG] [LOCAL ] CNMD: Primary data saved (32498 records). [2025-10-02T18:08:37.051305] [INFO ] [MAIN ] CNMD: Full history saved. [2025-10-02T18:08:37.052330] [INFO ] [MAIN ] Update Progress: 493/2370 symbols completed. CNMD took 27.2s. Estimated remaining: 4h 21m 0s. Rate: 7.2 symbols/min [2025-10-02T18:08:37.078175] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-02T18:08:37.245701] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:37.245909] [DEBUG] [LOCAL ] CNO: No existing data file found in primary storage. [2025-10-02T18:08:37.245967] [WARN ] [MAIN ] CNO: No existing data found, performing full refresh instead. [2025-10-02T18:08:37.246083] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-02T18:08:37.246129] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-02T18:08:37.246173] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-10-02T18:08:37.246208] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-02T18:08:37.630708] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-02T18:08:37.688274] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:37.873003] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-02T18:08:38.628759] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T18:08:38.631353] [INFO ] [REMOTE ] CNK: Full fetch complete (75806 records). [2025-10-02T18:08:38.631978] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-02T18:08:38.678994] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-10-02T18:08:39.188092] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-10-02T18:08:39.188509] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-10-02T18:08:39.189871] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-10-02T18:08:39.210452] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-10-02T18:08:39.213182] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:08:39.222161] [DEBUG] [LOCAL ] CNK: Trimmed 75806 records to 53264 (keeping 200 days of data) [2025-10-02T18:08:39.473699] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-02T18:08:39.586596] [DEBUG] [LOCAL ] CNK: Primary data saved (53264 records). [2025-10-02T18:08:39.586790] [INFO ] [MAIN ] CNK: Full history saved. [2025-10-02T18:08:39.586902] [INFO ] [MAIN ] Update Progress: 494/2370 symbols completed. CNK took 43.4s. Estimated remaining: 4h 20m 30s. Rate: 7.2 symbols/min [2025-10-02T18:08:39.771974] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:39.823950] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-10-02T18:08:39.824273] [INFO ] [MAIN ] CNP: Loaded 53469 existing records. [2025-10-02T18:08:40.019783] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:08:40.020189] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-02T18:08:40.020352] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-02T18:08:40.022268] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-02T18:08:40.022343] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-02T18:08:40.156289] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T18:08:40.279760] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-02T18:08:40.455288] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:41.046917] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T18:08:41.072986] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-02T18:08:41.325992] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T18:08:41.872996] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-02T18:08:42.622144] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T18:08:42.673006] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-02T18:08:43.472944] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T18:08:43.473071] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-10-02T18:08:44.113413] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T18:08:44.273006] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-02T18:08:44.956469] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T18:08:45.073003] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-02T18:08:45.187497] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T18:08:45.189709] [INFO ] [REMOTE ] CNNE: Full fetch complete (49873 records). [2025-10-02T18:08:45.189838] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-02T18:08:45.609261] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-10-02T18:08:45.609352] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-10-02T18:08:45.610052] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-10-02T18:08:45.610119] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-10-02T18:08:45.612714] [DEBUG] [LOCAL ] CNNE: Trimmed 49873 records to 36641 (keeping 200 days of data) [2025-10-02T18:08:45.850176] [DEBUG] [LOCAL ] CNNE: Primary data saved (36641 records). [2025-10-02T18:08:45.850349] [INFO ] [MAIN ] CNNE: Full history saved. [2025-10-02T18:08:45.850448] [INFO ] [MAIN ] Update Progress: 495/2370 symbols completed. CNNE took 29.1s. Estimated remaining: 4h 20m 14s. Rate: 7.2 symbols/min [2025-10-02T18:08:45.885190] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-02T18:08:46.041595] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:46.097157] [DEBUG] [LOCAL ] CNQ: Loaded 53581 existing records from primary storage. [2025-10-02T18:08:46.097507] [INFO ] [MAIN ] CNQ: Loaded 53581 existing records. [2025-10-02T18:08:46.292078] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:08:46.292400] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-02T18:08:46.292528] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-02T18:08:46.294432] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-10-02T18:08:46.294496] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-02T18:08:46.680092] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-02T18:08:46.693809] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:46.727085] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:08:47.412469] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-02T18:08:47.414581] [INFO ] [REMOTE ] CNM: Full fetch complete (73645 records). [2025-10-02T18:08:47.414733] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-02T18:08:47.482178] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-10-02T18:08:47.847330] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-10-02T18:08:47.847427] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-10-02T18:08:47.848381] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-10-02T18:08:47.848454] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-10-02T18:08:47.850054] [DEBUG] [LOCAL ] CNM: Trimmed 73645 records to 51367 (keeping 200 days of data) [2025-10-02T18:08:48.190251] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T18:08:48.215345] [DEBUG] [LOCAL ] CNM: Primary data saved (51367 records). [2025-10-02T18:08:48.215507] [INFO ] [MAIN ] CNM: Full history saved. [2025-10-02T18:08:48.215597] [INFO ] [MAIN ] Update Progress: 496/2370 symbols completed. CNM took 42.8s. Estimated remaining: 4h 19m 43s. Rate: 7.2 symbols/min [2025-10-02T18:08:48.282567] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-02T18:08:48.405256] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:48.405457] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-02T18:08:48.405552] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-02T18:08:48.405701] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-02T18:08:48.405755] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-02T18:08:48.405798] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-02T18:08:48.405832] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-02T18:08:48.810881] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:49.073005] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-10-02T18:08:49.282495] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:08:49.282891] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-10-02T18:08:49.282978] [FATAL] [REMOTE ] CNR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:08:49.283048] [FATAL] [MAIN ] CNR: Failed to fetch primary data. [2025-10-02T18:08:49.283116] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:08:49.283189] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-02T18:08:49.283252] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-02T18:08:49.283287] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-02T18:08:49.283327] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-02T18:08:49.283390] [INFO ] [MAIN ] Update Progress: 497/2370 symbols completed. CNR took 1.1s. Estimated remaining: 4h 19m 7s. Rate: 7.2 symbols/min [2025-10-02T18:08:49.505209] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T18:08:49.503499] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:08:49.548704] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T18:08:49.577023] [DEBUG] [LOCAL ] CNS: Loaded 20584 existing records from primary storage. [2025-10-02T18:08:49.577306] [INFO ] [MAIN ] CNS: Loaded 20584 existing records. [2025-10-02T18:08:49.765637] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:08:49.765887] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-02T18:08:49.765937] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-02T18:08:49.766692] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-02T18:08:49.766755] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-02T18:08:49.882012] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-02T18:08:50.173863] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:08:50.673034] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-10-02T18:08:51.472976] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-02T18:08:51.619015] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T18:08:51.757632] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T18:08:52.273038] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-02T18:08:53.072970] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-02T18:08:53.263696] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T18:08:53.542746] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T18:08:53.872987] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-02T18:08:54.071385] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T18:08:54.673052] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-02T18:08:54.914661] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T18:08:55.472983] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-02T18:08:56.273054] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-02T18:08:56.489359] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T18:08:57.046166] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T18:08:57.072967] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-02T18:08:57.266350] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T18:08:57.873028] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-02T18:08:58.605000] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T18:08:58.673024] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-02T18:08:59.473015] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-02T18:08:59.713245] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T18:08:59.741786] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T18:09:00.273024] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-02T18:09:00.902158] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T18:09:01.073058] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-02T18:09:01.873019] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-02T18:09:02.381796] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-02T18:09:02.518856] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T18:09:02.673040] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-02T18:09:03.414097] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T18:09:03.473048] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-02T18:09:04.272972] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-02T18:09:04.377298] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T18:09:05.073055] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-02T18:09:05.873010] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-02T18:09:06.141218] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T18:09:06.214746] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T18:09:06.673034] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-02T18:09:07.473045] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-02T18:09:07.645900] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T18:09:07.821958] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (4.35 seconds). [2025-10-02T18:09:08.241309] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T18:09:08.273006] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-02T18:09:08.684780] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T18:09:08.686941] [INFO ] [REMOTE ] CNO: Full fetch complete (60636 records). [2025-10-02T18:09:08.687075] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-02T18:09:09.074783] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-02T18:09:09.146018] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-02T18:09:09.149348] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T18:09:09.148739] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-02T18:09:09.154922] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-02T18:09:09.155391] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-02T18:09:09.156704] [DEBUG] [LOCAL ] CNO: Trimmed 60636 records to 41454 (keeping 200 days of data) [2025-10-02T18:09:09.441828] [DEBUG] [LOCAL ] CNO: Primary data saved (41454 records). [2025-10-02T18:09:09.441958] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-02T18:09:09.442061] [INFO ] [MAIN ] Update Progress: 498/2370 symbols completed. CNO took 32.4s. Estimated remaining: 4h 19m 44s. Rate: 7.2 symbols/min [2025-10-02T18:09:09.638275] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:09:09.689735] [DEBUG] [LOCAL ] CNX: Loaded 51372 existing records from primary storage. [2025-10-02T18:09:09.690128] [INFO ] [MAIN ] CNX: Loaded 51372 existing records. [2025-10-02T18:09:09.878163] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-02T18:09:09.965581] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:09:09.966249] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-02T18:09:09.966314] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-02T18:09:09.968014] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-02T18:09:09.968081] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-02T18:09:10.366222] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:09:10.562176] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T18:09:10.673004] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-10-02T18:09:11.472981] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-02T18:09:11.946809] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-02T18:09:12.272965] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-02T18:09:12.466891] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T18:09:12.671429] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T18:09:13.073025] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-02T18:09:13.872979] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-02T18:09:14.174991] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T18:09:14.673023] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-02T18:09:15.473031] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-02T18:09:15.549464] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T18:09:16.110222] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (3.84 seconds). [2025-10-02T18:09:16.273025] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-02T18:09:16.553732] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-02T18:09:16.621806] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T18:09:17.073038] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-02T18:09:17.872989] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-02T18:09:17.929125] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T18:09:17.930462] [INFO ] [REMOTE ] CNS: Full fetch complete (30197 records). [2025-10-02T18:09:17.930541] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-02T18:09:18.384857] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-10-02T18:09:18.385155] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-10-02T18:09:18.386128] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-10-02T18:09:18.387505] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T18:09:18.387693] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-10-02T18:09:18.399960] [DEBUG] [LOCAL ] CNS: Trimmed 30197 records to 20779 (keeping 200 days of data) [2025-10-02T18:09:18.530199] [DEBUG] [LOCAL ] CNS: Primary data saved (20779 records). [2025-10-02T18:09:18.530322] [INFO ] [MAIN ] CNS: Full history saved. [2025-10-02T18:09:18.530407] [INFO ] [MAIN ] Update Progress: 499/2370 symbols completed. CNS took 29.2s. Estimated remaining: 4h 19m 38s. Rate: 7.2 symbols/min [2025-10-02T18:09:18.678105] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-02T18:09:18.727529] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:09:18.767104] [DEBUG] [LOCAL ] CODI: Loaded 40010 existing records from primary storage. [2025-10-02T18:09:18.767399] [INFO ] [MAIN ] CODI: Loaded 40010 existing records. [2025-10-02T18:09:18.965977] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:09:18.966212] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-02T18:09:18.966261] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-02T18:09:18.967415] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-02T18:09:18.967512] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-02T18:09:19.373159] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:09:19.472985] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-02T18:09:19.558468] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T18:09:20.253900] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T18:09:20.272966] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-02T18:09:20.949735] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T18:09:20.951897] [INFO ] [REMOTE ] CNQ: Full fetch complete (77553 records). [2025-10-02T18:09:20.952017] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-02T18:09:21.079287] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-02T18:09:21.410229] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-02T18:09:21.410320] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-02T18:09:21.411223] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-02T18:09:21.411291] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-02T18:09:21.413246] [DEBUG] [LOCAL ] CNQ: Trimmed 77553 records to 53970 (keeping 200 days of data) [2025-10-02T18:09:21.777717] [DEBUG] [LOCAL ] CNQ: Primary data saved (53970 records). [2025-10-02T18:09:21.777935] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-02T18:09:21.778097] [INFO ] [MAIN ] Update Progress: 500/2370 symbols completed. CNQ took 35.9s. Estimated remaining: 4h 19m 11s. Rate: 7.2 symbols/min [2025-10-02T18:09:21.880279] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-10-02T18:09:21.972029] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:09:22.039388] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:09:22.068456] [DEBUG] [LOCAL ] COF: Loaded 53609 existing records from primary storage. [2025-10-02T18:09:22.068808] [INFO ] [MAIN ] COF: Loaded 53609 existing records. [2025-10-02T18:09:22.262843] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:09:22.263094] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-02T18:09:22.263163] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-02T18:09:22.265036] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-02T18:09:22.265101] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-02T18:09:22.680385] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:09:22.676994] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-02T18:09:22.681128] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T18:09:22.684543] [INFO ] [REMOTE ] CNP: Full fetch complete (77370 records). [2025-10-02T18:09:22.684697] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-02T18:09:23.108567] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-02T18:09:23.108719] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-02T18:09:23.109597] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-02T18:09:23.109767] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-02T18:09:23.111717] [DEBUG] [LOCAL ] CNP: Trimmed 77370 records to 53859 (keeping 200 days of data) [2025-10-02T18:09:23.254323] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T18:09:23.473059] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-02T18:09:23.482463] [DEBUG] [LOCAL ] CNP: Primary data saved (53859 records). [2025-10-02T18:09:23.482564] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-02T18:09:23.482676] [INFO ] [MAIN ] Update Progress: 501/2370 symbols completed. CNP took 43.9s. Estimated remaining: 4h 18m 38s. Rate: 7.2 symbols/min [2025-10-02T18:09:23.668984] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:09:23.669190] [DEBUG] [LOCAL ] COHR: No existing data file found in primary storage. [2025-10-02T18:09:23.669237] [WARN ] [MAIN ] COHR: No existing data found, performing full refresh instead. [2025-10-02T18:09:23.669371] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-02T18:09:23.669418] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-02T18:09:23.669462] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-02T18:09:23.669497] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-02T18:09:24.073088] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:09:24.273041] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-10-02T18:09:24.779372] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-02T18:09:24.920533] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:09:25.072993] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-02T18:09:25.872992] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-02T18:09:26.192759] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T18:09:26.683094] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-02T18:09:26.705473] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T18:09:26.907156] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T18:09:27.473039] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-10-02T18:09:28.273026] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-02T18:09:28.590330] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-10-02T18:09:29.073033] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-02T18:09:29.552356] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-02T18:09:29.843671] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T18:09:29.872972] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-02T18:09:30.025388] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T18:09:30.673006] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-02T18:09:31.202916] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T18:09:31.473055] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-02T18:09:32.170301] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:09:32.273014] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-02T18:09:33.072978] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-02T18:09:33.243060] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T18:09:33.872981] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-02T18:09:34.025435] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T18:09:34.673045] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-02T18:09:34.905435] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T18:09:35.472977] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-02T18:09:35.861043] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-02T18:09:36.210198] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T18:09:36.273031] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-02T18:09:37.072977] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-02T18:09:37.105195] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T18:09:37.872999] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-02T18:09:38.351238] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-02T18:09:38.678452] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-02T18:09:38.684122] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-02T18:09:39.472996] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-02T18:09:39.620495] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T18:09:40.272999] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-02T18:09:40.754010] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T18:09:40.755906] [INFO ] [REMOTE ] CNX: Full fetch complete (74373 records). [2025-10-02T18:09:40.756087] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-02T18:09:40.757281] [FATAL] [VALIDATOR ] CNX: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:09:40.757398] [FATAL] [MAIN ] CNX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:09:40.757444] [WARN ] [MAIN ] CNX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:09:40.757519] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-02T18:09:40.757618] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-10-02T18:09:40.757715] [INFO ] [LOCAL ] CNX: Starting deletion of derivative data. [2025-10-02T18:09:40.758097] [DEBUG] [LOCAL ] CNX: Deleted derivative data file. [2025-10-02T18:09:40.758882] [INFO ] [MAIN ] Update Progress: 502/2370 symbols completed. CNX took 31.3s. Estimated remaining: 4h 19m 3s. Rate: 7.2 symbols/min [2025-10-02T18:09:40.948896] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:09:41.011711] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-10-02T18:09:41.041177] [DEBUG] [LOCAL ] COLD: Loaded 52075 existing records from primary storage. [2025-10-02T18:09:41.041561] [INFO ] [MAIN ] COLD: Loaded 52075 existing records. [2025-10-02T18:09:41.078129] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-02T18:09:41.242308] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:09:41.242574] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-02T18:09:41.242628] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-02T18:09:41.244396] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-02T18:09:41.244471] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-02T18:09:41.648356] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:09:41.872997] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-02T18:09:42.268501] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T18:09:42.402537] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-02T18:09:42.673006] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-02T18:09:43.472973] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-02T18:09:43.863277] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T18:09:44.157228] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T18:09:44.272997] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-10-02T18:09:45.072971] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-02T18:09:45.545069] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-02T18:09:45.872970] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-02T18:09:46.018766] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T18:09:46.245858] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:09:46.247483] [INFO ] [REMOTE ] CODI: Full fetch complete (50992 records). [2025-10-02T18:09:46.247568] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-02T18:09:46.662629] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-10-02T18:09:46.662751] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-10-02T18:09:46.663451] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-10-02T18:09:46.663512] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-10-02T18:09:46.664737] [DEBUG] [LOCAL ] CODI: Trimmed 50992 records to 40283 (keeping 200 days of data) [2025-10-02T18:09:46.713481] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-02T18:09:46.900212] [DEBUG] [LOCAL ] CODI: Primary data saved (40283 records). [2025-10-02T18:09:46.900341] [INFO ] [MAIN ] CODI: Full history saved. [2025-10-02T18:09:46.900420] [INFO ] [MAIN ] Update Progress: 503/2370 symbols completed. CODI took 28.4s. Estimated remaining: 4h 18m 46s. Rate: 7.2 symbols/min [2025-10-02T18:09:47.089423] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:09:47.140667] [DEBUG] [LOCAL ] COMP: Loaded 53389 existing records from primary storage. [2025-10-02T18:09:47.141063] [INFO ] [MAIN ] COMP: Loaded 53389 existing records. [2025-10-02T18:09:47.333133] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:09:47.333346] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-02T18:09:47.333397] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-02T18:09:47.334854] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-02T18:09:47.334915] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-02T18:09:47.488902] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-02T18:09:47.734054] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:09:47.949377] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-02T18:09:48.137374] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T18:09:48.273042] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-10-02T18:09:49.073039] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-02T18:09:49.674968] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-02T18:09:49.873020] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-02T18:09:49.967463] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T18:09:50.672995] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-02T18:09:50.734998] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T18:09:51.473010] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-02T18:09:51.571898] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T18:09:52.272990] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-02T18:09:52.466845] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:09:53.072978] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-02T18:09:53.529947] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T18:09:53.872985] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-02T18:09:54.061936] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T18:09:54.673070] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-02T18:09:55.127210] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-02T18:09:55.473015] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-02T18:09:55.742165] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T18:09:56.060895] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-02T18:09:56.273022] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-02T18:09:57.073004] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-02T18:09:57.139243] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T18:09:57.798728] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T18:09:57.872999] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-02T18:09:58.673018] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-02T18:09:59.263339] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T18:09:59.417864] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-02T18:09:59.420021] [INFO ] [REMOTE ] COF: Full fetch complete (77417 records). [2025-10-02T18:09:59.420160] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-02T18:09:59.481519] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-02T18:09:59.849317] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-02T18:09:59.849443] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-02T18:09:59.850330] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-02T18:09:59.850423] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-02T18:09:59.852025] [DEBUG] [LOCAL ] COF: Trimmed 77417 records to 53999 (keeping 200 days of data) [2025-10-02T18:10:00.228368] [DEBUG] [LOCAL ] COF: Primary data saved (53999 records). [2025-10-02T18:10:00.228521] [INFO ] [MAIN ] COF: Full history saved. [2025-10-02T18:10:00.228666] [INFO ] [MAIN ] Update Progress: 504/2370 symbols completed. COF took 38.5s. Estimated remaining: 4h 18m 57s. Rate: 7.2 symbols/min [2025-10-02T18:10:00.278072] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-02T18:10:00.440847] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:00.441064] [DEBUG] [LOCAL ] CON: No existing data file found in primary storage. [2025-10-02T18:10:00.441171] [WARN ] [MAIN ] CON: No existing data found, performing full refresh instead. [2025-10-02T18:10:00.441357] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-02T18:10:00.441542] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-02T18:10:00.441615] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-02T18:10:00.441709] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-02T18:10:00.798801] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-02T18:10:00.897403] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:01.073010] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-10-02T18:10:01.227182] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-02T18:10:01.229127] [INFO ] [REMOTE ] COHR: Full fetch complete (76740 records). [2025-10-02T18:10:01.229344] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-02T18:10:01.230378] [FATAL] [VALIDATOR ] COHR: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:10:01.230519] [FATAL] [MAIN ] COHR: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:10:01.230607] [WARN ] [MAIN ] COHR: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:10:01.230730] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-02T18:10:01.230809] [DEBUG] [LOCAL ] COHR: No primary data file found to delete. [2025-10-02T18:10:01.230847] [INFO ] [LOCAL ] COHR: Starting deletion of derivative data. [2025-10-02T18:10:01.230889] [DEBUG] [LOCAL ] COHR: No derivative data file found to delete. [2025-10-02T18:10:01.230968] [INFO ] [MAIN ] Update Progress: 505/2370 symbols completed. COHR took 37.7s. Estimated remaining: 4h 18m 21s. Rate: 7.2 symbols/min [2025-10-02T18:10:01.421974] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:01.447675] [DEBUG] [LOCAL ] COOK: Loaded 24333 existing records from primary storage. [2025-10-02T18:10:01.448027] [INFO ] [MAIN ] COOK: Loaded 24333 existing records. [2025-10-02T18:10:01.642715] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:10:01.643020] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-02T18:10:01.643080] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-02T18:10:01.643977] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-10-02T18:10:01.644040] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-02T18:10:01.877685] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-02T18:10:02.095874] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:02.132040] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T18:10:02.672978] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-02T18:10:02.795298] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T18:10:03.459945] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T18:10:03.472952] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-02T18:10:04.273011] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-02T18:10:04.515723] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T18:10:04.819769] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T18:10:05.073010] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-10-02T18:10:05.873022] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-02T18:10:06.247700] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-02T18:10:06.510482] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T18:10:06.672979] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-02T18:10:07.473034] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-02T18:10:07.702053] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T18:10:08.089739] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T18:10:08.273050] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-02T18:10:09.072995] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-02T18:10:09.276126] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T18:10:09.306406] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T18:10:09.873016] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-02T18:10:10.673019] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-02T18:10:11.063384] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T18:10:11.259013] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T18:10:11.354063] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T18:10:11.473051] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-02T18:10:12.273018] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-02T18:10:12.593718] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T18:10:13.073047] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-02T18:10:13.873181] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-02T18:10:13.999902] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T18:10:14.113662] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-02T18:10:14.673078] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-02T18:10:15.473043] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-02T18:10:15.803952] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T18:10:16.113378] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T18:10:16.273000] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-02T18:10:16.322713] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T18:10:17.073007] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-02T18:10:17.878110] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-02T18:10:17.895797] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T18:10:18.176541] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T18:10:18.673016] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-02T18:10:19.330574] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T18:10:19.472994] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-02T18:10:19.724901] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T18:10:20.273048] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-02T18:10:21.073001] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-02T18:10:21.132889] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T18:10:21.137446] [INFO ] [REMOTE ] COMP: Full fetch complete (76781 records). [2025-10-02T18:10:21.137667] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-02T18:10:21.138792] [FATAL] [VALIDATOR ] COMP: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:10:21.138887] [FATAL] [MAIN ] COMP: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:10:21.138934] [WARN ] [MAIN ] COMP: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:10:21.138978] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-02T18:10:21.139052] [DEBUG] [LOCAL ] COMP: No primary data file found to delete. [2025-10-02T18:10:21.139109] [INFO ] [LOCAL ] COMP: Starting deletion of derivative data. [2025-10-02T18:10:21.139506] [DEBUG] [LOCAL ] COMP: Deleted derivative data file. [2025-10-02T18:10:21.139678] [INFO ] [MAIN ] Update Progress: 506/2370 symbols completed. COMP took 34.2s. Estimated remaining: 4h 18m 56s. Rate: 7.2 symbols/min [2025-10-02T18:10:21.324913] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:21.382720] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-10-02T18:10:21.383119] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-10-02T18:10:21.581826] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:10:21.582081] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-02T18:10:21.582140] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-02T18:10:21.583668] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-10-02T18:10:21.583744] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-02T18:10:21.879183] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-02T18:10:21.994795] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:22.197383] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T18:10:22.556119] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T18:10:22.664800] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T18:10:22.672957] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-02T18:10:23.473019] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-02T18:10:24.198573] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T18:10:24.273017] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-02T18:10:25.073030] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-10-02T18:10:25.279837] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T18:10:25.381390] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T18:10:25.873005] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-02T18:10:26.673053] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-02T18:10:27.114752] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T18:10:27.183424] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-02T18:10:27.472994] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-02T18:10:27.741699] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:10:27.743466] [INFO ] [REMOTE ] CON: Full fetch complete (56884 records). [2025-10-02T18:10:27.743561] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-02T18:10:28.165968] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-10-02T18:10:28.166059] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-10-02T18:10:28.166792] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-10-02T18:10:28.166859] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-10-02T18:10:28.168234] [DEBUG] [LOCAL ] CON: Trimmed 56884 records to 39102 (keeping 200 days of data) [2025-10-02T18:10:28.273299] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-02T18:10:28.426181] [DEBUG] [LOCAL ] CON: Primary data saved (39102 records). [2025-10-02T18:10:28.426339] [INFO ] [MAIN ] CON: Full history saved. [2025-10-02T18:10:28.426455] [INFO ] [MAIN ] Update Progress: 507/2370 symbols completed. CON took 28.2s. Estimated remaining: 4h 18m 44s. Rate: 7.2 symbols/min [2025-10-02T18:10:28.478392] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T18:10:28.516615] [INFO ] [REMOTE ] COOK: Full fetch complete (32509 records). [2025-10-02T18:10:28.547372] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-02T18:10:28.760335] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:29.075732] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-02T18:10:29.073633] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-02T18:10:29.075920] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-02T18:10:29.076849] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-02T18:10:29.077741] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-02T18:10:29.078633] [DEBUG] [LOCAL ] COOK: Trimmed 32509 records to 24479 (keeping 200 days of data) [2025-10-02T18:10:29.184844] [DEBUG] [LOCAL ] COR: Loaded 47080 existing records from primary storage. [2025-10-02T18:10:29.186805] [INFO ] [MAIN ] COR: Loaded 47080 existing records. [2025-10-02T18:10:29.435306] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:10:29.436060] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-02T18:10:29.436628] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-02T18:10:29.438869] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-02T18:10:29.439768] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-02T18:10:29.806004] [DEBUG] [LOCAL ] COOK: Primary data saved (24479 records). [2025-10-02T18:10:29.811856] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-02T18:10:29.822299] [INFO ] [MAIN ] Update Progress: 508/2370 symbols completed. COOK took 28.6s. Estimated remaining: 4h 18m 10s. Rate: 7.2 symbols/min [2025-10-02T18:10:29.984225] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:30.012589] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-10-02T18:10:30.094467] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:30.127887] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T18:10:30.184603] [DEBUG] [LOCAL ] COTY: Loaded 53229 existing records from primary storage. [2025-10-02T18:10:30.184994] [INFO ] [MAIN ] COTY: Loaded 53229 existing records. [2025-10-02T18:10:30.374815] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:10:30.375052] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-02T18:10:30.375103] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-02T18:10:30.376465] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-02T18:10:30.376528] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-02T18:10:30.684219] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-02T18:10:30.772925] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:30.951847] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T18:10:31.472988] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-02T18:10:31.700132] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T18:10:32.175536] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T18:10:32.273048] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-02T18:10:33.073005] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-02T18:10:33.175181] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T18:10:33.177356] [INFO ] [REMOTE ] COLD: Full fetch complete (74283 records). [2025-10-02T18:10:33.177476] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-02T18:10:33.624467] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-10-02T18:10:33.624677] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-10-02T18:10:33.625631] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-10-02T18:10:33.625752] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-10-02T18:10:33.627379] [DEBUG] [LOCAL ] COLD: Trimmed 74283 records to 52465 (keeping 200 days of data) [2025-10-02T18:10:33.874737] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-10-02T18:10:33.944364] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T18:10:34.044556] [DEBUG] [LOCAL ] COLD: Primary data saved (52465 records). [2025-10-02T18:10:34.044733] [INFO ] [MAIN ] COLD: Full history saved. [2025-10-02T18:10:34.045546] [INFO ] [MAIN ] Update Progress: 509/2370 symbols completed. COLD took 53.3s. Estimated remaining: 4h 17m 47s. Rate: 7.2 symbols/min [2025-10-02T18:10:34.241486] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:34.290813] [DEBUG] [LOCAL ] COUR: Loaded 48918 existing records from primary storage. [2025-10-02T18:10:34.291162] [INFO ] [MAIN ] COUR: Loaded 48918 existing records. [2025-10-02T18:10:34.488292] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:10:34.488515] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-02T18:10:34.488567] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-02T18:10:34.489913] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-02T18:10:34.489978] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-02T18:10:34.686721] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-02T18:10:34.916616] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:34.947156] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T18:10:35.473013] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-10-02T18:10:35.601257] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T18:10:36.272965] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-02T18:10:36.834192] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-02T18:10:37.072976] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-02T18:10:37.484263] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-02T18:10:37.872998] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-02T18:10:38.006904] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T18:10:38.673017] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-02T18:10:39.197932] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-02T18:10:39.245971] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T18:10:39.473041] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-02T18:10:40.272984] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-02T18:10:40.399719] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T18:10:40.991109] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T18:10:41.073004] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-02T18:10:41.783565] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T18:10:41.872997] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-02T18:10:42.672997] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-02T18:10:42.807107] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:10:43.472970] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-02T18:10:43.667132] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T18:10:44.273001] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-02T18:10:44.441949] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:10:45.073072] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-02T18:10:45.369432] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T18:10:45.874136] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-02T18:10:45.877122] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T18:10:46.673004] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-02T18:10:46.798328] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T18:10:47.473013] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-02T18:10:47.871673] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-02T18:10:48.273006] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-02T18:10:48.605806] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T18:10:49.073010] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-02T18:10:49.363730] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T18:10:49.873014] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-02T18:10:50.104818] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T18:10:50.303185] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T18:10:50.673019] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-02T18:10:51.473024] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-02T18:10:51.546164] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T18:10:52.272985] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-02T18:10:52.353331] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T18:10:53.073003] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-02T18:10:53.202854] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T18:10:53.873030] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-02T18:10:53.983545] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T18:10:54.672973] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-02T18:10:54.752692] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T18:10:55.081490] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T18:10:55.473047] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-02T18:10:56.220229] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:10:56.273000] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-02T18:10:57.077102] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-02T18:10:57.079037] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-02T18:10:57.081510] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-10-02T18:10:57.081769] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-02T18:10:57.526667] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-10-02T18:10:57.526772] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-10-02T18:10:57.527751] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-10-02T18:10:57.527821] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-10-02T18:10:57.529483] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 54117 (keeping 200 days of data) [2025-10-02T18:10:57.873019] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-02T18:10:57.894621] [DEBUG] [LOCAL ] COP: Primary data saved (54117 records). [2025-10-02T18:10:57.894821] [INFO ] [MAIN ] COP: Full history saved. [2025-10-02T18:10:57.894935] [INFO ] [MAIN ] Update Progress: 510/2370 symbols completed. COP took 36.8s. Estimated remaining: 4h 18m 35s. Rate: 7.2 symbols/min [2025-10-02T18:10:58.100079] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:10:58.135374] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T18:10:58.197857] [DEBUG] [LOCAL ] CP: Loaded 53267 existing records from primary storage. [2025-10-02T18:10:58.198373] [INFO ] [MAIN ] CP: Loaded 53267 existing records. [2025-10-02T18:10:58.403219] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:10:58.403719] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-02T18:10:58.404049] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-02T18:10:58.406429] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-10-02T18:10:58.406494] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-02T18:10:58.680254] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-02T18:10:58.825143] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:10:58.857664] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T18:10:59.473000] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-10-02T18:11:00.002787] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T18:11:00.176247] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T18:11:00.273046] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-02T18:11:01.073004] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-02T18:11:01.112175] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T18:11:01.872999] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-02T18:11:02.014492] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T18:11:02.506925] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T18:11:02.673004] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-02T18:11:03.473021] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-02T18:11:03.643734] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T18:11:04.273062] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-02T18:11:04.340150] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T18:11:04.342222] [INFO ] [REMOTE ] COTY: Full fetch complete (77091 records). [2025-10-02T18:11:04.342385] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-02T18:11:04.816233] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-02T18:11:04.816352] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-02T18:11:04.817299] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-02T18:11:04.817387] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-02T18:11:04.819228] [DEBUG] [LOCAL ] COTY: Trimmed 77091 records to 53616 (keeping 200 days of data) [2025-10-02T18:11:05.029708] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T18:11:05.044504] [INFO ] [REMOTE ] COUR: Full fetch complete (70846 records). [2025-10-02T18:11:05.057562] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-02T18:11:05.073843] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-02T18:11:05.366779] [DEBUG] [LOCAL ] COTY: Primary data saved (53616 records). [2025-10-02T18:11:05.386288] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-02T18:11:05.433065] [INFO ] [MAIN ] Update Progress: 511/2370 symbols completed. COTY took 35.6s. Estimated remaining: 4h 18m 24s. Rate: 7.2 symbols/min [2025-10-02T18:11:05.770620] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-10-02T18:11:05.784363] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-10-02T18:11:05.820376] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:11:05.821432] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-10-02T18:11:05.821807] [DEBUG] [LOCAL ] CPA: No existing data file found in primary storage. [2025-10-02T18:11:05.821940] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-10-02T18:11:05.821895] [WARN ] [MAIN ] CPA: No existing data found, performing full refresh instead. [2025-10-02T18:11:05.822533] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-02T18:11:05.822611] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-02T18:11:05.823028] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-02T18:11:05.823137] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-02T18:11:05.893068] [DEBUG] [LOCAL ] COUR: Trimmed 70846 records to 49263 (keeping 200 days of data) [2025-10-02T18:11:06.472140] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:11:06.475155] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-02T18:11:06.475757] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-10-02T18:11:06.677208] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-02T18:11:06.719857] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T18:11:06.841893] [DEBUG] [LOCAL ] COUR: Primary data saved (49263 records). [2025-10-02T18:11:06.842135] [INFO ] [MAIN ] COUR: Full history saved. [2025-10-02T18:11:06.843121] [INFO ] [MAIN ] Update Progress: 512/2370 symbols completed. COUR took 32.8s. Estimated remaining: 4h 17m 50s. Rate: 7.2 symbols/min [2025-10-02T18:11:07.123177] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:11:07.123433] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-02T18:11:07.123508] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-02T18:11:07.123669] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-02T18:11:07.123735] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-02T18:11:07.123788] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-02T18:11:07.123834] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-02T18:11:07.477142] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-02T18:11:07.643766] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:11:07.664471] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T18:11:08.178923] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T18:11:08.272976] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-02T18:11:08.973517] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:11:08.976176] [INFO ] [REMOTE ] COR: Full fetch complete (68772 records). [2025-10-02T18:11:08.976373] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-02T18:11:09.078180] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-02T18:11:09.418956] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-10-02T18:11:09.419045] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-10-02T18:11:09.419887] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-10-02T18:11:09.419953] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-10-02T18:11:09.421444] [DEBUG] [LOCAL ] COR: Trimmed 68772 records to 47382 (keeping 200 days of data) [2025-10-02T18:11:09.683182] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T18:11:09.765382] [DEBUG] [LOCAL ] COR: Primary data saved (47382 records). [2025-10-02T18:11:09.765523] [INFO ] [MAIN ] COR: Full history saved. [2025-10-02T18:11:09.765606] [INFO ] [MAIN ] Update Progress: 513/2370 symbols completed. COR took 41.3s. Estimated remaining: 4h 17m 22s. Rate: 7.2 symbols/min [2025-10-02T18:11:09.877367] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-10-02T18:11:09.955096] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:11:09.987158] [DEBUG] [LOCAL ] CPAY: Loaded 30628 existing records from primary storage. [2025-10-02T18:11:09.987463] [INFO ] [MAIN ] CPAY: Loaded 30628 existing records. [2025-10-02T18:11:10.185860] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:11:10.186120] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-02T18:11:10.186171] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-02T18:11:10.187201] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-02T18:11:10.187265] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-02T18:11:10.522803] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T18:11:10.612522] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:11:10.673029] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-02T18:11:10.902024] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T18:11:11.473035] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-02T18:11:11.949038] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T18:11:12.273008] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-02T18:11:13.073009] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-02T18:11:13.360772] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-10-02T18:11:13.364164] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T18:11:13.750579] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T18:11:13.873015] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-02T18:11:14.673018] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-10-02T18:11:15.238812] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T18:11:15.473005] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-02T18:11:15.856153] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-02T18:11:16.197376] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T18:11:16.273037] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-02T18:11:17.073024] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-02T18:11:17.873032] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-02T18:11:18.062974] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T18:11:18.203614] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T18:11:18.673011] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-02T18:11:19.248810] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T18:11:19.472964] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-02T18:11:19.556680] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T18:11:20.273019] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-02T18:11:20.642101] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-02T18:11:20.888685] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T18:11:21.073054] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-02T18:11:21.435022] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-02T18:11:21.872995] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-02T18:11:22.243544] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-02T18:11:22.673023] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-02T18:11:23.053111] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-02T18:11:23.473001] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-02T18:11:23.901789] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-02T18:11:24.273036] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-02T18:11:24.613033] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-02T18:11:25.072998] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-02T18:11:25.873009] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-02T18:11:26.310637] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T18:11:26.673046] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-02T18:11:27.473017] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-02T18:11:27.700603] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T18:11:27.955636] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-02T18:11:27.957284] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T18:11:28.272996] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-02T18:11:29.072999] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-02T18:11:29.532508] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T18:11:29.533450] [INFO ] [REMOTE ] CPAC: Full fetch complete (1875 records). [2025-10-02T18:11:29.533525] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-02T18:11:29.737406] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T18:11:29.737833] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:11:29.738102] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:11:29.738211] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-02T18:11:29.738451] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-02T18:11:29.738564] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-02T18:11:29.738714] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-02T18:11:29.738797] [INFO ] [MAIN ] Update Progress: 514/2370 symbols completed. CPAC took 22.9s. Estimated remaining: 4h 17m 56s. Rate: 7.2 symbols/min [2025-10-02T18:11:29.874607] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-02T18:11:29.924074] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:11:29.960392] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:11:29.985926] [DEBUG] [LOCAL ] CPF: Loaded 15158 existing records from primary storage. [2025-10-02T18:11:29.986186] [INFO ] [MAIN ] CPF: Loaded 15158 existing records. [2025-10-02T18:11:30.168398] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:11:30.168664] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-02T18:11:30.168728] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-02T18:11:30.169261] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-02T18:11:30.169323] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-02T18:11:30.554100] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:11:30.673002] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-10-02T18:11:31.409314] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:11:31.473053] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-02T18:11:31.933401] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T18:11:32.272996] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-02T18:11:33.019521] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T18:11:33.072996] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-02T18:11:33.730733] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T18:11:33.872991] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-02T18:11:34.174929] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-02T18:11:34.672973] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-02T18:11:35.253315] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T18:11:35.271043] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T18:11:35.473005] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-02T18:11:36.272998] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-02T18:11:36.880131] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T18:11:36.982315] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T18:11:37.072996] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-02T18:11:37.872980] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-02T18:11:38.636185] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T18:11:38.639243] [INFO ] [REMOTE ] CP: Full fetch complete (77128 records). [2025-10-02T18:11:38.639420] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-02T18:11:38.678172] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-02T18:11:39.113220] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-10-02T18:11:39.113410] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-10-02T18:11:39.114506] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-10-02T18:11:39.114709] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-10-02T18:11:39.116429] [DEBUG] [LOCAL ] CP: Trimmed 77128 records to 53656 (keeping 200 days of data) [2025-10-02T18:11:39.229932] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T18:11:39.478797] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-02T18:11:39.507205] [DEBUG] [LOCAL ] CP: Primary data saved (53656 records). [2025-10-02T18:11:39.507374] [INFO ] [MAIN ] CP: Full history saved. [2025-10-02T18:11:39.507467] [INFO ] [MAIN ] Update Progress: 515/2370 symbols completed. CP took 41.6s. Estimated remaining: 4h 17m 53s. Rate: 7.2 symbols/min [2025-10-02T18:11:39.693994] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:11:39.710016] [DEBUG] [LOCAL ] CPK: Loaded 13479 existing records from primary storage. [2025-10-02T18:11:39.710309] [INFO ] [MAIN ] CPK: Loaded 13479 existing records. [2025-10-02T18:11:39.877819] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T18:11:39.921736] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:11:39.922571] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-02T18:11:39.922683] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-02T18:11:39.923306] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-02T18:11:39.923370] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-02T18:11:40.278703] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-02T18:11:40.323436] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:11:40.869684] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T18:11:41.072987] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-02T18:11:41.209981] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T18:11:41.873041] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-10-02T18:11:42.440448] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:11:42.673050] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-02T18:11:42.846323] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T18:11:43.473002] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-02T18:11:43.701325] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T18:11:44.193907] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-02T18:11:44.273054] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-02T18:11:45.073020] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-02T18:11:45.250838] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T18:11:45.872999] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-02T18:11:46.072450] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T18:11:46.073679] [INFO ] [REMOTE ] CPA: Full fetch complete (41573 records). [2025-10-02T18:11:46.073772] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-02T18:11:46.074296] [FATAL] [VALIDATOR ] CPA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:11:46.074419] [FATAL] [MAIN ] CPA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:11:46.074509] [WARN ] [MAIN ] CPA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:11:46.074599] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-02T18:11:46.074724] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-02T18:11:46.074784] [INFO ] [LOCAL ] CPA: Starting deletion of derivative data. [2025-10-02T18:11:46.074830] [DEBUG] [LOCAL ] CPA: No derivative data file found to delete. [2025-10-02T18:11:46.074888] [INFO ] [MAIN ] Update Progress: 516/2370 symbols completed. CPA took 40.6s. Estimated remaining: 4h 17m 38s. Rate: 7.2 symbols/min [2025-10-02T18:11:46.260343] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:11:46.316296] [DEBUG] [LOCAL ] CPNG: Loaded 53671 existing records from primary storage. [2025-10-02T18:11:46.316785] [INFO ] [MAIN ] CPNG: Loaded 53671 existing records. [2025-10-02T18:11:46.522310] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:11:46.522539] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-02T18:11:46.522591] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-02T18:11:46.524448] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-10-02T18:11:46.524637] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-02T18:11:46.678120] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-02T18:11:46.959048] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T18:11:46.965537] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:11:47.473012] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-02T18:11:47.963740] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T18:11:48.272979] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-02T18:11:48.341793] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T18:11:48.992544] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T18:11:49.072999] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-02T18:11:49.873021] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-02T18:11:50.239100] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:11:50.240837] [INFO ] [REMOTE ] CPAY: Full fetch complete (45030 records). [2025-10-02T18:11:50.240940] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-02T18:11:50.665070] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-02T18:11:50.665182] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-02T18:11:50.665788] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-02T18:11:50.665853] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-02T18:11:50.667076] [DEBUG] [LOCAL ] CPAY: Trimmed 45030 records to 30849 (keeping 200 days of data) [2025-10-02T18:11:50.724603] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-02T18:11:50.766907] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T18:11:50.769307] [INFO ] [REMOTE ] CPF: Full fetch complete (24135 records). [2025-10-02T18:11:50.771393] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-02T18:11:51.251632] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-02T18:11:51.257330] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-02T18:11:51.258059] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-02T18:11:51.258192] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-02T18:11:51.279440] [DEBUG] [LOCAL ] CPF: Trimmed 24135 records to 15271 (keeping 200 days of data) [2025-10-02T18:11:51.373891] [DEBUG] [LOCAL ] CPAY: Primary data saved (30849 records). [2025-10-02T18:11:51.375542] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-02T18:11:51.376237] [INFO ] [MAIN ] Update Progress: 517/2370 symbols completed. CPAY took 41.6s. Estimated remaining: 4h 17m 19s. Rate: 7.2 symbols/min [2025-10-02T18:11:51.401257] [DEBUG] [LOCAL ] CPF: Primary data saved (15271 records). [2025-10-02T18:11:51.401454] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-02T18:11:51.401570] [INFO ] [MAIN ] Update Progress: 518/2370 symbols completed. CPF took 21.7s. Estimated remaining: 4h 16m 41s. Rate: 7.2 symbols/min [2025-10-02T18:11:51.472990] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-10-02T18:11:51.615096] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-02T18:11:52.273020] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-02T18:11:53.428615] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-02T18:11:53.433340] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-02T18:11:53.620543] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-02T18:11:53.872998] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-02T18:11:54.506245] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T18:11:54.673048] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-02T18:11:55.662355] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T18:11:55.665987] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-02T18:11:55.975889] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-02T18:11:56.273008] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-02T18:11:56.419428] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T18:11:57.073004] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-02T18:11:57.583549] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T18:11:57.873011] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-02T18:11:58.270558] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-02T18:11:58.673077] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-02T18:11:58.793877] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T18:11:59.473071] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-02T18:12:01.218850] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-02T18:12:01.230759] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-02T18:12:01.419784] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-02T18:12:01.421210] [INFO ] [REMOTE ] CPK: Full fetch complete (17874 records). [2025-10-02T18:12:01.421316] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-02T18:12:01.846617] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-10-02T18:12:01.846745] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-10-02T18:12:01.847159] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-10-02T18:12:01.847204] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-10-02T18:12:01.848038] [DEBUG] [LOCAL ] CPK: Trimmed 17874 records to 13609 (keeping 200 days of data) [2025-10-02T18:12:01.951210] [DEBUG] [LOCAL ] CPK: Primary data saved (13609 records). [2025-10-02T18:12:01.951371] [INFO ] [MAIN ] CPK: Full history saved. [2025-10-02T18:12:01.951513] [INFO ] [MAIN ] Update Progress: 519/2370 symbols completed. CPK took 22.4s. Estimated remaining: 4h 16m 41s. Rate: 7.2 symbols/min [2025-10-02T18:12:03.468056] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-10-02T18:12:03.480036] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-02T18:12:05.982072] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-02T18:12:05.993589] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-02T18:12:08.104984] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-10-02T18:12:08.118149] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-02T18:12:12.806351] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (4.69 seconds). [2025-10-02T18:12:12.818669] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-02T18:12:14.399470] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T18:12:14.414948] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-02T18:12:16.806170] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-10-02T18:12:16.819401] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-02T18:12:19.079262] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.26 seconds). [2025-10-02T18:12:19.081419] [INFO ] [REMOTE ] CPNG: Full fetch complete (77674 records). [2025-10-02T18:12:19.081525] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-02T18:12:19.511791] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-02T18:12:19.511888] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-02T18:12:19.512866] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-02T18:12:19.512936] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-02T18:12:19.514589] [DEBUG] [LOCAL ] CPNG: Trimmed 77674 records to 54061 (keeping 200 days of data) [2025-10-02T18:12:19.853379] [DEBUG] [LOCAL ] CPNG: Primary data saved (54061 records). [2025-10-02T18:12:19.853528] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-02T18:12:19.853671] [INFO ] [MAIN ] Update Progress: 520/2370 symbols completed. CPNG took 33.8s. Estimated remaining: 4h 17m 6s. Rate: 7.2 symbols/min [2025-10-02T18:12:20.434305] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:20.608937] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:20.571012] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:20.685931] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:20.719989] [DEBUG] [LOCAL ] CQP: Loaded 19493 existing records from primary storage. [2025-10-02T18:12:20.721540] [INFO ] [MAIN ] CQP: Loaded 19493 existing records. [2025-10-02T18:12:20.721326] [DEBUG] [LOCAL ] CPS: Loaded 25887 existing records from primary storage. [2025-10-02T18:12:20.745949] [INFO ] [MAIN ] CPS: Loaded 25887 existing records. [2025-10-02T18:12:21.013889] [DEBUG] [LOCAL ] CPT: Loaded 44368 existing records from primary storage. [2025-10-02T18:12:21.111749] [INFO ] [MAIN ] CPT: Loaded 44368 existing records. [2025-10-02T18:12:21.123225] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:21.159779] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-02T18:12:21.199367] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-02T18:12:21.244436] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-10-02T18:12:21.250251] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-02T18:12:21.292757] [DEBUG] [LOCAL ] CPRI: Loaded 52548 existing records from primary storage. [2025-10-02T18:12:21.280358] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:21.340953] [INFO ] [MAIN ] CPRI: Loaded 52548 existing records. [2025-10-02T18:12:21.356438] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-02T18:12:21.429216] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-02T18:12:21.525504] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-02T18:12:21.612792] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-02T18:12:21.964729] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:22.000552] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-02T18:12:22.020559] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-02T18:12:22.094370] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-02T18:12:22.061677] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:22.130029] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-02T18:12:22.124521] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-02T18:12:22.215438] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-02T18:12:22.366818] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:22.360698] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-02T18:12:22.382809] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-02T18:12:22.392321] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-10-02T18:12:22.886016] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:22.916015] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-10-02T18:12:23.305782] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:23.341518] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-10-02T18:12:23.364341] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:23.365424] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-10-02T18:12:23.706173] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T18:12:23.711012] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-02T18:12:24.137799] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T18:12:24.142352] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-02T18:12:24.654234] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T18:12:24.662895] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-02T18:12:24.805302] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T18:12:24.812150] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-02T18:12:24.851185] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T18:12:24.864332] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-02T18:12:24.880054] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-02T18:12:24.885410] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-02T18:12:25.657748] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T18:12:25.663614] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-02T18:12:25.915522] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T18:12:25.925776] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-02T18:12:25.957514] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T18:12:25.963687] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-02T18:12:26.191271] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T18:12:26.202299] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-02T18:12:26.945304] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T18:12:26.951754] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-02T18:12:26.999066] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T18:12:27.003978] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-02T18:12:27.147435] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T18:12:27.156805] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-02T18:12:27.493013] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T18:12:27.503707] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-02T18:12:27.641478] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-02T18:12:27.646835] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-02T18:12:28.163967] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T18:12:28.171571] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-02T18:12:28.447814] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T18:12:28.458222] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-02T18:12:29.032538] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T18:12:29.038440] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-02T18:12:29.204106] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T18:12:29.215502] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-02T18:12:29.391395] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T18:12:29.398799] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-02T18:12:29.917810] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T18:12:29.924042] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-02T18:12:30.318127] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:12:30.329467] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-02T18:12:30.434810] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T18:12:30.440249] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-02T18:12:30.864845] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T18:12:30.876698] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-02T18:12:31.052135] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T18:12:31.057925] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-02T18:12:31.252015] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T18:12:31.257685] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-02T18:12:31.534376] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-02T18:12:31.544181] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-02T18:12:32.211756] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T18:12:32.216150] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-02T18:12:32.309102] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T18:12:32.317162] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-02T18:12:32.621160] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T18:12:32.632836] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-02T18:12:33.003717] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T18:12:33.011208] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T18:12:33.073008] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-02T18:12:33.160833] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T18:12:33.872997] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-02T18:12:34.291084] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T18:12:34.673014] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-02T18:12:34.684710] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T18:12:34.685995] [INFO ] [REMOTE ] CPS: Full fetch complete (36305 records). [2025-10-02T18:12:34.686077] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-02T18:12:34.938971] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T18:12:35.167534] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-02T18:12:35.167623] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-02T18:12:35.168210] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-02T18:12:35.168274] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-02T18:12:35.169172] [DEBUG] [LOCAL ] CPS: Trimmed 36305 records to 26039 (keeping 200 days of data) [2025-10-02T18:12:35.326360] [DEBUG] [LOCAL ] CPS: Primary data saved (26039 records). [2025-10-02T18:12:35.326528] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-02T18:12:35.326640] [INFO ] [MAIN ] Update Progress: 521/2370 symbols completed. CPS took 15.5s. Estimated remaining: 4h 17m 23s. Rate: 7.2 symbols/min [2025-10-02T18:12:35.482527] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-02T18:12:35.517824] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:35.547469] [DEBUG] [LOCAL ] CR: Loaded 24428 existing records from primary storage. [2025-10-02T18:12:35.547860] [INFO ] [MAIN ] CR: Loaded 24428 existing records. [2025-10-02T18:12:35.787835] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:35.788069] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-02T18:12:35.788128] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-02T18:12:35.789191] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-02T18:12:35.789259] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-02T18:12:36.170445] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:36.272990] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-02T18:12:36.291487] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T18:12:36.292575] [INFO ] [REMOTE ] CQP: Full fetch complete (30640 records). [2025-10-02T18:12:36.292673] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-02T18:12:36.651630] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T18:12:36.749705] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-02T18:12:36.749805] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-02T18:12:36.750269] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-02T18:12:36.750366] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-02T18:12:36.751288] [DEBUG] [LOCAL ] CQP: Trimmed 30640 records to 19574 (keeping 200 days of data) [2025-10-02T18:12:36.874914] [DEBUG] [LOCAL ] CQP: Primary data saved (19574 records). [2025-10-02T18:12:36.875073] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-02T18:12:36.875161] [INFO ] [MAIN ] Update Progress: 522/2370 symbols completed. CQP took 17.0s. Estimated remaining: 4h 16m 51s. Rate: 7.2 symbols/min [2025-10-02T18:12:37.062463] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:37.062623] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-10-02T18:12:37.062693] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-10-02T18:12:37.062810] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-02T18:12:37.062853] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-02T18:12:37.062896] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-10-02T18:12:37.062929] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-02T18:12:37.078134] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-02T18:12:37.461180] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:37.872977] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-10-02T18:12:38.064444] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T18:12:38.672981] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-10-02T18:12:38.776127] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T18:12:39.019372] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T18:12:39.472969] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-02T18:12:39.563108] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T18:12:40.273001] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-02T18:12:41.055012] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-02T18:12:41.077599] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-02T18:12:41.092232] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T18:12:41.872994] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-02T18:12:42.164939] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T18:12:42.439895] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T18:12:42.672945] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-02T18:12:43.473027] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-02T18:12:44.140631] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T18:12:44.142735] [INFO ] [REMOTE ] CPRI: Full fetch complete (76149 records). [2025-10-02T18:12:44.142843] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-02T18:12:44.286436] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-02T18:12:44.335254] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T18:12:44.640201] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-10-02T18:12:44.640293] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-10-02T18:12:44.641207] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-10-02T18:12:44.641315] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-10-02T18:12:44.643406] [DEBUG] [LOCAL ] CPRI: Trimmed 76149 records to 52920 (keeping 200 days of data) [2025-10-02T18:12:44.963461] [DEBUG] [LOCAL ] CPRI: Primary data saved (52920 records). [2025-10-02T18:12:44.963612] [INFO ] [MAIN ] CPRI: Full history saved. [2025-10-02T18:12:44.963845] [INFO ] [MAIN ] Update Progress: 523/2370 symbols completed. CPRI took 25.1s. Estimated remaining: 4h 16m 42s. Rate: 7.2 symbols/min [2025-10-02T18:12:45.078079] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-02T18:12:45.166123] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:45.230812] [DEBUG] [LOCAL ] CRBG: Loaded 52361 existing records from primary storage. [2025-10-02T18:12:45.231236] [INFO ] [MAIN ] CRBG: Loaded 52361 existing records. [2025-10-02T18:12:45.441569] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:45.442052] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-02T18:12:45.442174] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-02T18:12:45.443970] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-02T18:12:45.444047] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-02T18:12:45.631385] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T18:12:45.866579] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:45.872975] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-10-02T18:12:45.926060] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T18:12:46.673054] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-02T18:12:47.473081] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-02T18:12:47.759375] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T18:12:48.120096] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T18:12:48.278106] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-02T18:12:48.289198] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T18:12:49.073013] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-02T18:12:49.872979] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-02T18:12:50.075248] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T18:12:50.453618] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T18:12:50.459098] [INFO ] [REMOTE ] CPT: Full fetch complete (63930 records). [2025-10-02T18:12:50.459275] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-02T18:12:50.675102] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-02T18:12:50.914246] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-02T18:12:50.914346] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-02T18:12:50.915117] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-02T18:12:50.915182] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-02T18:12:50.916717] [DEBUG] [LOCAL ] CPT: Trimmed 63930 records to 44684 (keeping 200 days of data) [2025-10-02T18:12:51.026288] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T18:12:51.262149] [DEBUG] [LOCAL ] CPT: Primary data saved (44684 records). [2025-10-02T18:12:51.262312] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-02T18:12:51.262716] [INFO ] [MAIN ] Update Progress: 524/2370 symbols completed. CPT took 31.4s. Estimated remaining: 4h 16m 26s. Rate: 7.2 symbols/min [2025-10-02T18:12:51.467568] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:12:51.473034] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-02T18:12:51.523068] [DEBUG] [LOCAL ] CRC: Loaded 44050 existing records from primary storage. [2025-10-02T18:12:51.523534] [INFO ] [MAIN ] CRC: Loaded 44050 existing records. [2025-10-02T18:12:51.806362] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:12:51.808071] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-02T18:12:51.808196] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-02T18:12:51.809750] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-02T18:12:51.809837] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-02T18:12:52.277512] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-02T18:12:52.299864] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T18:12:52.409154] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T18:12:52.433367] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:12:53.073000] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-02T18:12:53.851801] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T18:12:53.874705] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-10-02T18:12:53.878566] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T18:12:54.673049] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-02T18:12:55.095100] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T18:12:55.473004] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-02T18:12:55.542682] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T18:12:56.273003] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-02T18:12:56.983549] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T18:12:57.041493] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T18:12:57.072987] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-02T18:12:57.758891] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-02T18:12:57.873016] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-02T18:12:58.673029] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-02T18:12:59.157439] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T18:12:59.473010] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-02T18:12:59.622863] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T18:13:00.273053] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-02T18:13:01.073067] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-02T18:13:01.457537] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T18:13:01.623281] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T18:13:01.731449] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T18:13:01.732806] [INFO ] [REMOTE ] CRBD: Full fetch complete (14608 records). [2025-10-02T18:13:01.732889] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-02T18:13:01.886450] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-02T18:13:02.162075] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-02T18:13:02.162223] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-02T18:13:02.162712] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-02T18:13:02.162777] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-02T18:13:02.163522] [DEBUG] [LOCAL ] CRBD: Trimmed 14608 records to 9065 (keeping 200 days of data) [2025-10-02T18:13:02.226413] [DEBUG] [LOCAL ] CRBD: Primary data saved (9065 records). [2025-10-02T18:13:02.226560] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-02T18:13:02.226691] [INFO ] [MAIN ] Update Progress: 525/2370 symbols completed. CRBD took 25.4s. Estimated remaining: 4h 16m 27s. Rate: 7.2 symbols/min [2025-10-02T18:13:02.413687] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:02.413897] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-02T18:13:02.413963] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-02T18:13:02.414084] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-02T18:13:02.414128] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-02T18:13:02.414173] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-02T18:13:02.414208] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-02T18:13:02.681254] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-02T18:13:02.819073] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:03.473005] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-02T18:13:04.045237] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T18:13:04.121832] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-02T18:13:04.273033] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-02T18:13:04.916958] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T18:13:05.073014] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-10-02T18:13:05.281971] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:13:05.282280] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-10-02T18:13:05.282371] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:13:05.282419] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-02T18:13:05.282484] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:13:05.282559] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-02T18:13:05.282622] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-02T18:13:05.282708] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-02T18:13:05.282773] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-02T18:13:05.282840] [INFO ] [MAIN ] Update Progress: 526/2370 symbols completed. CRCL took 3.1s. Estimated remaining: 4h 16m 0s. Rate: 7.2 symbols/min [2025-10-02T18:13:05.474629] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:05.542789] [DEBUG] [LOCAL ] CRGY: Loaded 52509 existing records from primary storage. [2025-10-02T18:13:05.543229] [INFO ] [MAIN ] CRGY: Loaded 52509 existing records. [2025-10-02T18:13:05.750786] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:13:05.751148] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-02T18:13:05.751268] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-02T18:13:05.753485] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-02T18:13:05.777706] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-02T18:13:05.878152] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-02T18:13:05.862057] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:13:06.231843] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:06.673024] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-02T18:13:07.049744] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T18:13:07.473006] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-02T18:13:08.201928] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T18:13:08.272971] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-02T18:13:09.046002] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T18:13:09.072982] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-02T18:13:09.873002] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-10-02T18:13:10.014384] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T18:13:10.573028] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T18:13:10.673000] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-02T18:13:11.472986] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-02T18:13:11.752277] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T18:13:12.230847] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T18:13:12.272967] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-02T18:13:13.073022] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-02T18:13:13.134870] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T18:13:13.625570] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T18:13:13.872989] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-02T18:13:14.147559] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:13:14.148824] [INFO ] [REMOTE ] CR: Full fetch complete (34708 records). [2025-10-02T18:13:14.148928] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-02T18:13:14.606376] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-02T18:13:14.606575] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-02T18:13:14.607251] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-02T18:13:14.607353] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-02T18:13:14.608797] [DEBUG] [LOCAL ] CR: Trimmed 34708 records to 24566 (keeping 200 days of data) [2025-10-02T18:13:14.678280] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-02T18:13:14.786107] [DEBUG] [LOCAL ] CR: Primary data saved (24566 records). [2025-10-02T18:13:14.786265] [INFO ] [MAIN ] CR: Full history saved. [2025-10-02T18:13:14.786375] [INFO ] [MAIN ] Update Progress: 527/2370 symbols completed. CR took 39.5s. Estimated remaining: 4h 15m 56s. Rate: 7.2 symbols/min [2025-10-02T18:13:14.967013] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:15.030171] [DEBUG] [LOCAL ] CRH: Loaded 53462 existing records from primary storage. [2025-10-02T18:13:15.030510] [INFO ] [MAIN ] CRH: Loaded 53462 existing records. [2025-10-02T18:13:15.236813] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:13:15.237109] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-02T18:13:15.237164] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-02T18:13:15.239086] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-02T18:13:15.239150] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-02T18:13:15.477814] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-02T18:13:15.648139] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:15.674391] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T18:13:16.272974] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-02T18:13:16.382752] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:13:17.073047] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-10-02T18:13:17.383592] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T18:13:17.383360] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T18:13:17.396311] [INFO ] [REMOTE ] CRC: Full fetch complete (62399 records). [2025-10-02T18:13:17.396569] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-02T18:13:17.818542] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-02T18:13:17.818627] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-02T18:13:17.819373] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-02T18:13:17.819422] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-02T18:13:17.820774] [DEBUG] [LOCAL ] CRC: Trimmed 62399 records to 44370 (keeping 200 days of data) [2025-10-02T18:13:17.875497] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-02T18:13:18.100479] [DEBUG] [LOCAL ] CRC: Primary data saved (44370 records). [2025-10-02T18:13:18.100660] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-02T18:13:18.100769] [INFO ] [MAIN ] Update Progress: 528/2370 symbols completed. CRC took 26.8s. Estimated remaining: 4h 15m 30s. Rate: 7.2 symbols/min [2025-10-02T18:13:18.284613] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:18.344011] [DEBUG] [LOCAL ] CRI: Loaded 49912 existing records from primary storage. [2025-10-02T18:13:18.344434] [INFO ] [MAIN ] CRI: Loaded 49912 existing records. [2025-10-02T18:13:18.537638] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:13:18.538024] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-02T18:13:18.538162] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-02T18:13:18.540575] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-02T18:13:18.540668] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-02T18:13:18.675441] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-02T18:13:18.776701] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:13:18.999035] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:19.257792] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T18:13:19.473060] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-10-02T18:13:20.272971] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-02T18:13:20.434516] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T18:13:20.711089] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T18:13:21.073003] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-02T18:13:21.873032] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-02T18:13:22.004184] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:13:22.601640] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T18:13:22.673054] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-02T18:13:23.246589] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T18:13:23.251192] [INFO ] [REMOTE ] CRBG: Full fetch complete (75703 records). [2025-10-02T18:13:23.251333] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-02T18:13:23.478169] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-02T18:13:23.700479] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-02T18:13:23.700573] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-02T18:13:23.701477] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-02T18:13:23.701549] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-02T18:13:23.703143] [DEBUG] [LOCAL ] CRBG: Trimmed 75703 records to 52747 (keeping 200 days of data) [2025-10-02T18:13:24.035745] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T18:13:24.094662] [DEBUG] [LOCAL ] CRBG: Primary data saved (52747 records). [2025-10-02T18:13:24.094818] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-02T18:13:24.094903] [INFO ] [MAIN ] Update Progress: 529/2370 symbols completed. CRBG took 39.1s. Estimated remaining: 4h 15m 14s. Rate: 7.2 symbols/min [2025-10-02T18:13:24.279528] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-02T18:13:24.283625] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:24.342387] [DEBUG] [LOCAL ] CRK: Loaded 52153 existing records from primary storage. [2025-10-02T18:13:24.342772] [INFO ] [MAIN ] CRK: Loaded 52153 existing records. [2025-10-02T18:13:24.536526] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:13:24.536802] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-02T18:13:24.536860] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-02T18:13:24.538371] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-02T18:13:24.538435] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-02T18:13:24.941169] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:25.072996] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-02T18:13:25.430454] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-02T18:13:25.873019] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-02T18:13:26.031263] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:13:26.673012] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-10-02T18:13:26.984547] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T18:13:27.274207] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:13:27.473018] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-02T18:13:28.272999] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-02T18:13:28.472802] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T18:13:28.937547] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T18:13:29.073015] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-02T18:13:29.873475] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-02T18:13:30.137053] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T18:13:30.672983] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-02T18:13:30.769042] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:13:31.431477] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T18:13:31.472959] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-02T18:13:32.273003] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-02T18:13:32.533368] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:13:33.079864] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-02T18:13:33.100175] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T18:13:33.874690] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-02T18:13:33.877690] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T18:13:34.672998] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-02T18:13:34.881106] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T18:13:35.472970] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-02T18:13:35.745438] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T18:13:36.274553] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-02T18:13:36.280723] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T18:13:37.046093] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T18:13:37.072959] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-02T18:13:37.872988] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-02T18:13:38.044033] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T18:13:38.673038] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-02T18:13:38.993800] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T18:13:39.216498] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T18:13:39.472996] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-02T18:13:40.273040] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-02T18:13:40.463820] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T18:13:41.073075] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-02T18:13:41.243194] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T18:13:41.873002] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-02T18:13:42.189505] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T18:13:42.598441] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T18:13:42.673007] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-02T18:13:43.472980] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-02T18:13:43.552368] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T18:13:44.235802] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T18:13:44.273060] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-02T18:13:45.073014] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-02T18:13:45.234140] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T18:13:45.872979] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-02T18:13:45.938629] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T18:13:45.941225] [INFO ] [REMOTE ] CRGY: Full fetch complete (75977 records). [2025-10-02T18:13:45.941367] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-02T18:13:46.367237] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-02T18:13:46.367332] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-02T18:13:46.368317] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-02T18:13:46.368388] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-02T18:13:46.370166] [DEBUG] [LOCAL ] CRGY: Trimmed 75977 records to 52894 (keeping 200 days of data) [2025-10-02T18:13:46.686718] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-02T18:13:46.715179] [DEBUG] [LOCAL ] CRGY: Primary data saved (52894 records). [2025-10-02T18:13:46.715338] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-02T18:13:46.715427] [INFO ] [MAIN ] Update Progress: 530/2370 symbols completed. CRGY took 41.4s. Estimated remaining: 4h 15m 55s. Rate: 7.2 symbols/min [2025-10-02T18:13:46.917607] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:46.952740] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T18:13:47.004262] [DEBUG] [LOCAL ] CRL: Loaded 42959 existing records from primary storage. [2025-10-02T18:13:47.004639] [INFO ] [MAIN ] CRL: Loaded 42959 existing records. [2025-10-02T18:13:47.199269] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:13:47.199611] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-02T18:13:47.199762] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-02T18:13:47.201686] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-02T18:13:47.201753] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-02T18:13:47.475637] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-02T18:13:47.611546] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:47.646320] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T18:13:48.273045] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-10-02T18:13:48.359387] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T18:13:49.072980] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-02T18:13:49.096441] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-02T18:13:49.098698] [INFO ] [REMOTE ] CRH: Full fetch complete (77299 records). [2025-10-02T18:13:49.098807] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-02T18:13:49.535290] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-02T18:13:49.535479] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-02T18:13:49.536416] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-02T18:13:49.536532] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-02T18:13:49.538512] [DEBUG] [LOCAL ] CRH: Trimmed 77299 records to 53852 (keeping 200 days of data) [2025-10-02T18:13:49.876699] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-02T18:13:49.906300] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T18:13:49.936535] [DEBUG] [LOCAL ] CRH: Primary data saved (53852 records). [2025-10-02T18:13:49.936721] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-02T18:13:49.938325] [INFO ] [MAIN ] Update Progress: 531/2370 symbols completed. CRH took 35.2s. Estimated remaining: 4h 15m 29s. Rate: 7.2 symbols/min [2025-10-02T18:13:50.128152] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:50.128353] [DEBUG] [LOCAL ] CRM: No existing data file found in primary storage. [2025-10-02T18:13:50.128428] [WARN ] [MAIN ] CRM: No existing data found, performing full refresh instead. [2025-10-02T18:13:50.128547] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-02T18:13:50.128588] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-02T18:13:50.128629] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-10-02T18:13:50.128699] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-02T18:13:50.523792] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:50.673932] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T18:13:50.674009] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-02T18:13:51.472978] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-02T18:13:51.569666] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:13:52.273033] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-02T18:13:52.389710] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T18:13:52.613453] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-02T18:13:52.615506] [INFO ] [REMOTE ] CRI: Full fetch complete (70915 records). [2025-10-02T18:13:52.615713] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-02T18:13:53.068671] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-02T18:13:53.068773] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-02T18:13:53.069613] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-02T18:13:53.069695] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-02T18:13:53.071337] [DEBUG] [LOCAL ] CRI: Trimmed 70915 records to 50218 (keeping 200 days of data) [2025-10-02T18:13:53.073002] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-02T18:13:53.398699] [DEBUG] [LOCAL ] CRI: Primary data saved (50218 records). [2025-10-02T18:13:53.398858] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-02T18:13:53.398958] [INFO ] [MAIN ] Update Progress: 532/2370 symbols completed. CRI took 35.3s. Estimated remaining: 4h 15m 4s. Rate: 7.2 symbols/min [2025-10-02T18:13:53.581556] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:13:53.581749] [DEBUG] [LOCAL ] CRS: No existing data file found in primary storage. [2025-10-02T18:13:53.581799] [WARN ] [MAIN ] CRS: No existing data found, performing full refresh instead. [2025-10-02T18:13:53.581950] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-02T18:13:53.582003] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-02T18:13:53.582049] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-10-02T18:13:53.582139] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-02T18:13:53.878116] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-10-02T18:13:53.993821] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:13:54.029542] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T18:13:54.673046] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-10-02T18:13:54.814733] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T18:13:55.473012] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-02T18:13:56.232053] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T18:13:56.272966] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-02T18:13:56.476162] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-10-02T18:13:57.073015] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-02T18:13:57.235088] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T18:13:57.873022] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-02T18:13:57.928947] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T18:13:58.672974] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-02T18:13:59.165866] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-02T18:13:59.273967] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T18:13:59.473048] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-02T18:13:59.944676] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T18:13:59.946969] [INFO ] [REMOTE ] CRK: Full fetch complete (75595 records). [2025-10-02T18:13:59.947139] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-02T18:14:00.280584] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-02T18:14:00.450874] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-10-02T18:14:00.450989] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-10-02T18:14:00.452494] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-10-02T18:14:00.452586] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-10-02T18:14:00.454325] [DEBUG] [LOCAL ] CRK: Trimmed 75595 records to 52539 (keeping 200 days of data) [2025-10-02T18:14:00.919296] [DEBUG] [LOCAL ] CRK: Primary data saved (52539 records). [2025-10-02T18:14:00.919489] [INFO ] [MAIN ] CRK: Full history saved. [2025-10-02T18:14:00.919591] [INFO ] [MAIN ] Update Progress: 533/2370 symbols completed. CRK took 36.8s. Estimated remaining: 4h 14m 53s. Rate: 7.2 symbols/min [2025-10-02T18:14:01.078220] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-02T18:14:01.135901] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:01.143950] [DEBUG] [LOCAL ] CRT: Loaded 4988 existing records from primary storage. [2025-10-02T18:14:01.144799] [INFO ] [MAIN ] CRT: Loaded 4988 existing records. [2025-10-02T18:14:01.403471] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:14:01.403859] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-02T18:14:01.403929] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-02T18:14:01.404696] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-02T18:14:01.404770] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-02T18:14:01.886933] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:01.887594] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-10-02T18:14:01.920391] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-02T18:14:02.090281] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-02T18:14:02.365184] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T18:14:02.433466] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-02T18:14:02.673009] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-02T18:14:03.473017] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-02T18:14:04.273032] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-02T18:14:04.394712] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T18:14:04.925143] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T18:14:05.073058] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-02T18:14:05.856523] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T18:14:05.859084] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-02T18:14:05.873020] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-02T18:14:06.673040] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-02T18:14:07.304527] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-02T18:14:07.473026] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-02T18:14:08.073681] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-02T18:14:08.272986] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-02T18:14:09.073004] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-02T18:14:09.442305] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T18:14:09.747389] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-02T18:14:09.873040] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-02T18:14:10.297332] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T18:14:10.673016] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-02T18:14:10.989792] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T18:14:11.323906] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-02T18:14:11.473024] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-02T18:14:12.273025] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-02T18:14:13.072974] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-02T18:14:13.112123] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T18:14:13.761346] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-02T18:14:13.873020] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-02T18:14:14.351259] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-10-02T18:14:14.476953] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T18:14:14.673008] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-02T18:14:15.290223] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-02T18:14:15.473020] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-02T18:14:16.093027] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T18:14:16.272997] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-02T18:14:17.073010] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-02T18:14:17.873039] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-02T18:14:18.489427] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T18:14:18.672979] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-02T18:14:18.905185] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-10-02T18:14:19.312810] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T18:14:19.473005] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-02T18:14:20.208901] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T18:14:20.273020] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-02T18:14:21.072976] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-02T18:14:21.096065] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T18:14:21.097087] [INFO ] [REMOTE ] CRT: Full fetch complete (7557 records). [2025-10-02T18:14:21.097180] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-02T18:14:21.510201] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-02T18:14:21.510348] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-02T18:14:21.510590] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-02T18:14:21.510663] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-02T18:14:21.511138] [DEBUG] [LOCAL ] CRT: Trimmed 7557 records to 5011 (keeping 200 days of data) [2025-10-02T18:14:21.544387] [DEBUG] [LOCAL ] CRT: Primary data saved (5011 records). [2025-10-02T18:14:21.544525] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-02T18:14:21.544610] [INFO ] [MAIN ] Update Progress: 534/2370 symbols completed. CRT took 20.6s. Estimated remaining: 4h 15m 27s. Rate: 7.2 symbols/min [2025-10-02T18:14:21.740996] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:21.783561] [DEBUG] [LOCAL ] CSAN: Loaded 42343 existing records from primary storage. [2025-10-02T18:14:21.783967] [INFO ] [MAIN ] CSAN: Loaded 42343 existing records. [2025-10-02T18:14:21.881739] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-02T18:14:21.998508] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:14:21.998962] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-02T18:14:21.999029] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-02T18:14:22.000521] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-02T18:14:22.000601] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-02T18:14:22.137722] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-10-02T18:14:22.453026] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:22.446902] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T18:14:22.456706] [INFO ] [REMOTE ] CRL: Full fetch complete (63022 records). [2025-10-02T18:14:22.456918] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-02T18:14:22.673524] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-02T18:14:22.890817] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-02T18:14:22.890905] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-02T18:14:22.891731] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-02T18:14:22.891800] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-02T18:14:22.893204] [DEBUG] [LOCAL ] CRL: Trimmed 63022 records to 43331 (keeping 200 days of data) [2025-10-02T18:14:23.182328] [DEBUG] [LOCAL ] CRL: Primary data saved (43331 records). [2025-10-02T18:14:23.182481] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-02T18:14:23.182672] [INFO ] [MAIN ] Update Progress: 535/2370 symbols completed. CRL took 36.5s. Estimated remaining: 4h 14m 55s. Rate: 7.2 symbols/min [2025-10-02T18:14:23.390170] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:23.420537] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T18:14:23.461153] [DEBUG] [LOCAL ] CSL: Loaded 31471 existing records from primary storage. [2025-10-02T18:14:23.461455] [INFO ] [MAIN ] CSL: Loaded 31471 existing records. [2025-10-02T18:14:23.478180] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-10-02T18:14:23.668280] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:14:23.668526] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-02T18:14:23.668584] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-02T18:14:23.669682] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-02T18:14:23.669749] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-02T18:14:24.073094] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:24.273013] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-02T18:14:25.073026] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-10-02T18:14:25.251702] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T18:14:25.292859] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-02T18:14:25.873390] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-02T18:14:25.876313] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T18:14:26.340993] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T18:14:26.673021] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-02T18:14:27.473067] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-02T18:14:28.139084] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-02T18:14:28.141206] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-10-02T18:14:28.141338] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-02T18:14:28.276123] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-02T18:14:28.577220] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T18:14:28.644873] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-02T18:14:28.645149] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-02T18:14:28.646162] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-02T18:14:28.646253] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-02T18:14:28.648255] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 54160 (keeping 200 days of data) [2025-10-02T18:14:28.915332] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T18:14:29.062443] [DEBUG] [LOCAL ] CRM: Primary data saved (54160 records). [2025-10-02T18:14:29.062603] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-02T18:14:29.062722] [INFO ] [MAIN ] Update Progress: 536/2370 symbols completed. CRM took 39.1s. Estimated remaining: 4h 14m 38s. Rate: 7.2 symbols/min [2025-10-02T18:14:29.078135] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-02T18:14:29.256045] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:29.271146] [DEBUG] [LOCAL ] CSR: Loaded 12788 existing records from primary storage. [2025-10-02T18:14:29.271395] [INFO ] [MAIN ] CSR: Loaded 12788 existing records. [2025-10-02T18:14:29.490269] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:14:29.490801] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-02T18:14:29.491013] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-02T18:14:29.499304] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-02T18:14:29.513456] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-02T18:14:29.550121] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-02T18:14:29.880962] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-02T18:14:29.927521] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:30.196372] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T18:14:30.673026] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-02T18:14:31.434825] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:14:31.472980] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-02T18:14:31.801063] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-02T18:14:32.273002] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-10-02T18:14:33.072971] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-02T18:14:33.102431] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T18:14:33.303081] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T18:14:33.872996] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-02T18:14:34.576111] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:14:34.672973] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-02T18:14:34.750231] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-02T18:14:35.472996] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-02T18:14:35.946022] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T18:14:36.273031] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-02T18:14:36.768762] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T18:14:36.770697] [INFO ] [REMOTE ] CRS: Full fetch complete (62716 records). [2025-10-02T18:14:36.770810] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-02T18:14:36.981757] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-02T18:14:37.078084] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-02T18:14:37.227413] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-02T18:14:37.227497] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-02T18:14:37.228304] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-02T18:14:37.228380] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-02T18:14:37.229822] [DEBUG] [LOCAL ] CRS: Trimmed 62716 records to 43533 (keeping 200 days of data) [2025-10-02T18:14:37.524197] [DEBUG] [LOCAL ] CRS: Primary data saved (43533 records). [2025-10-02T18:14:37.524330] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-02T18:14:37.524407] [INFO ] [MAIN ] Update Progress: 537/2370 symbols completed. CRS took 44.1s. Estimated remaining: 4h 14m 31s. Rate: 7.2 symbols/min [2025-10-02T18:14:37.715197] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:37.715384] [DEBUG] [LOCAL ] CSTM: No existing data file found in primary storage. [2025-10-02T18:14:37.715441] [WARN ] [MAIN ] CSTM: No existing data found, performing full refresh instead. [2025-10-02T18:14:37.715559] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-02T18:14:37.715602] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-02T18:14:37.715672] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-10-02T18:14:37.715729] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-02T18:14:37.878127] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-02T18:14:38.106638] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:38.664328] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T18:14:38.673786] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-02T18:14:39.348377] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T18:14:39.473028] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-10-02T18:14:39.482569] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T18:14:40.273031] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-02T18:14:41.072986] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-02T18:14:41.314040] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T18:14:41.854781] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T18:14:41.872954] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-02T18:14:42.169706] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T18:14:42.673014] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-02T18:14:43.414126] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T18:14:43.472964] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-02T18:14:44.222407] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T18:14:44.272978] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-02T18:14:44.604582] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T18:14:45.073026] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-02T18:14:45.746711] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T18:14:45.872997] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-02T18:14:45.977429] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-02T18:14:46.673006] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-02T18:14:47.445561] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T18:14:47.472946] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-02T18:14:48.041593] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T18:14:48.273002] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-02T18:14:49.015537] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T18:14:49.073047] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-02T18:14:49.874957] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-02T18:14:49.898963] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T18:14:50.035059] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-02T18:14:50.673046] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-02T18:14:51.118778] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T18:14:51.284960] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T18:14:51.473006] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-02T18:14:52.110357] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-02T18:14:52.273015] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-02T18:14:53.073069] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-02T18:14:53.872978] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-02T18:14:54.008816] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T18:14:54.515846] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:14:54.673008] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-02T18:14:54.932796] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T18:14:54.934441] [INFO ] [REMOTE ] CSAN: Full fetch complete (60649 records). [2025-10-02T18:14:54.934530] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-02T18:14:55.378783] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-02T18:14:55.378901] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-02T18:14:55.379923] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-02T18:14:55.380004] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-02T18:14:55.381797] [DEBUG] [LOCAL ] CSAN: Trimmed 60649 records to 42614 (keeping 200 days of data) [2025-10-02T18:14:55.479333] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-02T18:14:55.645722] [DEBUG] [LOCAL ] CSAN: Primary data saved (42614 records). [2025-10-02T18:14:55.645853] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-02T18:14:55.645931] [INFO ] [MAIN ] Update Progress: 538/2370 symbols completed. CSAN took 34.1s. Estimated remaining: 4h 14m 56s. Rate: 7.2 symbols/min [2025-10-02T18:14:55.848114] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:55.863496] [DEBUG] [LOCAL ] CSV: Loaded 12774 existing records from primary storage. [2025-10-02T18:14:55.864007] [INFO ] [MAIN ] CSV: Loaded 12774 existing records. [2025-10-02T18:14:56.103959] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:14:56.104530] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-02T18:14:56.104730] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-02T18:14:56.105695] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-02T18:14:56.105762] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-02T18:14:56.277485] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-02T18:14:56.364885] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T18:14:56.557530] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:57.071264] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T18:14:57.081505] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-10-02T18:14:57.446602] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-02T18:14:57.872965] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-02T18:14:58.046821] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T18:14:58.491837] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T18:14:58.492936] [INFO ] [REMOTE ] CSR: Full fetch complete (17702 records). [2025-10-02T18:14:58.493012] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-02T18:14:58.682035] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-02T18:14:58.903493] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-10-02T18:14:58.903571] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-10-02T18:14:58.903999] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-10-02T18:14:58.904064] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-10-02T18:14:58.904662] [DEBUG] [LOCAL ] CSR: Trimmed 17702 records to 12887 (keeping 200 days of data) [2025-10-02T18:14:59.002842] [DEBUG] [LOCAL ] CSR: Primary data saved (12887 records). [2025-10-02T18:14:59.003078] [INFO ] [MAIN ] CSR: Full history saved. [2025-10-02T18:14:59.003418] [INFO ] [MAIN ] Update Progress: 539/2370 symbols completed. CSR took 29.9s. Estimated remaining: 4h 14m 30s. Rate: 7.2 symbols/min [2025-10-02T18:14:59.188802] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:14:59.189011] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-02T18:14:59.189065] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-02T18:14:59.189179] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-02T18:14:59.189221] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-02T18:14:59.189262] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-02T18:14:59.189306] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-02T18:14:59.483414] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-02T18:14:59.574346] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:14:59.848825] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:14:59.853522] [INFO ] [REMOTE ] CSL: Full fetch complete (45335 records). [2025-10-02T18:14:59.853665] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-02T18:15:00.266505] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-10-02T18:15:00.266594] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-10-02T18:15:00.267268] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-10-02T18:15:00.267341] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-10-02T18:15:00.269357] [DEBUG] [LOCAL ] CSL: Trimmed 45335 records to 31700 (keeping 200 days of data) [2025-10-02T18:15:00.327531] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-02T18:15:00.485141] [DEBUG] [LOCAL ] CSL: Primary data saved (31700 records). [2025-10-02T18:15:00.485290] [INFO ] [MAIN ] CSL: Full history saved. [2025-10-02T18:15:00.485419] [INFO ] [MAIN ] Update Progress: 540/2370 symbols completed. CSL took 37.3s. Estimated remaining: 4h 13m 59s. Rate: 7.2 symbols/min [2025-10-02T18:15:00.674360] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:00.690304] [DEBUG] [LOCAL ] CTBB: Loaded 7070 existing records from primary storage. [2025-10-02T18:15:00.690581] [INFO ] [MAIN ] CTBB: Loaded 7070 existing records. [2025-10-02T18:15:00.891287] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:15:00.891511] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-02T18:15:00.891562] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-02T18:15:00.891994] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-02T18:15:00.892058] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-02T18:15:01.079159] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-10-02T18:15:01.331589] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:01.366621] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T18:15:01.391115] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:15:01.391565] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-10-02T18:15:01.391715] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:15:01.391820] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-02T18:15:01.391882] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:15:01.391928] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-02T18:15:01.391987] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-02T18:15:01.392025] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-02T18:15:01.392098] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-02T18:15:01.392177] [INFO ] [MAIN ] Update Progress: 541/2370 symbols completed. CSW took 2.4s. Estimated remaining: 4h 13m 25s. Rate: 7.2 symbols/min [2025-10-02T18:15:01.532460] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T18:15:01.629759] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:01.629995] [DEBUG] [LOCAL ] CTDD: No existing data file found in primary storage. [2025-10-02T18:15:01.630044] [WARN ] [MAIN ] CTDD: No existing data found, performing full refresh instead. [2025-10-02T18:15:01.630190] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-02T18:15:01.630260] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-02T18:15:01.630317] [DEBUG] [LOCAL ] CTDD: No primary data file found to delete. [2025-10-02T18:15:01.630354] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-02T18:15:01.879451] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-02T18:15:02.060309] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:02.673043] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-10-02T18:15:03.473006] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-10-02T18:15:03.574468] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T18:15:03.671525] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T18:15:04.273006] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-02T18:15:04.319609] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T18:15:05.073059] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-02T18:15:05.321506] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T18:15:05.873050] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-02T18:15:06.363305] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-02T18:15:06.666910] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T18:15:06.676165] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-02T18:15:07.408853] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T18:15:07.473033] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-02T18:15:08.040630] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T18:15:08.273002] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-02T18:15:08.923197] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T18:15:09.073009] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-02T18:15:09.872999] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-02T18:15:10.423013] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T18:15:10.673051] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-02T18:15:11.018583] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T18:15:11.473006] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-02T18:15:11.949375] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T18:15:11.953241] [INFO ] [REMOTE ] CSTM: Full fetch complete (69257 records). [2025-10-02T18:15:11.953357] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-02T18:15:12.276537] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-02T18:15:12.310980] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T18:15:12.420246] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-02T18:15:12.420334] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-02T18:15:12.421333] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-02T18:15:12.421400] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-02T18:15:12.422864] [DEBUG] [LOCAL ] CSTM: Trimmed 69257 records to 47784 (keeping 200 days of data) [2025-10-02T18:15:12.721965] [DEBUG] [LOCAL ] CSTM: Primary data saved (47784 records). [2025-10-02T18:15:12.722119] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-02T18:15:12.722199] [INFO ] [MAIN ] Update Progress: 542/2370 symbols completed. CSTM took 35.2s. Estimated remaining: 4h 13m 27s. Rate: 7.2 symbols/min [2025-10-02T18:15:12.906383] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:12.906688] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-10-02T18:15:12.906749] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-10-02T18:15:12.906873] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-10-02T18:15:12.906930] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-02T18:15:12.907001] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-02T18:15:12.907053] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-10-02T18:15:13.075409] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-02T18:15:13.298370] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:13.342963] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T18:15:13.707088] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T18:15:13.873015] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-02T18:15:14.503607] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T18:15:14.673024] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-02T18:15:15.415262] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T18:15:15.473039] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-02T18:15:16.272999] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-10-02T18:15:16.346248] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T18:15:16.846450] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:15:16.846827] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-10-02T18:15:16.846914] [FATAL] [REMOTE ] CTEST: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:15:16.846965] [FATAL] [MAIN ] CTEST: Failed to fetch primary data. [2025-10-02T18:15:16.847028] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:15:16.847102] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-10-02T18:15:16.847190] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-10-02T18:15:16.847247] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-10-02T18:15:16.847293] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-10-02T18:15:16.847341] [INFO ] [MAIN ] Update Progress: 543/2370 symbols completed. CTEST took 4.1s. Estimated remaining: 4h 13m 5s. Rate: 7.2 symbols/min [2025-10-02T18:15:17.041538] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:17.041748] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-02T18:15:17.041805] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-02T18:15:17.041962] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-02T18:15:17.042008] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-02T18:15:17.042050] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-02T18:15:17.042083] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-02T18:15:17.078237] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-02T18:15:17.450558] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:17.758124] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-02T18:15:17.873034] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-02T18:15:18.295791] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-02T18:15:18.673015] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-02T18:15:19.476800] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-10-02T18:15:19.479253] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T18:15:19.677625] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:15:19.678326] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-10-02T18:15:19.678576] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:15:19.678860] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-02T18:15:19.678961] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:15:19.679209] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-02T18:15:19.679406] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-02T18:15:19.679543] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-02T18:15:19.679607] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-02T18:15:19.679704] [INFO ] [MAIN ] Update Progress: 544/2370 symbols completed. CTEV took 2.8s. Estimated remaining: 4h 12m 38s. Rate: 7.2 symbols/min [2025-10-02T18:15:19.938369] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:19.973206] [DEBUG] [LOCAL ] CTO: Loaded 27816 existing records from primary storage. [2025-10-02T18:15:19.973470] [INFO ] [MAIN ] CTO: Loaded 27816 existing records. [2025-10-02T18:15:20.186798] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:15:20.187041] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-02T18:15:20.187130] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-02T18:15:20.188286] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-02T18:15:20.188352] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-02T18:15:20.278165] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-02T18:15:20.625324] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:20.979736] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T18:15:21.073006] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-02T18:15:21.872994] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-02T18:15:21.900504] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T18:15:22.566629] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-02T18:15:22.673036] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-02T18:15:23.473013] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-10-02T18:15:23.572047] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-02T18:15:24.273041] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-02T18:15:24.954706] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T18:15:25.053289] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T18:15:25.072966] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-02T18:15:25.872975] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-02T18:15:26.202914] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T18:15:26.672997] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-02T18:15:26.883609] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T18:15:27.124179] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T18:15:27.125570] [INFO ] [REMOTE ] CTDD: Full fetch complete (8458 records). [2025-10-02T18:15:27.125672] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-02T18:15:27.480164] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-02T18:15:27.527595] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-02T18:15:27.527702] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-02T18:15:27.527958] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-02T18:15:27.528089] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-02T18:15:27.528602] [DEBUG] [LOCAL ] CTDD: Trimmed 8458 records to 5926 (keeping 200 days of data) [2025-10-02T18:15:27.573780] [DEBUG] [LOCAL ] CTDD: Primary data saved (5926 records). [2025-10-02T18:15:27.573913] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-02T18:15:27.573999] [INFO ] [MAIN ] Update Progress: 545/2370 symbols completed. CTDD took 26.2s. Estimated remaining: 4h 12m 28s. Rate: 7.2 symbols/min [2025-10-02T18:15:27.774332] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:27.818222] [DEBUG] [LOCAL ] CTOS: Loaded 36522 existing records from primary storage. [2025-10-02T18:15:27.818551] [INFO ] [MAIN ] CTOS: Loaded 36522 existing records. [2025-10-02T18:15:28.031276] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:15:28.031585] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-02T18:15:28.031702] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-02T18:15:28.033904] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-02T18:15:28.033969] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-02T18:15:28.161597] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T18:15:28.178757] [INFO ] [REMOTE ] CSV: Full fetch complete (19556 records). [2025-10-02T18:15:28.191936] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-02T18:15:28.278965] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-02T18:15:28.823273] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:28.929110] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-02T18:15:28.929190] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-02T18:15:28.929537] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-02T18:15:28.929586] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-02T18:15:28.930287] [DEBUG] [LOCAL ] CSV: Trimmed 19556 records to 12924 (keeping 200 days of data) [2025-10-02T18:15:29.022951] [DEBUG] [LOCAL ] CSV: Primary data saved (12924 records). [2025-10-02T18:15:29.023093] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-02T18:15:29.023206] [INFO ] [MAIN ] Update Progress: 546/2370 symbols completed. CSV took 33.4s. Estimated remaining: 4h 11m 57s. Rate: 7.2 symbols/min [2025-10-02T18:15:29.081505] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-02T18:15:29.212897] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:29.272860] [DEBUG] [LOCAL ] CTRA: Loaded 53648 existing records from primary storage. [2025-10-02T18:15:29.273266] [INFO ] [MAIN ] CTRA: Loaded 53648 existing records. [2025-10-02T18:15:29.468148] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:15:29.468381] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-02T18:15:29.468435] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-02T18:15:29.471344] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-02T18:15:29.471410] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-02T18:15:29.807419] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T18:15:29.895935] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-10-02T18:15:29.904065] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:29.917335] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-02T18:15:30.673019] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-02T18:15:31.318609] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T18:15:31.472992] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-02T18:15:32.161417] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T18:15:32.272995] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-02T18:15:32.522709] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T18:15:32.984209] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T18:15:33.073027] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-02T18:15:33.675367] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T18:15:33.873012] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-02T18:15:34.673020] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-02T18:15:35.262054] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T18:15:35.472998] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-02T18:15:36.168596] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T18:15:36.207860] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:15:36.272998] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-02T18:15:36.945525] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T18:15:37.073069] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-02T18:15:37.872997] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-10-02T18:15:38.195367] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T18:15:38.673011] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-02T18:15:39.473014] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-02T18:15:39.756997] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T18:15:39.827244] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-02T18:15:40.273112] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-02T18:15:40.434407] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-02T18:15:40.961120] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T18:15:40.962198] [INFO ] [REMOTE ] CTBB: Full fetch complete (10777 records). [2025-10-02T18:15:40.962322] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-02T18:15:41.079311] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-02T18:15:41.392448] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-02T18:15:41.392533] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-02T18:15:41.392920] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-02T18:15:41.392984] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-02T18:15:41.393480] [DEBUG] [LOCAL ] CTBB: Trimmed 10777 records to 7097 (keeping 200 days of data) [2025-10-02T18:15:41.441119] [DEBUG] [LOCAL ] CTBB: Primary data saved (7097 records). [2025-10-02T18:15:41.441281] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-02T18:15:41.441429] [INFO ] [MAIN ] Update Progress: 547/2370 symbols completed. CTBB took 41.0s. Estimated remaining: 4h 12m 3s. Rate: 7.2 symbols/min [2025-10-02T18:15:41.631924] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:41.632169] [DEBUG] [LOCAL ] CTRE: No existing data file found in primary storage. [2025-10-02T18:15:41.632275] [WARN ] [MAIN ] CTRE: No existing data found, performing full refresh instead. [2025-10-02T18:15:41.632457] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-02T18:15:41.632506] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-02T18:15:41.632553] [DEBUG] [LOCAL ] CTRE: No primary data file found to delete. [2025-10-02T18:15:41.632600] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-02T18:15:41.879468] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-02T18:15:42.035801] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:42.673049] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-02T18:15:42.724860] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-02T18:15:43.239391] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T18:15:43.473096] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-10-02T18:15:44.272976] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-02T18:15:44.372515] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:15:45.073082] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-02T18:15:45.253380] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T18:15:45.293096] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T18:15:45.873018] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-02T18:15:46.320146] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T18:15:46.673057] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-02T18:15:47.473011] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-02T18:15:47.659325] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T18:15:48.282154] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-02T18:15:48.286490] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T18:15:49.073000] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-02T18:15:49.295198] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T18:15:49.651793] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T18:15:49.872961] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-02T18:15:50.152267] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T18:15:50.153792] [INFO ] [REMOTE ] CTO: Full fetch complete (41775 records). [2025-10-02T18:15:50.153878] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-02T18:15:50.573538] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-02T18:15:50.573916] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-02T18:15:50.574566] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-02T18:15:50.574632] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-02T18:15:50.575750] [DEBUG] [LOCAL ] CTO: Trimmed 41775 records to 28044 (keeping 200 days of data) [2025-10-02T18:15:50.673451] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-02T18:15:50.765363] [DEBUG] [LOCAL ] CTO: Primary data saved (28044 records). [2025-10-02T18:15:50.765516] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-02T18:15:50.765606] [INFO ] [MAIN ] Update Progress: 548/2370 symbols completed. CTO took 31.1s. Estimated remaining: 4h 11m 58s. Rate: 7.2 symbols/min [2025-10-02T18:15:50.956524] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:50.995921] [DEBUG] [LOCAL ] CTRI: Loaded 38669 existing records from primary storage. [2025-10-02T18:15:50.996286] [INFO ] [MAIN ] CTRI: Loaded 38669 existing records. [2025-10-02T18:15:51.201385] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:15:51.201935] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-02T18:15:51.202020] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-02T18:15:51.213505] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-02T18:15:51.230856] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-02T18:15:51.238276] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T18:15:51.478540] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-02T18:15:51.650168] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:15:52.273055] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-10-02T18:15:52.689797] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-02T18:15:53.041705] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T18:15:53.072994] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-02T18:15:53.319282] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T18:15:53.872962] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-02T18:15:54.354199] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T18:15:54.673038] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-02T18:15:55.108408] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T18:15:55.473050] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-02T18:15:56.173929] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:15:56.273032] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-02T18:15:57.073019] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-02T18:15:57.273874] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T18:15:57.361172] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T18:15:57.873013] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-02T18:15:58.673009] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-02T18:15:59.006722] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T18:15:59.009016] [INFO ] [REMOTE ] CTOS: Full fetch complete (53573 records). [2025-10-02T18:15:59.009146] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-02T18:15:59.169695] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-02T18:15:59.478517] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-02T18:15:59.497242] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-02T18:15:59.497333] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-02T18:15:59.499028] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-02T18:15:59.499105] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-02T18:15:59.500511] [DEBUG] [LOCAL ] CTOS: Trimmed 53573 records to 36860 (keeping 200 days of data) [2025-10-02T18:15:59.718295] [DEBUG] [LOCAL ] CTOS: Primary data saved (36860 records). [2025-10-02T18:15:59.718446] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-02T18:15:59.720488] [INFO ] [MAIN ] Update Progress: 549/2370 symbols completed. CTOS took 32.1s. Estimated remaining: 4h 11m 52s. Rate: 7.2 symbols/min [2025-10-02T18:15:59.915956] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:15:59.951043] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T18:15:59.976942] [DEBUG] [LOCAL ] CTS: Loaded 19374 existing records from primary storage. [2025-10-02T18:15:59.977197] [INFO ] [MAIN ] CTS: Loaded 19374 existing records. [2025-10-02T18:16:00.181263] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:16:00.181493] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-02T18:16:00.181548] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-02T18:16:00.182366] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-02T18:16:00.182431] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-02T18:16:00.278118] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-02T18:16:00.599678] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:16:01.072970] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-10-02T18:16:01.232407] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T18:16:01.574747] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T18:16:01.873023] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-02T18:16:02.123899] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T18:16:02.673036] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-02T18:16:03.127425] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T18:16:03.473003] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-02T18:16:04.273247] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-02T18:16:04.504029] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T18:16:04.553556] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T18:16:05.073015] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-02T18:16:05.872973] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-02T18:16:06.216319] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-02T18:16:06.247678] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-02T18:16:06.673051] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-02T18:16:07.289963] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T18:16:07.473044] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-02T18:16:08.273023] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-02T18:16:08.554851] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-02T18:16:08.817752] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T18:16:09.073000] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-02T18:16:09.873049] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-02T18:16:10.200486] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T18:16:10.673009] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-02T18:16:10.925007] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T18:16:11.251733] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T18:16:11.473023] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-02T18:16:12.109974] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:16:12.273027] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-02T18:16:12.923043] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T18:16:13.073004] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-02T18:16:13.873007] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-02T18:16:13.944119] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T18:16:13.979609] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T18:16:14.672999] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-02T18:16:15.431054] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T18:16:15.473047] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-02T18:16:15.829211] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T18:16:16.273011] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-02T18:16:17.073004] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-02T18:16:17.164829] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-02T18:16:17.169888] [INFO ] [REMOTE ] CTRA: Full fetch complete (77663 records). [2025-10-02T18:16:17.170119] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-02T18:16:17.623566] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-02T18:16:17.623699] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-02T18:16:17.624568] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-02T18:16:17.624622] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-02T18:16:17.626214] [DEBUG] [LOCAL ] CTRA: Trimmed 77663 records to 54038 (keeping 200 days of data) [2025-10-02T18:16:17.874541] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-02T18:16:17.985364] [DEBUG] [LOCAL ] CTRA: Primary data saved (54038 records). [2025-10-02T18:16:17.985772] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-02T18:16:17.985866] [INFO ] [MAIN ] Update Progress: 550/2370 symbols completed. CTRA took 49.0s. Estimated remaining: 4h 12m 16s. Rate: 7.2 symbols/min [2025-10-02T18:16:18.178516] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:16:18.195981] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T18:16:18.233394] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-02T18:16:18.290341] [DEBUG] [LOCAL ] CTVA: Loaded 53239 existing records from primary storage. [2025-10-02T18:16:18.290704] [INFO ] [MAIN ] CTVA: Loaded 53239 existing records. [2025-10-02T18:16:18.485414] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:16:18.485680] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-02T18:16:18.485742] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-02T18:16:18.487364] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-02T18:16:18.487428] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-02T18:16:18.672993] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-02T18:16:18.875152] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:16:19.472961] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-10-02T18:16:19.541695] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-02T18:16:19.544909] [INFO ] [REMOTE ] CTRE: Full fetch complete (71194 records). [2025-10-02T18:16:19.545021] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-02T18:16:19.990232] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-02T18:16:19.990314] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-02T18:16:19.991106] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-02T18:16:19.991170] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-02T18:16:19.992557] [DEBUG] [LOCAL ] CTRE: Trimmed 71194 records to 49617 (keeping 200 days of data) [2025-10-02T18:16:20.119792] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T18:16:20.127909] [INFO ] [REMOTE ] CTRI: Full fetch complete (51935 records). [2025-10-02T18:16:20.128938] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-02T18:16:20.277535] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-02T18:16:20.677328] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-02T18:16:20.677431] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-02T18:16:20.678638] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-02T18:16:20.678746] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-02T18:16:20.682850] [DEBUG] [LOCAL ] CTRI: Trimmed 51935 records to 39023 (keeping 200 days of data) [2025-10-02T18:16:20.995270] [DEBUG] [LOCAL ] CTRE: Primary data saved (49617 records). [2025-10-02T18:16:20.995991] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-02T18:16:20.996940] [INFO ] [MAIN ] Update Progress: 551/2370 symbols completed. CTRE took 39.6s. Estimated remaining: 4h 11m 51s. Rate: 7.2 symbols/min [2025-10-02T18:16:21.124330] [DEBUG] [LOCAL ] CTRI: Primary data saved (39023 records). [2025-10-02T18:16:21.125065] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-02T18:16:21.125197] [INFO ] [MAIN ] Update Progress: 552/2370 symbols completed. CTRI took 30.4s. Estimated remaining: 4h 11m 15s. Rate: 7.2 symbols/min [2025-10-02T18:16:21.244330] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:16:21.249929] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-02T18:16:21.263719] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-02T18:16:21.264063] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-02T18:16:21.264466] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-02T18:16:21.287930] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-02T18:16:21.329193] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-02T18:16:21.509638] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:16:21.562608] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T18:16:21.602785] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-02T18:16:21.827681] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-02T18:16:21.881999] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-02T18:16:21.942475] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:16:21.943586] [DEBUG] [LOCAL ] CUBE: Loaded 50642 existing records from primary storage. [2025-10-02T18:16:21.944302] [INFO ] [MAIN ] CUBE: Loaded 50642 existing records. [2025-10-02T18:16:22.151326] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:16:22.151493] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-02T18:16:22.151554] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-02T18:16:22.153508] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-10-02T18:16:22.153618] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-02T18:16:22.553965] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T18:16:22.559933] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:16:22.673001] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-10-02T18:16:23.092139] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-10-02T18:16:23.472992] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-02T18:16:23.921002] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-02T18:16:24.273023] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-02T18:16:24.600348] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-02T18:16:24.618354] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T18:16:25.073008] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-10-02T18:16:25.873009] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-02T18:16:26.673175] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-02T18:16:26.673099] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T18:16:27.006799] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T18:16:27.054983] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-02T18:16:27.473003] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-02T18:16:27.797323] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-02T18:16:28.272995] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-02T18:16:29.072973] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-02T18:16:29.317800] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:16:29.403321] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-02T18:16:29.872990] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-02T18:16:30.122710] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-02T18:16:30.673018] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-02T18:16:31.472993] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-02T18:16:31.684976] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-10-02T18:16:32.280628] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-02T18:16:32.286895] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T18:16:33.073025] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-02T18:16:33.141554] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T18:16:33.142879] [INFO ] [REMOTE ] CTS: Full fetch complete (26799 records). [2025-10-02T18:16:33.142961] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-02T18:16:33.573714] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-02T18:16:33.573857] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-02T18:16:33.574396] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-02T18:16:33.574469] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-02T18:16:33.575208] [DEBUG] [LOCAL ] CTS: Trimmed 26799 records to 19508 (keeping 200 days of data) [2025-10-02T18:16:33.705458] [DEBUG] [LOCAL ] CTS: Primary data saved (19508 records). [2025-10-02T18:16:33.705605] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-02T18:16:33.705713] [INFO ] [MAIN ] Update Progress: 553/2370 symbols completed. CTS took 34.0s. Estimated remaining: 4h 11m 21s. Rate: 7.2 symbols/min [2025-10-02T18:16:33.878134] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-02T18:16:33.898673] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:16:33.899001] [DEBUG] [LOCAL ] CUBI: No existing data file found in primary storage. [2025-10-02T18:16:33.900064] [WARN ] [MAIN ] CUBI: No existing data found, performing full refresh instead. [2025-10-02T18:16:33.900235] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-02T18:16:33.900282] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-02T18:16:33.900326] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-10-02T18:16:33.900362] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-02T18:16:34.291272] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:16:34.311152] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-02T18:16:34.568478] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T18:16:34.673000] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-02T18:16:35.011725] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-02T18:16:35.473041] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-10-02T18:16:36.272997] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-02T18:16:36.601835] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-02T18:16:36.662088] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T18:16:37.073004] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-02T18:16:37.447915] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-02T18:16:37.448944] [INFO ] [REMOTE ] CUBB: Full fetch complete (926 records). [2025-10-02T18:16:37.449036] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-02T18:16:37.697524] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-10-02T18:16:37.697884] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:16:37.697977] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:16:37.698109] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-02T18:16:37.698204] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-02T18:16:37.698263] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-02T18:16:37.698337] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-02T18:16:37.698429] [INFO ] [MAIN ] Update Progress: 554/2370 symbols completed. CUBB took 16.7s. Estimated remaining: 4h 10m 59s. Rate: 7.2 symbols/min [2025-10-02T18:16:37.878253] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-02T18:16:37.960864] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:16:38.041816] [DEBUG] [LOCAL ] CUK: Loaded 51001 existing records from primary storage. [2025-10-02T18:16:38.042340] [INFO ] [MAIN ] CUK: Loaded 51001 existing records. [2025-10-02T18:16:38.300858] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:16:38.301118] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-02T18:16:38.301169] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-02T18:16:38.302530] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-02T18:16:38.302619] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-02T18:16:38.678286] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-02T18:16:38.751861] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:16:39.277480] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T18:16:39.473066] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-02T18:16:40.224576] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T18:16:40.272967] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-02T18:16:40.916042] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T18:16:41.073023] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-02T18:16:41.872995] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-02T18:16:42.127293] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T18:16:42.631564] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T18:16:42.673022] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-02T18:16:42.836469] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T18:16:43.472987] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-02T18:16:43.574871] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T18:16:44.273019] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-10-02T18:16:45.072999] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-02T18:16:45.440775] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T18:16:45.843430] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T18:16:45.872981] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-02T18:16:46.099882] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T18:16:46.673028] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-02T18:16:47.472984] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-02T18:16:47.564768] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T18:16:48.273039] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-02T18:16:48.502599] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T18:16:49.073054] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-02T18:16:49.285934] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T18:16:49.873159] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-02T18:16:50.063054] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T18:16:50.445934] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T18:16:50.672975] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-02T18:16:51.052084] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T18:16:51.473012] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-02T18:16:52.272986] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-02T18:16:52.559470] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T18:16:52.943961] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T18:16:53.073004] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-02T18:16:53.873007] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-02T18:16:54.303948] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T18:16:54.606418] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T18:16:54.673031] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-02T18:16:54.914112] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T18:16:55.473015] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-02T18:16:56.273007] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-02T18:16:56.776098] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-02T18:16:56.902727] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T18:16:57.073028] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-02T18:16:57.872973] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-02T18:16:58.000386] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T18:16:58.672986] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-02T18:16:59.060052] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-02T18:16:59.473019] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-02T18:16:59.833722] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T18:16:59.976576] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-02T18:17:00.186190] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T18:17:00.273018] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-02T18:17:01.072996] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-02T18:17:01.734381] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T18:17:01.736495] [INFO ] [REMOTE ] CUBE: Full fetch complete (73034 records). [2025-10-02T18:17:01.736677] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-02T18:17:01.878232] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-02T18:17:02.281843] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-10-02T18:17:02.281950] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-10-02T18:17:02.283003] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-10-02T18:17:02.283074] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-10-02T18:17:02.284694] [DEBUG] [LOCAL ] CUBE: Trimmed 73034 records to 51004 (keeping 200 days of data) [2025-10-02T18:17:02.633452] [DEBUG] [LOCAL ] CUBE: Primary data saved (51004 records). [2025-10-02T18:17:02.633597] [INFO ] [MAIN ] CUBE: Full history saved. [2025-10-02T18:17:02.633711] [INFO ] [MAIN ] Update Progress: 555/2370 symbols completed. CUBE took 41.5s. Estimated remaining: 4h 11m 45s. Rate: 7.2 symbols/min [2025-10-02T18:17:02.677595] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-02T18:17:02.836703] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:02.836992] [DEBUG] [LOCAL ] CULP: No existing data file found in primary storage. [2025-10-02T18:17:02.837169] [WARN ] [MAIN ] CULP: No existing data found, performing full refresh instead. [2025-10-02T18:17:02.837395] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-02T18:17:02.837469] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-02T18:17:02.837541] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-10-02T18:17:02.837696] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-02T18:17:03.091496] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T18:17:03.298775] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T18:17:03.339395] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:03.473014] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-02T18:17:04.273017] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-02T18:17:04.647236] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-02T18:17:04.937705] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T18:17:04.939563] [INFO ] [REMOTE ] CTVA: Full fetch complete (76592 records). [2025-10-02T18:17:04.939759] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-02T18:17:04.940582] [FATAL] [VALIDATOR ] CTVA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:17:04.940721] [FATAL] [MAIN ] CTVA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:17:04.940770] [WARN ] [MAIN ] CTVA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:17:04.940813] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-02T18:17:04.940917] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-10-02T18:17:04.940976] [INFO ] [LOCAL ] CTVA: Starting deletion of derivative data. [2025-10-02T18:17:04.941534] [DEBUG] [LOCAL ] CTVA: Deleted derivative data file. [2025-10-02T18:17:04.941684] [INFO ] [MAIN ] Update Progress: 556/2370 symbols completed. CTVA took 47.0s. Estimated remaining: 4h 11m 17s. Rate: 7.2 symbols/min [2025-10-02T18:17:05.078106] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-02T18:17:05.132885] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:05.167720] [DEBUG] [LOCAL ] CURB: Loaded 32632 existing records from primary storage. [2025-10-02T18:17:05.168046] [INFO ] [MAIN ] CURB: Loaded 32632 existing records. [2025-10-02T18:17:05.288248] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T18:17:05.306263] [INFO ] [REMOTE ] CUBI: Full fetch complete (39356 records). [2025-10-02T18:17:05.321870] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-02T18:17:05.461612] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:17:05.494992] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-02T18:17:05.500723] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-02T18:17:05.517198] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-02T18:17:05.522392] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-02T18:17:05.877095] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-10-02T18:17:06.175579] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-02T18:17:06.178929] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-02T18:17:06.179530] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-02T18:17:06.179611] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-02T18:17:06.228239] [DEBUG] [LOCAL ] CUBI: Trimmed 39356 records to 27296 (keeping 200 days of data) [2025-10-02T18:17:06.267873] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:06.443796] [DEBUG] [LOCAL ] CUBI: Primary data saved (27296 records). [2025-10-02T18:17:06.443991] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-02T18:17:06.444074] [INFO ] [MAIN ] Update Progress: 557/2370 symbols completed. CUBI took 32.7s. Estimated remaining: 4h 10m 46s. Rate: 7.2 symbols/min [2025-10-02T18:17:06.606887] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:17:06.673045] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-02T18:17:07.090879] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-02T18:17:07.174521] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-02T18:17:07.472991] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-02T18:17:08.273005] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-10-02T18:17:09.073050] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-02T18:17:09.078735] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T18:17:09.782468] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T18:17:09.873041] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-02T18:17:10.352216] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-02T18:17:10.673003] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-02T18:17:11.141312] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-02T18:17:11.472992] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-02T18:17:11.988678] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T18:17:12.273082] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-02T18:17:12.938278] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-02T18:17:13.073020] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-02T18:17:13.163460] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T18:17:13.639185] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T18:17:13.873003] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-02T18:17:14.673045] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-02T18:17:15.176690] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T18:17:15.473036] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-02T18:17:15.565584] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-02T18:17:15.567740] [INFO ] [REMOTE ] CUK: Full fetch complete (73937 records). [2025-10-02T18:17:15.567894] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-02T18:17:16.002537] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-02T18:17:16.002723] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-02T18:17:16.003689] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-02T18:17:16.003768] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-02T18:17:16.005560] [DEBUG] [LOCAL ] CUK: Trimmed 73937 records to 51371 (keeping 200 days of data) [2025-10-02T18:17:16.099343] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T18:17:16.292202] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-02T18:17:16.338065] [DEBUG] [LOCAL ] CUK: Primary data saved (51371 records). [2025-10-02T18:17:16.338223] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-02T18:17:16.338313] [INFO ] [MAIN ] Update Progress: 558/2370 symbols completed. CUK took 38.6s. Estimated remaining: 4h 10m 43s. Rate: 7.2 symbols/min [2025-10-02T18:17:16.921858] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-02T18:17:17.073005] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-02T18:17:17.750196] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-02T18:17:17.873014] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-02T18:17:18.441882] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T18:17:18.442593] [INFO ] [REMOTE ] CULP: Full fetch complete (4659 records). [2025-10-02T18:17:18.442715] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-02T18:17:18.684830] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-02T18:17:18.848898] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-02T18:17:18.849009] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-02T18:17:18.849200] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-02T18:17:18.849244] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-02T18:17:18.849757] [DEBUG] [LOCAL ] CULP: Trimmed 4659 records to 2954 (keeping 200 days of data) [2025-10-02T18:17:18.867494] [DEBUG] [LOCAL ] CULP: Primary data saved (2954 records). [2025-10-02T18:17:18.867592] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-02T18:17:18.867728] [INFO ] [MAIN ] Update Progress: 559/2370 symbols completed. CULP took 16.2s. Estimated remaining: 4h 10m 16s. Rate: 7.2 symbols/min [2025-10-02T18:17:20.158870] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T18:17:20.165493] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-02T18:17:21.511960] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T18:17:21.520003] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-02T18:17:23.048118] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:17:23.056751] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-02T18:17:24.069359] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T18:17:24.077334] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-02T18:17:24.999959] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T18:17:25.007825] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-02T18:17:26.347318] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T18:17:26.355192] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-02T18:17:27.680261] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T18:17:27.687913] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-02T18:17:28.982330] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T18:17:28.990246] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-02T18:17:30.184852] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T18:17:30.186527] [INFO ] [REMOTE ] CURB: Full fetch complete (47303 records). [2025-10-02T18:17:30.186609] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-02T18:17:30.614742] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-02T18:17:30.614876] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-02T18:17:30.615670] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-02T18:17:30.615738] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-02T18:17:30.617131] [DEBUG] [LOCAL ] CURB: Trimmed 47303 records to 32869 (keeping 200 days of data) [2025-10-02T18:17:30.833661] [DEBUG] [LOCAL ] CURB: Primary data saved (32869 records). [2025-10-02T18:17:30.833823] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-02T18:17:30.833908] [INFO ] [MAIN ] Update Progress: 560/2370 symbols completed. CURB took 25.9s. Estimated remaining: 4h 10m 20s. Rate: 7.2 symbols/min [2025-10-02T18:17:31.559155] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:31.666137] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:31.664603] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:31.702170] [DEBUG] [LOCAL ] CVEO: No existing data file found in primary storage. [2025-10-02T18:17:31.704205] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:31.704811] [WARN ] [MAIN ] CVEO: No existing data found, performing full refresh instead. [2025-10-02T18:17:31.705932] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-02T18:17:31.705994] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-02T18:17:31.706043] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-10-02T18:17:31.706077] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-02T18:17:31.873763] [DEBUG] [LOCAL ] CURV: Loaded 26720 existing records from primary storage. [2025-10-02T18:17:31.928277] [INFO ] [MAIN ] CURV: Loaded 26720 existing records. [2025-10-02T18:17:32.174012] [DEBUG] [LOCAL ] CVE: Loaded 53556 existing records from primary storage. [2025-10-02T18:17:32.214623] [DEBUG] [LOCAL ] CUZ: Loaded 49353 existing records from primary storage. [2025-10-02T18:17:32.230904] [INFO ] [MAIN ] CVE: Loaded 53556 existing records. [2025-10-02T18:17:32.230576] [INFO ] [MAIN ] CUZ: Loaded 49353 existing records. [2025-10-02T18:17:32.672137] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:17:32.662737] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:32.687555] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-02T18:17:32.714474] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-02T18:17:32.714350] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-10-02T18:17:32.756706] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-02T18:17:32.831352] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-02T18:17:32.831230] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:17:32.906794] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-02T18:17:32.901518] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:17:32.906959] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-02T18:17:32.938421] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-02T18:17:32.943798] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-02T18:17:32.956261] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-02T18:17:32.961575] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-02T18:17:33.041687] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-02T18:17:33.066868] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-02T18:17:33.813178] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T18:17:33.935309] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-02T18:17:33.970994] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:34.022604] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-10-02T18:17:34.026138] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:34.044175] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-10-02T18:17:34.121456] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:34.121924] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-10-02T18:17:34.874612] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T18:17:34.876952] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-02T18:17:35.656015] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T18:17:35.664673] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-02T18:17:35.749037] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:17:35.759139] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-02T18:17:35.775704] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T18:17:35.779476] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-02T18:17:35.982398] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T18:17:35.994125] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-02T18:17:36.518803] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T18:17:36.523261] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-02T18:17:36.863542] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T18:17:36.869850] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-02T18:17:37.046067] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T18:17:37.056273] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-02T18:17:37.447568] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-02T18:17:37.452578] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-02T18:17:37.995991] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T18:17:38.002113] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-02T18:17:38.280257] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T18:17:38.290522] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-02T18:17:38.482113] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T18:17:38.673022] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-02T18:17:38.814988] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T18:17:39.472999] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-02T18:17:39.580400] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T18:17:39.816983] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T18:17:40.273033] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-02T18:17:40.832067] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T18:17:41.072997] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-02T18:17:41.354560] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T18:17:41.491449] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (5.50 seconds). [2025-10-02T18:17:41.873010] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-02T18:17:42.074949] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T18:17:42.673016] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-02T18:17:43.448403] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T18:17:43.472968] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-02T18:17:43.645380] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T18:17:44.273018] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-02T18:17:45.073029] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-02T18:17:45.193230] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T18:17:45.458474] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:17:45.872991] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-02T18:17:46.068790] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T18:17:46.673002] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-02T18:17:47.363945] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T18:17:47.473023] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-02T18:17:48.273068] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-02T18:17:48.528702] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-02T18:17:49.073047] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-02T18:17:49.111398] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T18:17:49.562876] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T18:17:49.706331] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T18:17:49.707776] [INFO ] [REMOTE ] CVEO: Full fetch complete (20306 records). [2025-10-02T18:17:49.707908] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-02T18:17:49.878154] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-02T18:17:50.174253] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-02T18:17:50.174387] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-02T18:17:50.174954] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-02T18:17:50.175065] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-02T18:17:50.175989] [DEBUG] [LOCAL ] CVEO: Trimmed 20306 records to 15211 (keeping 200 days of data) [2025-10-02T18:17:50.272208] [DEBUG] [LOCAL ] CVEO: Primary data saved (15211 records). [2025-10-02T18:17:50.272365] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-02T18:17:50.272446] [INFO ] [MAIN ] Update Progress: 561/2370 symbols completed. CVEO took 19.4s. Estimated remaining: 4h 10m 47s. Rate: 7.2 symbols/min [2025-10-02T18:17:50.489338] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:50.489557] [DEBUG] [LOCAL ] CVI: No existing data file found in primary storage. [2025-10-02T18:17:50.489604] [WARN ] [MAIN ] CVI: No existing data found, performing full refresh instead. [2025-10-02T18:17:50.489747] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-02T18:17:50.489794] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-02T18:17:50.489839] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-02T18:17:50.489873] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-02T18:17:50.687639] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-02T18:17:50.921903] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:51.473096] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-10-02T18:17:51.553080] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T18:17:52.273022] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-02T18:17:52.564864] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T18:17:53.073007] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-02T18:17:53.284566] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T18:17:53.873044] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-02T18:17:54.007855] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T18:17:54.673021] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-02T18:17:54.740635] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T18:17:54.842429] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T18:17:54.844446] [INFO ] [REMOTE ] CURV: Full fetch complete (38837 records). [2025-10-02T18:17:54.844678] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-02T18:17:54.845503] [FATAL] [VALIDATOR ] CURV: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:17:54.845619] [FATAL] [MAIN ] CURV: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:17:54.845713] [WARN ] [MAIN ] CURV: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:17:54.845860] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-02T18:17:54.845958] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-10-02T18:17:54.846018] [INFO ] [LOCAL ] CURV: Starting deletion of derivative data. [2025-10-02T18:17:54.846704] [DEBUG] [LOCAL ] CURV: Deleted derivative data file. [2025-10-02T18:17:54.846930] [INFO ] [MAIN ] Update Progress: 562/2370 symbols completed. CURV took 24.0s. Estimated remaining: 4h 10m 27s. Rate: 7.2 symbols/min [2025-10-02T18:17:55.045076] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:17:55.065381] [DEBUG] [LOCAL ] CVLG: Loaded 15428 existing records from primary storage. [2025-10-02T18:17:55.065754] [INFO ] [MAIN ] CVLG: Loaded 15428 existing records. [2025-10-02T18:17:55.260259] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:17:55.260487] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-02T18:17:55.260535] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-02T18:17:55.261101] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-02T18:17:55.261164] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-02T18:17:55.482711] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-02T18:17:55.653432] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:17:56.110343] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T18:17:56.273037] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-02T18:17:57.073033] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-02T18:17:57.162141] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T18:17:57.873013] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-02T18:17:58.037730] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T18:17:58.678109] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-02T18:17:58.693064] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T18:17:59.472981] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-10-02T18:17:59.517877] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T18:18:00.273004] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-02T18:18:00.291789] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T18:18:00.632955] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-02T18:18:01.073041] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-02T18:18:01.873023] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-02T18:18:02.137364] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T18:18:02.147736] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-02T18:18:02.150037] [INFO ] [REMOTE ] CUZ: Full fetch complete (70797 records). [2025-10-02T18:18:02.150232] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-02T18:18:02.593589] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-02T18:18:02.593716] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-02T18:18:02.594598] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-02T18:18:02.594696] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-02T18:18:02.599057] [DEBUG] [LOCAL ] CUZ: Trimmed 70797 records to 49712 (keeping 200 days of data) [2025-10-02T18:18:02.690670] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-02T18:18:02.930251] [DEBUG] [LOCAL ] CUZ: Primary data saved (49712 records). [2025-10-02T18:18:02.930499] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-02T18:18:02.930634] [INFO ] [MAIN ] Update Progress: 563/2370 symbols completed. CUZ took 32.1s. Estimated remaining: 4h 10m 18s. Rate: 7.2 symbols/min [2025-10-02T18:18:03.121446] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:03.181242] [DEBUG] [LOCAL ] CVNA: Loaded 52972 existing records from primary storage. [2025-10-02T18:18:03.181605] [INFO ] [MAIN ] CVNA: Loaded 52972 existing records. [2025-10-02T18:18:03.371408] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:18:03.371669] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-02T18:18:03.371741] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-02T18:18:03.373229] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-02T18:18:03.373290] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-02T18:18:03.478143] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-02T18:18:03.577429] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T18:18:03.793175] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:03.830328] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T18:18:04.273038] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-02T18:18:05.072977] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-02T18:18:05.188839] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T18:18:05.400562] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T18:18:05.873000] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-10-02T18:18:06.672976] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-02T18:18:06.704225] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T18:18:07.473073] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-02T18:18:07.954549] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-10-02T18:18:08.272989] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-02T18:18:08.410154] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T18:18:09.073671] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-02T18:18:09.076556] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T18:18:09.872972] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-02T18:18:10.375877] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-02T18:18:10.673021] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-02T18:18:10.981698] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T18:18:11.162842] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T18:18:11.473016] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-02T18:18:12.273032] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-02T18:18:12.684444] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-02T18:18:12.830211] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T18:18:13.072998] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-02T18:18:13.775274] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:18:13.776825] [INFO ] [REMOTE ] CVE: Full fetch complete (77169 records). [2025-10-02T18:18:13.776925] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-02T18:18:13.777806] [FATAL] [VALIDATOR ] CVE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:18:13.777894] [FATAL] [MAIN ] CVE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:18:13.777945] [WARN ] [MAIN ] CVE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:18:13.778046] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-02T18:18:13.778116] [DEBUG] [LOCAL ] CVE: No primary data file found to delete. [2025-10-02T18:18:13.778151] [INFO ] [LOCAL ] CVE: Starting deletion of derivative data. [2025-10-02T18:18:13.778668] [DEBUG] [LOCAL ] CVE: Deleted derivative data file. [2025-10-02T18:18:13.778767] [INFO ] [MAIN ] Update Progress: 564/2370 symbols completed. CVE took 42.9s. Estimated remaining: 4h 10m 18s. Rate: 7.2 symbols/min [2025-10-02T18:18:13.882534] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-10-02T18:18:13.965745] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:14.027378] [DEBUG] [LOCAL ] CVS: Loaded 53696 existing records from primary storage. [2025-10-02T18:18:14.027728] [INFO ] [MAIN ] CVS: Loaded 53696 existing records. [2025-10-02T18:18:14.226781] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:18:14.227086] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-02T18:18:14.227159] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-02T18:18:14.228717] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-02T18:18:14.228785] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-02T18:18:14.383139] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T18:18:14.654071] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:14.672996] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-02T18:18:15.472959] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-02T18:18:15.591070] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T18:18:16.272973] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-10-02T18:18:16.514176] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T18:18:17.072975] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-02T18:18:17.108584] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-10-02T18:18:17.872976] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-10-02T18:18:18.166048] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T18:18:18.672970] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-02T18:18:18.869099] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-10-02T18:18:19.104851] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T18:18:19.473025] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-10-02T18:18:20.272993] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-02T18:18:20.953537] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-02T18:18:21.022604] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T18:18:21.073008] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-02T18:18:21.872985] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-02T18:18:22.053481] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T18:18:22.090637] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T18:18:22.672994] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-02T18:18:23.472994] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-02T18:18:24.170444] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-02T18:18:24.272957] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-10-02T18:18:24.273836] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T18:18:24.709564] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-02T18:18:25.073036] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-02T18:18:25.704743] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T18:18:25.707040] [INFO ] [REMOTE ] CVLG: Full fetch complete (20862 records). [2025-10-02T18:18:25.707142] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-02T18:18:25.707836] [FATAL] [VALIDATOR ] CVLG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:18:25.707926] [FATAL] [MAIN ] CVLG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:18:25.707970] [WARN ] [MAIN ] CVLG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:18:25.708093] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-02T18:18:25.708189] [DEBUG] [LOCAL ] CVLG: No primary data file found to delete. [2025-10-02T18:18:25.708248] [INFO ] [LOCAL ] CVLG: Starting deletion of derivative data. [2025-10-02T18:18:25.708796] [DEBUG] [LOCAL ] CVLG: Deleted derivative data file. [2025-10-02T18:18:25.708929] [INFO ] [MAIN ] Update Progress: 565/2370 symbols completed. CVLG took 30.9s. Estimated remaining: 4h 10m 21s. Rate: 7.2 symbols/min [2025-10-02T18:18:25.835275] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T18:18:25.863380] [INFO ] [REMOTE ] CVI: Full fetch complete (66991 records). [2025-10-02T18:18:25.880917] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-02T18:18:25.894740] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-10-02T18:18:25.919593] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:25.920026] [DEBUG] [LOCAL ] CVX: No existing data file found in primary storage. [2025-10-02T18:18:25.920888] [WARN ] [MAIN ] CVX: No existing data found, performing full refresh instead. [2025-10-02T18:18:25.921034] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-02T18:18:25.921127] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-02T18:18:25.921193] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-10-02T18:18:25.921277] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-02T18:18:25.933837] [FATAL] [VALIDATOR ] CVI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:18:25.990079] [FATAL] [MAIN ] CVI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:18:26.018231] [WARN ] [MAIN ] CVI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:18:26.044731] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-02T18:18:26.055937] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-02T18:18:26.061159] [INFO ] [LOCAL ] CVI: Starting deletion of derivative data. [2025-10-02T18:18:26.061252] [DEBUG] [LOCAL ] CVI: No derivative data file found to delete. [2025-10-02T18:18:26.066525] [INFO ] [MAIN ] Update Progress: 566/2370 symbols completed. CVI took 35.8s. Estimated remaining: 4h 9m 47s. Rate: 7.2 symbols/min [2025-10-02T18:18:26.477131] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:26.541019] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:26.564709] [DEBUG] [LOCAL ] CW: Loaded 22276 existing records from primary storage. [2025-10-02T18:18:26.565104] [INFO ] [MAIN ] CW: Loaded 22276 existing records. [2025-10-02T18:18:26.678446] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-10-02T18:18:26.765203] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:18:26.765435] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-02T18:18:26.765484] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-02T18:18:26.766338] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-02T18:18:26.766402] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-02T18:18:27.155866] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:27.473048] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-02T18:18:28.100726] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-02T18:18:28.273041] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-10-02T18:18:28.588320] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T18:18:29.073024] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-02T18:18:29.420716] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-02T18:18:29.490828] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T18:18:29.873048] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-02T18:18:30.672995] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-02T18:18:30.807904] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T18:18:31.035363] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T18:18:31.473012] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-02T18:18:32.272998] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-02T18:18:32.932424] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-02T18:18:33.073039] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-02T18:18:33.719665] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-02T18:18:33.821147] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:18:33.872989] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-02T18:18:34.673001] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-02T18:18:34.955594] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T18:18:35.472981] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-02T18:18:35.679774] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T18:18:36.273007] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-02T18:18:36.896572] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-10-02T18:18:37.073444] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-02T18:18:37.073361] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T18:18:37.872977] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-02T18:18:38.318396] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-02T18:18:38.392325] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-02T18:18:38.673032] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-02T18:18:39.473037] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-02T18:18:39.932161] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-02T18:18:40.273470] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-02T18:18:40.690324] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-02T18:18:40.798708] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T18:18:41.072985] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-02T18:18:41.873055] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-02T18:18:42.052194] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T18:18:42.423400] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-02T18:18:42.673016] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-02T18:18:43.473027] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-02T18:18:43.555940] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T18:18:44.273038] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-02T18:18:44.426530] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-02T18:18:44.429037] [INFO ] [REMOTE ] CVNA: Full fetch complete (76649 records). [2025-10-02T18:18:44.429171] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-02T18:18:44.878943] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-02T18:18:44.879038] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-02T18:18:44.879980] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-02T18:18:44.880050] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-02T18:18:44.881822] [DEBUG] [LOCAL ] CVNA: Trimmed 76649 records to 53343 (keeping 200 days of data) [2025-10-02T18:18:45.076282] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-02T18:18:45.240135] [DEBUG] [LOCAL ] CVNA: Primary data saved (53343 records). [2025-10-02T18:18:45.240293] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-02T18:18:45.240391] [INFO ] [MAIN ] Update Progress: 567/2370 symbols completed. CVNA took 42.3s. Estimated remaining: 4h 10m 14s. Rate: 7.2 symbols/min [2025-10-02T18:18:45.435587] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:45.435779] [DEBUG] [LOCAL ] CWAN: No existing data file found in primary storage. [2025-10-02T18:18:45.435877] [WARN ] [MAIN ] CWAN: No existing data found, performing full refresh instead. [2025-10-02T18:18:45.435999] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-02T18:18:45.436043] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-02T18:18:45.436087] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-10-02T18:18:45.436125] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-02T18:18:45.841260] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:45.873048] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-10-02T18:18:46.013887] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-02T18:18:46.042130] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-02T18:18:46.045020] [INFO ] [REMOTE ] CVS: Full fetch complete (77813 records). [2025-10-02T18:18:46.045135] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-02T18:18:46.503116] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-02T18:18:46.502982] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T18:18:46.503326] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-02T18:18:46.510347] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-02T18:18:46.510452] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-02T18:18:46.512595] [DEBUG] [LOCAL ] CVS: Trimmed 77813 records to 54086 (keeping 200 days of data) [2025-10-02T18:18:46.705237] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-02T18:18:46.871232] [DEBUG] [LOCAL ] CVS: Primary data saved (54086 records). [2025-10-02T18:18:46.871388] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-02T18:18:46.871477] [INFO ] [MAIN ] Update Progress: 568/2370 symbols completed. CVS took 33.1s. Estimated remaining: 4h 9m 44s. Rate: 7.2 symbols/min [2025-10-02T18:18:47.076362] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:47.076591] [DEBUG] [LOCAL ] CWEN: No existing data file found in primary storage. [2025-10-02T18:18:47.076683] [WARN ] [MAIN ] CWEN: No existing data found, performing full refresh instead. [2025-10-02T18:18:47.076811] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-02T18:18:47.076855] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-02T18:18:47.076899] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-10-02T18:18:47.076934] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-02T18:18:47.479732] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-02T18:18:47.505233] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:47.583794] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T18:18:48.273013] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-02T18:18:48.274185] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T18:18:49.073030] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-10-02T18:18:49.204820] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-02T18:18:49.873027] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-02T18:18:49.907618] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T18:18:50.412119] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T18:18:50.673052] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-02T18:18:51.143567] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T18:18:51.473046] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-02T18:18:52.246176] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T18:18:52.272996] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-02T18:18:52.510579] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:18:53.073014] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-02T18:18:53.873013] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-02T18:18:54.453872] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-02T18:18:54.613350] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T18:18:54.634368] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T18:18:54.635747] [INFO ] [REMOTE ] CW: Full fetch complete (33333 records). [2025-10-02T18:18:54.635841] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-02T18:18:54.678201] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-02T18:18:55.031594] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-02T18:18:55.031703] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-02T18:18:55.032283] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-02T18:18:55.032350] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-02T18:18:55.033252] [DEBUG] [LOCAL ] CW: Trimmed 33333 records to 22388 (keeping 200 days of data) [2025-10-02T18:18:55.195433] [DEBUG] [LOCAL ] CW: Primary data saved (22388 records). [2025-10-02T18:18:55.195566] [INFO ] [MAIN ] CW: Full history saved. [2025-10-02T18:18:55.195669] [INFO ] [MAIN ] Update Progress: 569/2370 symbols completed. CW took 29.1s. Estimated remaining: 4h 9m 36s. Rate: 7.2 symbols/min [2025-10-02T18:18:55.383192] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:18:55.442714] [DEBUG] [LOCAL ] CWH: Loaded 51374 existing records from primary storage. [2025-10-02T18:18:55.443064] [INFO ] [MAIN ] CWH: Loaded 51374 existing records. [2025-10-02T18:18:55.478110] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-02T18:18:55.658206] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:18:55.658425] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-02T18:18:55.658475] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-02T18:18:55.661152] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-02T18:18:55.661251] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-02T18:18:56.069110] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:18:56.273027] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-02T18:18:56.398464] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T18:18:57.072987] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-02T18:18:57.870996] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-10-02T18:18:57.882584] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-10-02T18:18:57.959819] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T18:18:58.581806] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T18:18:58.673031] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-02T18:18:59.472996] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-02T18:18:59.618754] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:19:00.273022] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-02T18:19:01.073107] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-02T18:19:01.074532] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-02T18:19:01.135584] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T18:19:01.644383] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T18:19:01.873033] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-02T18:19:02.464778] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:19:02.672996] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-02T18:19:03.472982] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-02T18:19:03.637407] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T18:19:04.278109] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-02T18:19:04.293757] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T18:19:05.055405] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T18:19:05.072955] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-02T18:19:05.873021] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-02T18:19:06.599011] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-02T18:19:06.673003] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-02T18:19:06.823508] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T18:19:07.473031] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-02T18:19:07.515263] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T18:19:08.272981] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-02T18:19:08.485751] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-02T18:19:08.487876] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-10-02T18:19:08.491365] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-02T18:19:08.924500] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-02T18:19:08.924717] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-02T18:19:08.925976] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-02T18:19:08.926165] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-02T18:19:08.928151] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 54150 (keeping 200 days of data) [2025-10-02T18:19:09.081831] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-02T18:19:09.089765] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T18:19:09.363446] [DEBUG] [LOCAL ] CVX: Primary data saved (54150 records). [2025-10-02T18:19:09.363802] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-02T18:19:09.363906] [INFO ] [MAIN ] Update Progress: 570/2370 symbols completed. CVX took 43.7s. Estimated remaining: 4h 9m 46s. Rate: 7.2 symbols/min [2025-10-02T18:19:09.552103] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:09.601262] [DEBUG] [LOCAL ] CWK: Loaded 49410 existing records from primary storage. [2025-10-02T18:19:09.601592] [INFO ] [MAIN ] CWK: Loaded 49410 existing records. [2025-10-02T18:19:09.806856] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:09.807237] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-02T18:19:09.807321] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-02T18:19:09.809364] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-02T18:19:09.809431] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-02T18:19:09.873679] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-02T18:19:09.968930] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T18:19:10.280554] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:10.673008] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-10-02T18:19:10.989554] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T18:19:11.472999] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-02T18:19:11.573569] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T18:19:12.280801] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-02T18:19:12.287187] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T18:19:13.073009] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-02T18:19:13.337015] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T18:19:13.873006] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-02T18:19:14.182412] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T18:19:14.581699] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T18:19:14.672991] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-02T18:19:15.235710] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T18:19:15.473007] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-02T18:19:16.272968] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-02T18:19:16.307700] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T18:19:17.040777] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T18:19:17.072996] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-02T18:19:17.753504] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T18:19:17.872995] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-02T18:19:18.593232] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T18:19:18.672981] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-02T18:19:19.382531] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T18:19:19.472986] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-02T18:19:19.916063] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T18:19:20.273056] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-02T18:19:21.070120] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T18:19:21.080119] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-02T18:19:21.873009] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-02T18:19:22.207216] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T18:19:22.672986] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-02T18:19:22.926887] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T18:19:23.473006] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-02T18:19:23.655220] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T18:19:24.174270] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:19:24.176485] [INFO ] [REMOTE ] CWEN: Full fetch complete (64684 records). [2025-10-02T18:19:24.176728] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-02T18:19:24.278212] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-02T18:19:24.614145] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-02T18:19:24.614228] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-02T18:19:24.615081] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-02T18:19:24.615149] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-02T18:19:24.616523] [DEBUG] [LOCAL ] CWEN: Trimmed 64684 records to 45415 (keeping 200 days of data) [2025-10-02T18:19:24.858008] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T18:19:24.863401] [INFO ] [REMOTE ] CWH: Full fetch complete (72959 records). [2025-10-02T18:19:24.864430] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-02T18:19:25.083273] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-02T18:19:25.347599] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-02T18:19:25.348041] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-02T18:19:25.349429] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-02T18:19:25.349511] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-02T18:19:25.356086] [DEBUG] [LOCAL ] CWH: Trimmed 72959 records to 51715 (keeping 200 days of data) [2025-10-02T18:19:25.489227] [DEBUG] [LOCAL ] CWEN: Primary data saved (45415 records). [2025-10-02T18:19:25.489933] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-02T18:19:25.490264] [INFO ] [MAIN ] Update Progress: 571/2370 symbols completed. CWEN took 38.6s. Estimated remaining: 4h 10m 2s. Rate: 7.2 symbols/min [2025-10-02T18:19:25.694191] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:25.690519] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:19:25.699849] [INFO ] [REMOTE ] CWAN: Full fetch complete (74746 records). [2025-10-02T18:19:25.700283] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-02T18:19:25.704015] [FATAL] [VALIDATOR ] CWAN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:19:25.704960] [FATAL] [MAIN ] CWAN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:19:25.705800] [WARN ] [MAIN ] CWAN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:19:25.706431] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-02T18:19:25.706920] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-10-02T18:19:25.707610] [INFO ] [LOCAL ] CWAN: Starting deletion of derivative data. [2025-10-02T18:19:25.708475] [DEBUG] [LOCAL ] CWAN: No derivative data file found to delete. [2025-10-02T18:19:25.708915] [INFO ] [MAIN ] Update Progress: 572/2370 symbols completed. CWAN took 40.5s. Estimated remaining: 4h 9m 28s. Rate: 7.2 symbols/min [2025-10-02T18:19:25.851001] [DEBUG] [LOCAL ] CWT: Loaded 27897 existing records from primary storage. [2025-10-02T18:19:25.852283] [INFO ] [MAIN ] CWT: Loaded 27897 existing records. [2025-10-02T18:19:26.074953] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:26.238479] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:26.239210] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-02T18:19:26.241187] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-02T18:19:26.244943] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-02T18:19:26.245398] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-02T18:19:26.467100] [DEBUG] [LOCAL ] CX: Loaded 52827 existing records from primary storage. [2025-10-02T18:19:26.502012] [INFO ] [MAIN ] CX: Loaded 52827 existing records. [2025-10-02T18:19:26.844243] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:26.860571] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-10-02T18:19:27.038132] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:27.041155] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-02T18:19:27.042733] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-02T18:19:27.046739] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-02T18:19:27.056345] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-02T18:19:27.056743] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-02T18:19:27.057123] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-02T18:19:27.209267] [DEBUG] [LOCAL ] CWH: Primary data saved (51715 records). [2025-10-02T18:19:27.235751] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-02T18:19:27.241059] [INFO ] [MAIN ] Update Progress: 573/2370 symbols completed. CWH took 32.0s. Estimated remaining: 4h 8m 59s. Rate: 7.2 symbols/min [2025-10-02T18:19:27.679154] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:27.724271] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:27.724712] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-10-02T18:19:27.733532] [DEBUG] [LOCAL ] CXE: Loaded 6571 existing records from primary storage. [2025-10-02T18:19:27.733807] [INFO ] [MAIN ] CXE: Loaded 6571 existing records. [2025-10-02T18:19:27.922558] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:27.922846] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-02T18:19:27.922908] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-02T18:19:27.923405] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-02T18:19:27.923467] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-02T18:19:28.310372] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:28.310854] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-10-02T18:19:28.331072] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T18:19:28.897509] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T18:19:28.904019] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-10-02T18:19:29.073002] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-02T18:19:29.553432] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T18:19:29.873014] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-02T18:19:30.027558] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T18:19:30.673051] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-02T18:19:31.473018] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-02T18:19:31.588225] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T18:19:32.165509] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T18:19:32.273031] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-02T18:19:32.680519] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-02T18:19:33.073071] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-02T18:19:33.629918] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T18:19:33.873032] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-02T18:19:34.672985] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-02T18:19:34.771898] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T18:19:35.014142] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T18:19:35.473011] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-02T18:19:35.958789] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T18:19:36.273032] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-02T18:19:36.901386] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T18:19:36.903427] [INFO ] [REMOTE ] CWK: Full fetch complete (71007 records). [2025-10-02T18:19:36.903527] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-02T18:19:37.086360] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-02T18:19:37.323636] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-10-02T18:19:37.323755] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-10-02T18:19:37.324702] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-10-02T18:19:37.324769] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-10-02T18:19:37.326234] [DEBUG] [LOCAL ] CWK: Trimmed 71007 records to 49782 (keeping 200 days of data) [2025-10-02T18:19:37.658245] [DEBUG] [LOCAL ] CWK: Primary data saved (49782 records). [2025-10-02T18:19:37.659224] [INFO ] [MAIN ] CWK: Full history saved. [2025-10-02T18:19:37.660111] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:19:37.661495] [INFO ] [MAIN ] Update Progress: 574/2370 symbols completed. CWK took 28.3s. Estimated remaining: 4h 8m 57s. Rate: 7.2 symbols/min [2025-10-02T18:19:37.817738] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T18:19:37.872967] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-02T18:19:37.874978] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:37.883418] [DEBUG] [LOCAL ] CXH: Loaded 4413 existing records from primary storage. [2025-10-02T18:19:37.884051] [INFO ] [MAIN ] CXH: Loaded 4413 existing records. [2025-10-02T18:19:38.069669] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:38.069882] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-02T18:19:38.069932] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-02T18:19:38.070322] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-02T18:19:38.070382] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-02T18:19:38.453405] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:38.673006] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-02T18:19:38.731568] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T18:19:39.473020] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-02T18:19:40.101885] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T18:19:40.220450] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T18:19:40.273005] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-02T18:19:41.066832] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T18:19:41.072951] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-02T18:19:41.655662] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T18:19:41.873028] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-02T18:19:42.531270] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-02T18:19:42.673022] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-02T18:19:43.473012] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-02T18:19:43.867395] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:19:44.273054] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-10-02T18:19:44.949880] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T18:19:45.072973] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-02T18:19:45.258097] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T18:19:45.455957] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-02T18:19:45.873010] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-02T18:19:46.459906] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T18:19:46.673006] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-02T18:19:47.473026] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-02T18:19:47.870681] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T18:19:47.922386] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:19:48.272999] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-02T18:19:48.716489] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T18:19:49.072948] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-02T18:19:49.873005] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-02T18:19:50.361413] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T18:19:50.375756] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-02T18:19:50.673027] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-02T18:19:51.473030] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-02T18:19:51.522381] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T18:19:52.273015] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-02T18:19:52.744939] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T18:19:52.806628] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T18:19:52.807543] [INFO ] [REMOTE ] CXE: Full fetch complete (11776 records). [2025-10-02T18:19:52.807617] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-02T18:19:53.078137] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-02T18:19:53.220771] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-02T18:19:53.220855] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-02T18:19:53.221167] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-02T18:19:53.221213] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-02T18:19:53.221705] [DEBUG] [LOCAL ] CXE: Trimmed 11776 records to 6615 (keeping 200 days of data) [2025-10-02T18:19:53.263958] [DEBUG] [LOCAL ] CXE: Primary data saved (6615 records). [2025-10-02T18:19:53.264128] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-02T18:19:53.264227] [INFO ] [MAIN ] Update Progress: 575/2370 symbols completed. CXE took 26.0s. Estimated remaining: 4h 9m 11s. Rate: 7.2 symbols/min [2025-10-02T18:19:53.454155] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:53.503096] [DEBUG] [LOCAL ] CXM: Loaded 47646 existing records from primary storage. [2025-10-02T18:19:53.503426] [INFO ] [MAIN ] CXM: Loaded 47646 existing records. [2025-10-02T18:19:53.723341] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:53.723578] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-02T18:19:53.723627] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-02T18:19:53.725467] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-02T18:19:53.725540] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-02T18:19:53.878156] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-02T18:19:54.119275] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:54.125056] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T18:19:54.127434] [INFO ] [REMOTE ] CWT: Full fetch complete (40461 records). [2025-10-02T18:19:54.127576] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-02T18:19:54.560938] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-02T18:19:54.561180] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-02T18:19:54.562691] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-02T18:19:54.564194] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-02T18:19:54.564264] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-02T18:19:54.565294] [DEBUG] [LOCAL ] CWT: Trimmed 40461 records to 28121 (keeping 200 days of data) [2025-10-02T18:19:54.673635] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-02T18:19:54.742858] [DEBUG] [LOCAL ] CWT: Primary data saved (28121 records). [2025-10-02T18:19:54.742992] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-02T18:19:54.743074] [INFO ] [MAIN ] Update Progress: 576/2370 symbols completed. CWT took 29.3s. Estimated remaining: 4h 8m 42s. Rate: 7.2 symbols/min [2025-10-02T18:19:54.925108] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:19:54.958493] [DEBUG] [LOCAL ] CXT: Loaded 30989 existing records from primary storage. [2025-10-02T18:19:54.958873] [INFO ] [MAIN ] CXT: Loaded 30989 existing records. [2025-10-02T18:19:55.184730] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:19:55.185006] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-02T18:19:55.185066] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-02T18:19:55.188037] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-02T18:19:55.188126] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-02T18:19:55.324743] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T18:19:55.479154] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-02T18:19:55.615571] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:19:56.273010] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-02T18:19:56.297023] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T18:19:57.072979] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-02T18:19:57.653467] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T18:19:57.873129] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-02T18:19:58.132228] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:19:58.517528] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-02T18:19:58.672998] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-02T18:19:59.473015] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-10-02T18:20:00.273043] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-10-02T18:20:00.325980] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T18:20:01.073012] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-02T18:20:01.251106] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T18:20:01.734597] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:20:01.873056] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-02T18:20:02.563609] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T18:20:02.672996] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-02T18:20:03.359617] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T18:20:03.473031] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-02T18:20:04.272989] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-02T18:20:04.589478] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T18:20:04.749936] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T18:20:04.750932] [INFO ] [REMOTE ] CXH: Full fetch complete (5467 records). [2025-10-02T18:20:04.751018] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-02T18:20:05.073633] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-02T18:20:05.202817] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-02T18:20:05.203022] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-02T18:20:05.203247] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-02T18:20:05.203327] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-02T18:20:05.203987] [DEBUG] [LOCAL ] CXH: Trimmed 5467 records to 4422 (keeping 200 days of data) [2025-10-02T18:20:05.262905] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T18:20:05.281657] [DEBUG] [LOCAL ] CXH: Primary data saved (4422 records). [2025-10-02T18:20:05.281809] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-02T18:20:05.281904] [INFO ] [MAIN ] Update Progress: 577/2370 symbols completed. CXH took 27.6s. Estimated remaining: 4h 8m 40s. Rate: 7.2 symbols/min [2025-10-02T18:20:05.468727] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:20:05.512327] [DEBUG] [LOCAL ] CXW: Loaded 44030 existing records from primary storage. [2025-10-02T18:20:05.512690] [INFO ] [MAIN ] CXW: Loaded 44030 existing records. [2025-10-02T18:20:05.718743] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:20:05.718982] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-02T18:20:05.719035] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-02T18:20:05.720401] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-02T18:20:05.720464] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-02T18:20:05.878124] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-02T18:20:06.121969] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:20:06.673000] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-02T18:20:06.981736] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T18:20:07.103065] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T18:20:07.473015] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-10-02T18:20:08.212215] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T18:20:08.273020] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-02T18:20:09.073003] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-02T18:20:09.447184] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-02T18:20:09.872971] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-02T18:20:10.054595] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T18:20:10.673038] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-02T18:20:11.069497] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-02T18:20:11.472998] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-02T18:20:12.052912] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T18:20:12.272998] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-02T18:20:13.015293] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T18:20:13.072992] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-02T18:20:13.378587] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (4.31 seconds). [2025-10-02T18:20:13.616205] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T18:20:13.618562] [INFO ] [REMOTE ] CX: Full fetch complete (76393 records). [2025-10-02T18:20:13.618726] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-02T18:20:13.877577] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-02T18:20:14.052277] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-02T18:20:14.052406] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-02T18:20:14.053437] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-02T18:20:14.053667] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-02T18:20:14.073289] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T18:20:14.080458] [DEBUG] [LOCAL ] CX: Trimmed 76393 records to 53213 (keeping 200 days of data) [2025-10-02T18:20:14.431273] [DEBUG] [LOCAL ] CX: Primary data saved (53213 records). [2025-10-02T18:20:14.431423] [INFO ] [MAIN ] CX: Full history saved. [2025-10-02T18:20:14.431510] [INFO ] [MAIN ] Update Progress: 578/2370 symbols completed. CX took 48.7s. Estimated remaining: 4h 8m 35s. Rate: 7.2 symbols/min [2025-10-02T18:20:14.621897] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:20:14.649527] [DEBUG] [LOCAL ] CYD: Loaded 26522 existing records from primary storage. [2025-10-02T18:20:14.649837] [INFO ] [MAIN ] CYD: Loaded 26522 existing records. [2025-10-02T18:20:14.683293] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-02T18:20:14.848042] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:20:14.848285] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-02T18:20:14.848332] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-02T18:20:14.849282] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-02T18:20:14.849344] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-02T18:20:15.238667] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:20:15.473003] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-02T18:20:15.629218] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:20:16.044512] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T18:20:16.273006] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-02T18:20:17.072971] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-10-02T18:20:17.265081] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T18:20:17.623587] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T18:20:17.872991] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-02T18:20:18.472636] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T18:20:18.672980] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-02T18:20:19.473050] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-02T18:20:19.698345] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T18:20:20.046060] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:20:20.158283] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T18:20:20.273033] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-02T18:20:21.073018] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-02T18:20:21.669911] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T18:20:21.873003] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-02T18:20:22.641761] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T18:20:22.673036] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-02T18:20:23.324300] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T18:20:23.473015] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-02T18:20:23.772696] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T18:20:24.273017] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-02T18:20:24.872958] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T18:20:25.073028] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-02T18:20:25.630030] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T18:20:25.631815] [INFO ] [REMOTE ] CXT: Full fetch complete (45298 records). [2025-10-02T18:20:25.631975] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-02T18:20:25.633085] [FATAL] [VALIDATOR ] CXT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:20:25.633206] [FATAL] [MAIN ] CXT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:20:25.633290] [WARN ] [MAIN ] CXT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:20:25.633383] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-02T18:20:25.633487] [DEBUG] [LOCAL ] CXT: No primary data file found to delete. [2025-10-02T18:20:25.633556] [INFO ] [LOCAL ] CXT: Starting deletion of derivative data. [2025-10-02T18:20:25.634124] [DEBUG] [LOCAL ] CXT: Deleted derivative data file. [2025-10-02T18:20:25.634254] [INFO ] [MAIN ] Update Progress: 579/2370 symbols completed. CXT took 30.9s. Estimated remaining: 4h 8m 35s. Rate: 7.2 symbols/min [2025-10-02T18:20:25.878321] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-02T18:20:25.884345] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:20:25.939975] [DEBUG] [LOCAL ] CYH: Loaded 47530 existing records from primary storage. [2025-10-02T18:20:25.940603] [INFO ] [MAIN ] CYH: Loaded 47530 existing records. [2025-10-02T18:20:26.240546] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:20:26.241020] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-02T18:20:26.241126] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-02T18:20:26.242812] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-02T18:20:26.242893] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-02T18:20:26.639236] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T18:20:26.683623] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-02T18:20:26.907926] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:20:27.472986] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-10-02T18:20:27.577543] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T18:20:28.273034] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-02T18:20:28.565697] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-02T18:20:29.073007] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-02T18:20:29.371278] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T18:20:29.865931] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T18:20:29.876206] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-02T18:20:30.497577] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T18:20:30.672997] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-02T18:20:31.472971] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-02T18:20:31.572216] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:20:32.255063] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T18:20:32.272970] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-02T18:20:32.705914] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T18:20:33.073045] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-02T18:20:33.726262] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T18:20:33.873008] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-02T18:20:34.678507] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-02T18:20:34.684481] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T18:20:35.374577] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T18:20:35.473035] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-02T18:20:36.052426] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T18:20:36.054439] [INFO ] [REMOTE ] CXW: Full fetch complete (64847 records). [2025-10-02T18:20:36.054591] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-02T18:20:36.280625] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-02T18:20:36.498669] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-02T18:20:36.498851] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-02T18:20:36.499948] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-02T18:20:36.500020] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-02T18:20:36.501973] [DEBUG] [LOCAL ] CXW: Trimmed 64847 records to 44355 (keeping 200 days of data) [2025-10-02T18:20:36.783793] [DEBUG] [LOCAL ] CXW: Primary data saved (44355 records). [2025-10-02T18:20:36.783928] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-02T18:20:36.785470] [INFO ] [MAIN ] Update Progress: 580/2370 symbols completed. CXW took 31.5s. Estimated remaining: 4h 8m 36s. Rate: 7.2 symbols/min [2025-10-02T18:20:36.976581] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:20:36.976941] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-10-02T18:20:36.977011] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-10-02T18:20:36.977165] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-02T18:20:36.977210] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-02T18:20:36.977254] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-02T18:20:36.977288] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-02T18:20:37.078256] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-02T18:20:37.355514] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T18:20:37.462208] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:20:37.757955] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:20:37.873052] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-02T18:20:38.294900] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T18:20:38.297079] [INFO ] [REMOTE ] CXM: Full fetch complete (68743 records). [2025-10-02T18:20:38.297210] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-02T18:20:38.682933] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-02T18:20:38.749761] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-02T18:20:38.749866] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-02T18:20:38.750859] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-02T18:20:38.750928] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-02T18:20:38.752549] [DEBUG] [LOCAL ] CXM: Trimmed 68743 records to 47964 (keeping 200 days of data) [2025-10-02T18:20:38.983088] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T18:20:39.066256] [DEBUG] [LOCAL ] CXM: Primary data saved (47964 records). [2025-10-02T18:20:39.066403] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-02T18:20:39.066491] [INFO ] [MAIN ] Update Progress: 581/2370 symbols completed. CXM took 45.8s. Estimated remaining: 4h 8m 9s. Rate: 7.2 symbols/min [2025-10-02T18:20:39.245579] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:20:39.260328] [DEBUG] [LOCAL ] DAC: Loaded 12526 existing records from primary storage. [2025-10-02T18:20:39.260585] [INFO ] [MAIN ] DAC: Loaded 12526 existing records. [2025-10-02T18:20:39.450455] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:20:39.450699] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-02T18:20:39.450761] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-02T18:20:39.451288] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-02T18:20:39.451351] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-02T18:20:39.483883] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-02T18:20:39.875661] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:20:40.156544] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T18:20:40.273036] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-10-02T18:20:40.814926] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T18:20:41.073024] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-02T18:20:41.406746] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T18:20:41.873005] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-02T18:20:42.455956] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T18:20:42.672974] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-10-02T18:20:43.051587] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T18:20:43.473015] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-02T18:20:44.272997] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-02T18:20:44.785045] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-02T18:20:45.053451] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T18:20:45.072971] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-02T18:20:45.312340] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T18:20:45.873017] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-02T18:20:46.523055] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:20:46.673003] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-02T18:20:47.466194] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T18:20:47.472902] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-02T18:20:47.617325] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-02T18:20:48.273039] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-02T18:20:48.423013] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T18:20:49.073047] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-02T18:20:49.163097] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-02T18:20:49.873003] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-02T18:20:50.191760] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T18:20:50.193156] [INFO ] [REMOTE ] CYD: Full fetch complete (33328 records). [2025-10-02T18:20:50.193247] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-02T18:20:50.607705] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-10-02T18:20:50.607811] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-10-02T18:20:50.608430] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-10-02T18:20:50.608498] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-10-02T18:20:50.609593] [DEBUG] [LOCAL ] CYD: Trimmed 33328 records to 26748 (keeping 200 days of data) [2025-10-02T18:20:50.673935] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-02T18:20:50.783387] [DEBUG] [LOCAL ] CYD: Primary data saved (26748 records). [2025-10-02T18:20:50.783532] [INFO ] [MAIN ] CYD: Full history saved. [2025-10-02T18:20:50.783619] [INFO ] [MAIN ] Update Progress: 582/2370 symbols completed. CYD took 36.4s. Estimated remaining: 4h 8m 11s. Rate: 7.2 symbols/min [2025-10-02T18:20:50.979684] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:20:51.036193] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-10-02T18:20:51.036675] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-10-02T18:20:51.238486] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:20:51.239193] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-02T18:20:51.239244] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-02T18:20:51.241120] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-10-02T18:20:51.241185] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-02T18:20:51.480582] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-02T18:20:51.641780] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:20:51.737365] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T18:20:51.882275] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T18:20:52.272998] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-02T18:20:53.072133] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T18:20:53.075312] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-02T18:20:53.267886] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T18:20:53.873029] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-02T18:20:54.672974] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-10-02T18:20:54.839148] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T18:20:55.473100] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-02T18:20:55.858031] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-02T18:20:56.115205] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T18:20:56.273009] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-02T18:20:56.852763] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T18:20:56.986918] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-10-02T18:20:57.073021] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-02T18:20:57.872997] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-02T18:20:58.344287] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T18:20:58.672986] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-02T18:20:58.692249] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-02T18:20:59.473043] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-02T18:20:59.833727] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T18:20:59.835716] [INFO ] [REMOTE ] CYH: Full fetch complete (69977 records). [2025-10-02T18:20:59.835827] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-02T18:21:00.275491] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-02T18:21:00.276538] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-02T18:21:00.276600] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-02T18:21:00.277549] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-02T18:21:00.277733] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-02T18:21:00.279454] [DEBUG] [LOCAL ] CYH: Trimmed 69977 records to 47856 (keeping 200 days of data) [2025-10-02T18:21:00.576225] [DEBUG] [LOCAL ] CYH: Primary data saved (47856 records). [2025-10-02T18:21:00.576440] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-02T18:21:00.576693] [INFO ] [MAIN ] Update Progress: 583/2370 symbols completed. CYH took 34.9s. Estimated remaining: 4h 8m 7s. Rate: 7.2 symbols/min [2025-10-02T18:21:00.766876] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:21:00.823717] [DEBUG] [LOCAL ] DAN: Loaded 48976 existing records from primary storage. [2025-10-02T18:21:00.824097] [INFO ] [MAIN ] DAN: Loaded 48976 existing records. [2025-10-02T18:21:01.026983] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:21:01.027359] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-02T18:21:01.027729] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-02T18:21:01.029505] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-02T18:21:01.029584] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-02T18:21:01.078184] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-02T18:21:01.170547] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T18:21:01.243324] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T18:21:01.530160] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:21:01.873002] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-10-02T18:21:02.672972] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-02T18:21:02.826884] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T18:21:03.473007] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-02T18:21:03.752146] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T18:21:04.273014] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-02T18:21:04.575326] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T18:21:05.072998] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-02T18:21:05.387716] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-02T18:21:05.732554] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T18:21:05.733692] [INFO ] [REMOTE ] DAC: Full fetch complete (19359 records). [2025-10-02T18:21:05.733782] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-02T18:21:05.734363] [FATAL] [VALIDATOR ] DAC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:21:05.734461] [FATAL] [MAIN ] DAC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:21:05.734509] [WARN ] [MAIN ] DAC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:21:05.734603] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-02T18:21:05.734763] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-10-02T18:21:05.734821] [INFO ] [LOCAL ] DAC: Starting deletion of derivative data. [2025-10-02T18:21:05.735219] [DEBUG] [LOCAL ] DAC: Deleted derivative data file. [2025-10-02T18:21:05.735324] [INFO ] [MAIN ] Update Progress: 584/2370 symbols completed. DAC took 26.7s. Estimated remaining: 4h 7m 49s. Rate: 7.2 symbols/min [2025-10-02T18:21:05.875210] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-02T18:21:05.935611] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:21:05.967708] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T18:21:05.995507] [DEBUG] [LOCAL ] DAO: Loaded 20913 existing records from primary storage. [2025-10-02T18:21:05.995815] [INFO ] [MAIN ] DAO: Loaded 20913 existing records. [2025-10-02T18:21:06.190442] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:21:06.190615] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-02T18:21:06.190761] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-02T18:21:06.191621] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-02T18:21:06.191721] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-02T18:21:06.584571] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:21:06.672982] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-10-02T18:21:07.473003] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-02T18:21:07.924181] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T18:21:08.264771] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-10-02T18:21:08.275516] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-02T18:21:08.896074] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T18:21:09.072996] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-02T18:21:09.872987] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-02T18:21:10.236182] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-02T18:21:10.672979] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-02T18:21:11.449677] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-02T18:21:11.472948] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-02T18:21:11.568906] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T18:21:11.622238] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T18:21:12.272987] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-02T18:21:13.073012] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-02T18:21:13.792009] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-02T18:21:13.872529] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T18:21:13.876501] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-02T18:21:14.035161] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T18:21:14.672981] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-02T18:21:15.472995] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-02T18:21:16.091706] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-02T18:21:16.273046] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-02T18:21:16.396998] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T18:21:17.069543] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T18:21:17.076825] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-02T18:21:17.873043] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-02T18:21:18.594478] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-02T18:21:18.643957] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T18:21:18.672962] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-02T18:21:19.377332] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:21:19.473005] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-02T18:21:20.097012] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-02T18:21:20.273000] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-02T18:21:21.072977] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-02T18:21:21.379713] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T18:21:21.558565] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T18:21:21.873022] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-02T18:21:22.673016] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-02T18:21:22.723206] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T18:21:23.473035] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-02T18:21:23.802847] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T18:21:24.078096] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-02T18:21:24.272966] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-02T18:21:24.467055] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T18:21:25.073035] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-02T18:21:25.872972] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-02T18:21:26.141779] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T18:21:26.672997] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-02T18:21:26.751860] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T18:21:27.473020] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-02T18:21:27.581613] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T18:21:27.980344] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T18:21:28.273002] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-02T18:21:28.559430] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T18:21:28.561032] [INFO ] [REMOTE ] DAN: Full fetch complete (70470 records). [2025-10-02T18:21:28.561246] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-02T18:21:28.562200] [FATAL] [VALIDATOR ] DAN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:21:28.562299] [FATAL] [MAIN ] DAN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:21:28.562373] [WARN ] [MAIN ] DAN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:21:28.562454] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-02T18:21:28.562522] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-02T18:21:28.562561] [INFO ] [LOCAL ] DAN: Starting deletion of derivative data. [2025-10-02T18:21:28.562964] [DEBUG] [LOCAL ] DAN: Deleted derivative data file. [2025-10-02T18:21:28.563102] [INFO ] [MAIN ] Update Progress: 585/2370 symbols completed. DAN took 28.0s. Estimated remaining: 4h 8m 25s. Rate: 7.2 symbols/min [2025-10-02T18:21:28.757228] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:21:28.810441] [DEBUG] [LOCAL ] DAR: Loaded 51846 existing records from primary storage. [2025-10-02T18:21:28.810876] [INFO ] [MAIN ] DAR: Loaded 51846 existing records. [2025-10-02T18:21:29.023561] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:21:29.023843] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-02T18:21:29.023895] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-02T18:21:29.025355] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-02T18:21:29.025430] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-02T18:21:29.078107] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-02T18:21:29.453434] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:21:29.486121] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T18:21:29.873060] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-02T18:21:30.672983] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-02T18:21:31.005617] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T18:21:31.104104] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-02T18:21:31.106201] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-10-02T18:21:31.106316] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-02T18:21:31.482221] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-10-02T18:21:31.547337] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-02T18:21:31.547431] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-02T18:21:31.548468] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-02T18:21:31.548547] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-02T18:21:31.550351] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 54143 (keeping 200 days of data) [2025-10-02T18:21:31.919207] [DEBUG] [LOCAL ] DAL: Primary data saved (54143 records). [2025-10-02T18:21:31.919356] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-02T18:21:31.919469] [INFO ] [MAIN ] Update Progress: 586/2370 symbols completed. DAL took 41.1s. Estimated remaining: 4h 8m 1s. Rate: 7.2 symbols/min [2025-10-02T18:21:32.114854] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:21:32.115092] [DEBUG] [LOCAL ] DAVA: No existing data file found in primary storage. [2025-10-02T18:21:32.115146] [WARN ] [MAIN ] DAVA: No existing data found, performing full refresh instead. [2025-10-02T18:21:32.115263] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-02T18:21:32.115309] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-02T18:21:32.115354] [DEBUG] [LOCAL ] DAVA: No primary data file found to delete. [2025-10-02T18:21:32.115389] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-02T18:21:32.278144] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-02T18:21:32.336616] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T18:21:32.413027] [INFO ] [REMOTE ] D: Full fetch complete (77265 records). [2025-10-02T18:21:32.426096] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-02T18:21:32.457264] [FATAL] [VALIDATOR ] D: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:21:32.472842] [FATAL] [MAIN ] D: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:21:32.497978] [WARN ] [MAIN ] D: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:21:32.504230] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-02T18:21:32.529916] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-02T18:21:32.535364] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:21:32.535488] [INFO ] [LOCAL ] D: Starting deletion of derivative data. [2025-10-02T18:21:32.535833] [DEBUG] [LOCAL ] D: No derivative data file found to delete. [2025-10-02T18:21:32.535917] [INFO ] [MAIN ] Update Progress: 587/2370 symbols completed. D took 55.8s. Estimated remaining: 4h 7m 29s. Rate: 7.2 symbols/min [2025-10-02T18:21:32.719622] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:21:32.788521] [DEBUG] [LOCAL ] DAY: Loaded 49528 existing records from primary storage. [2025-10-02T18:21:32.788938] [INFO ] [MAIN ] DAY: Loaded 49528 existing records. [2025-10-02T18:21:32.982542] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:21:32.982778] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-02T18:21:32.982853] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-02T18:21:32.984831] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-02T18:21:32.984895] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-02T18:21:33.081907] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-10-02T18:21:33.104112] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T18:21:33.110974] [INFO ] [REMOTE ] DAO: Full fetch complete (32838 records). [2025-10-02T18:21:33.121461] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-02T18:21:33.155974] [FATAL] [VALIDATOR ] DAO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:21:33.167779] [FATAL] [MAIN ] DAO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:21:33.200030] [WARN ] [MAIN ] DAO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:21:33.258538] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-02T18:21:33.298411] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-10-02T18:21:33.311381] [INFO ] [LOCAL ] DAO: Starting deletion of derivative data. [2025-10-02T18:21:33.337746] [DEBUG] [LOCAL ] DAO: Deleted derivative data file. [2025-10-02T18:21:33.365800] [INFO ] [MAIN ] Update Progress: 588/2370 symbols completed. DAO took 27.6s. Estimated remaining: 4h 6m 58s. Rate: 7.2 symbols/min [2025-10-02T18:21:33.426632] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:21:33.639896] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-02T18:21:33.643556] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:21:33.720860] [DEBUG] [LOCAL ] DB: Loaded 52580 existing records from primary storage. [2025-10-02T18:21:33.721354] [INFO ] [MAIN ] DB: Loaded 52580 existing records. [2025-10-02T18:21:33.878199] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-02T18:21:33.943134] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:21:33.943352] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-02T18:21:33.943411] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-02T18:21:33.944989] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-02T18:21:33.945055] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-02T18:21:34.370282] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:21:34.546891] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:21:34.673001] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-02T18:21:35.473054] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-10-02T18:21:35.601625] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T18:21:35.964589] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T18:21:36.273038] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-02T18:21:37.016053] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T18:21:37.072966] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-02T18:21:37.555110] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T18:21:37.873044] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-02T18:21:38.323243] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T18:21:38.672984] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-02T18:21:39.093094] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-02T18:21:39.472991] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-10-02T18:21:40.272992] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-02T18:21:40.385878] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T18:21:41.073007] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-02T18:21:41.211411] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:21:41.474365] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T18:21:41.873045] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-02T18:21:42.672976] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-02T18:21:42.843574] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:21:43.187064] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T18:21:43.472941] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-02T18:21:44.147980] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T18:21:44.273021] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-02T18:21:45.073012] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-02T18:21:45.136467] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T18:21:45.571288] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T18:21:45.873000] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-02T18:21:46.569426] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:21:46.673028] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-02T18:21:47.474330] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-02T18:21:47.480015] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T18:21:48.272997] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-02T18:21:48.332234] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T18:21:49.073022] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-02T18:21:49.125607] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T18:21:49.832611] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T18:21:49.873014] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-02T18:21:50.678119] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-02T18:21:50.701720] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T18:21:51.379159] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T18:21:51.472994] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-02T18:21:52.273059] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-02T18:21:52.354741] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T18:21:52.879085] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T18:21:53.073034] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-02T18:21:53.610670] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:21:53.873001] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-02T18:21:54.304531] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T18:21:54.672996] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-02T18:21:55.473048] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-02T18:21:55.945781] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-02T18:21:56.272995] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-02T18:21:56.501088] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T18:21:56.609332] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:21:57.073013] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-02T18:21:57.877910] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-02T18:21:57.883752] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T18:21:58.673037] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-02T18:21:58.979487] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T18:21:59.472987] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-02T18:21:59.525364] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T18:22:00.273027] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-02T18:22:00.670950] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T18:22:01.014298] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-02T18:22:01.016877] [INFO ] [REMOTE ] DAVA: Full fetch complete (55967 records). [2025-10-02T18:22:01.017044] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-02T18:22:01.078075] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-02T18:22:01.479843] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-02T18:22:01.479939] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-02T18:22:01.480625] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-02T18:22:01.480711] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-02T18:22:01.482011] [DEBUG] [LOCAL ] DAVA: Trimmed 55967 records to 41312 (keeping 200 days of data) [2025-10-02T18:22:01.794580] [DEBUG] [LOCAL ] DAVA: Primary data saved (41312 records). [2025-10-02T18:22:01.794765] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-02T18:22:01.794862] [INFO ] [MAIN ] Update Progress: 589/2370 symbols completed. DAVA took 29.9s. Estimated remaining: 4h 7m 51s. Rate: 7.2 symbols/min [2025-10-02T18:22:01.875314] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-02T18:22:02.008592] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:02.009263] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-02T18:22:02.009415] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-02T18:22:02.009720] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-02T18:22:02.009837] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-02T18:22:02.009972] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-02T18:22:02.010021] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-02T18:22:02.483988] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:02.479743] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-02T18:22:02.673003] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-02T18:22:03.112523] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T18:22:03.473046] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-02T18:22:03.713486] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T18:22:04.112988] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T18:22:04.116033] [INFO ] [REMOTE ] DAR: Full fetch complete (74632 records). [2025-10-02T18:22:04.116221] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-02T18:22:04.275922] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-02T18:22:04.649907] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-02T18:22:04.650085] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-02T18:22:04.650953] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-02T18:22:04.651018] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-02T18:22:04.652623] [DEBUG] [LOCAL ] DAR: Trimmed 74632 records to 52218 (keeping 200 days of data) [2025-10-02T18:22:04.989564] [DEBUG] [LOCAL ] DAR: Primary data saved (52218 records). [2025-10-02T18:22:04.989762] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-02T18:22:04.989899] [INFO ] [MAIN ] Update Progress: 590/2370 symbols completed. DAR took 36.4s. Estimated remaining: 4h 7m 27s. Rate: 7.2 symbols/min [2025-10-02T18:22:05.073912] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-10-02T18:22:05.182865] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:05.226296] [DEBUG] [LOCAL ] DBI: Loaded 44591 existing records from primary storage. [2025-10-02T18:22:05.226627] [INFO ] [MAIN ] DBI: Loaded 44591 existing records. [2025-10-02T18:22:05.433330] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:22:05.433819] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-02T18:22:05.433900] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-02T18:22:05.435401] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-02T18:22:05.435468] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-02T18:22:05.565345] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-02T18:22:05.879855] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-02T18:22:05.950604] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:05.982215] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T18:22:06.098111] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T18:22:06.673005] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-02T18:22:07.473009] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-10-02T18:22:08.055114] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-10-02T18:22:08.166462] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T18:22:08.168375] [INFO ] [REMOTE ] DAY: Full fetch complete (71573 records). [2025-10-02T18:22:08.168520] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-02T18:22:08.278906] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-02T18:22:08.609590] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-02T18:22:08.609700] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-02T18:22:08.610552] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-02T18:22:08.610617] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-02T18:22:08.612140] [DEBUG] [LOCAL ] DAY: Trimmed 71573 records to 49792 (keeping 200 days of data) [2025-10-02T18:22:08.934415] [DEBUG] [LOCAL ] DAY: Primary data saved (49792 records). [2025-10-02T18:22:08.934713] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-02T18:22:08.935712] [INFO ] [MAIN ] Update Progress: 591/2370 symbols completed. DAY took 36.4s. Estimated remaining: 4h 7m 5s. Rate: 7.2 symbols/min [2025-10-02T18:22:09.078158] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-02T18:22:09.136094] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:09.137387] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-10-02T18:22:09.137556] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-10-02T18:22:09.137753] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-02T18:22:09.137801] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-02T18:22:09.137862] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-10-02T18:22:09.137939] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-02T18:22:09.288888] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T18:22:09.594068] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-02T18:22:09.600939] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:09.873000] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-02T18:22:10.662909] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T18:22:10.664620] [INFO ] [REMOTE ] DB: Full fetch complete (74224 records). [2025-10-02T18:22:10.664773] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-02T18:22:10.665628] [FATAL] [VALIDATOR ] DB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:22:10.665785] [FATAL] [MAIN ] DB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:22:10.665847] [WARN ] [MAIN ] DB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:22:10.665929] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-02T18:22:10.666010] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-10-02T18:22:10.666059] [INFO ] [LOCAL ] DB: Starting deletion of derivative data. [2025-10-02T18:22:10.666638] [DEBUG] [LOCAL ] DB: Deleted derivative data file. [2025-10-02T18:22:10.666788] [INFO ] [MAIN ] Update Progress: 592/2370 symbols completed. DB took 37.3s. Estimated remaining: 4h 6m 37s. Rate: 7.2 symbols/min [2025-10-02T18:22:10.682684] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-02T18:22:10.864329] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:10.914516] [DEBUG] [LOCAL ] DBRG: Loaded 49736 existing records from primary storage. [2025-10-02T18:22:10.914912] [INFO ] [MAIN ] DBRG: Loaded 49736 existing records. [2025-10-02T18:22:11.116097] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:22:11.116436] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-02T18:22:11.116613] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-02T18:22:11.119032] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-02T18:22:11.119096] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-02T18:22:11.477354] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-10-02T18:22:11.518390] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T18:22:11.553127] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:11.640716] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T18:22:12.272988] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-02T18:22:12.404079] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T18:22:13.072996] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-02T18:22:13.310945] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T18:22:13.805459] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T18:22:13.873029] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-02T18:22:14.673056] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-02T18:22:15.155674] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T18:22:15.393290] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T18:22:15.472996] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-02T18:22:16.273020] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-02T18:22:16.297496] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T18:22:17.073022] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-10-02T18:22:17.778374] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T18:22:17.872972] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-02T18:22:18.624835] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T18:22:18.672966] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-02T18:22:19.446101] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-02T18:22:19.473014] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-02T18:22:19.717506] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T18:22:20.273019] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-02T18:22:21.073038] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-02T18:22:21.129617] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T18:22:21.470448] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-02T18:22:21.866573] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T18:22:21.872970] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-02T18:22:22.452738] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T18:22:22.673049] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-02T18:22:23.473056] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-02T18:22:24.153889] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-02T18:22:24.273011] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-02T18:22:24.318544] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T18:22:25.073019] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-02T18:22:25.385189] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T18:22:25.794896] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-02T18:22:25.872999] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-02T18:22:26.611275] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T18:22:26.673255] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-02T18:22:27.473015] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-02T18:22:27.995090] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T18:22:28.273071] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-02T18:22:28.895629] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T18:22:28.896900] [INFO ] [REMOTE ] DBL: Full fetch complete (12557 records). [2025-10-02T18:22:28.897006] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-02T18:22:29.064765] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T18:22:29.077832] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-02T18:22:29.387520] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-02T18:22:29.387609] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-02T18:22:29.387976] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-02T18:22:29.388068] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-02T18:22:29.388693] [DEBUG] [LOCAL ] DBL: Trimmed 12557 records to 9352 (keeping 200 days of data) [2025-10-02T18:22:29.452337] [DEBUG] [LOCAL ] DBL: Primary data saved (9352 records). [2025-10-02T18:22:29.452496] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-02T18:22:29.452611] [INFO ] [MAIN ] Update Progress: 593/2370 symbols completed. DBL took 20.5s. Estimated remaining: 4h 7m 0s. Rate: 7.2 symbols/min [2025-10-02T18:22:29.645261] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:29.684824] [DEBUG] [LOCAL ] DCI: Loaded 37344 existing records from primary storage. [2025-10-02T18:22:29.685171] [INFO ] [MAIN ] DCI: Loaded 37344 existing records. [2025-10-02T18:22:29.898340] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-02T18:22:29.907475] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:22:29.908805] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-02T18:22:29.908872] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-02T18:22:29.910234] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-02T18:22:29.910299] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-02T18:22:30.302753] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:30.673066] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-02T18:22:30.998828] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T18:22:31.175998] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-02T18:22:31.473073] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-10-02T18:22:32.273006] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-02T18:22:32.332202] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T18:22:32.749394] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T18:22:33.064131] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T18:22:33.072966] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-02T18:22:33.835962] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T18:22:33.837068] [INFO ] [REMOTE ] DBD: Full fetch complete (30817 records). [2025-10-02T18:22:33.837147] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-02T18:22:33.837666] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:22:33.837760] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:22:33.837807] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:22:33.837928] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-02T18:22:33.838038] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-02T18:22:33.838097] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-02T18:22:33.838164] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-02T18:22:33.838247] [INFO ] [MAIN ] Update Progress: 594/2370 symbols completed. DBD took 32.0s. Estimated remaining: 4h 6m 40s. Rate: 7.2 symbols/min [2025-10-02T18:22:33.878108] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-02T18:22:34.028162] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:34.045244] [DEBUG] [LOCAL ] DCO: Loaded 13871 existing records from primary storage. [2025-10-02T18:22:34.045563] [INFO ] [MAIN ] DCO: Loaded 13871 existing records. [2025-10-02T18:22:34.253320] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:22:34.253560] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-02T18:22:34.253631] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-02T18:22:34.254238] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-10-02T18:22:34.254302] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-02T18:22:34.678270] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-02T18:22:34.684330] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:35.473000] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-10-02T18:22:35.716800] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T18:22:36.072251] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T18:22:36.240573] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T18:22:36.272960] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-02T18:22:37.066231] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-02T18:22:37.072944] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-02T18:22:37.611818] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T18:22:37.873068] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-02T18:22:38.673021] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-02T18:22:39.270089] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T18:22:39.473054] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-02T18:22:39.982245] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T18:22:40.273007] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-02T18:22:41.072990] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-02T18:22:41.218388] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T18:22:41.287379] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T18:22:41.873060] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-02T18:22:42.584243] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T18:22:42.619578] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T18:22:42.673051] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-02T18:22:43.473021] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-02T18:22:43.552339] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T18:22:44.273028] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-02T18:22:44.630911] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T18:22:45.073002] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-02T18:22:45.115490] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-02T18:22:45.872979] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-02T18:22:46.550215] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T18:22:46.672998] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-02T18:22:47.478379] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-02T18:22:47.490974] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T18:22:47.557153] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T18:22:47.559090] [INFO ] [REMOTE ] DBI: Full fetch complete (65809 records). [2025-10-02T18:22:47.559228] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-02T18:22:47.989601] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-02T18:22:47.989728] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-02T18:22:47.990633] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-02T18:22:47.990734] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-02T18:22:47.992504] [DEBUG] [LOCAL ] DBI: Trimmed 65809 records to 44841 (keeping 200 days of data) [2025-10-02T18:22:48.267085] [DEBUG] [LOCAL ] DBI: Primary data saved (44841 records). [2025-10-02T18:22:48.267220] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-02T18:22:48.267333] [INFO ] [MAIN ] Update Progress: 595/2370 symbols completed. DBI took 43.3s. Estimated remaining: 4h 6m 50s. Rate: 7.2 symbols/min [2025-10-02T18:22:48.279821] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-02T18:22:48.460109] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:22:48.516304] [DEBUG] [LOCAL ] DD: Loaded 52826 existing records from primary storage. [2025-10-02T18:22:48.516670] [INFO ] [MAIN ] DD: Loaded 52826 existing records. [2025-10-02T18:22:48.733169] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:22:48.733561] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-02T18:22:48.733706] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-02T18:22:48.735565] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-02T18:22:48.735636] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-02T18:22:49.075419] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-02T18:22:49.205846] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:22:49.208513] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T18:22:49.229904] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T18:22:49.873033] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-02T18:22:50.486099] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T18:22:50.673038] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-02T18:22:50.866351] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T18:22:51.473028] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-02T18:22:52.117817] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:22:52.273009] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-02T18:22:53.073007] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-10-02T18:22:53.873003] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-02T18:23:05.037576] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (13.56 seconds). [2025-10-02T18:23:05.042856] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-02T18:23:05.625548] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (12.55 seconds). [2025-10-02T18:23:05.637144] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-02T18:23:05.685208] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (11.81 seconds). [2025-10-02T18:23:05.693501] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-02T18:23:06.090379] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (13.82 seconds). [2025-10-02T18:23:06.102856] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-02T18:23:06.490560] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T18:23:06.495004] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-02T18:23:07.384584] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T18:23:07.395587] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-02T18:23:08.104721] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-02T18:23:08.108710] [INFO ] [REMOTE ] DCO: Full fetch complete (19112 records). [2025-10-02T18:23:08.108502] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-02T18:23:08.120239] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-02T18:23:08.140316] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-02T18:23:08.159182] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-02T18:23:08.236824] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-02T18:23:08.560072] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-10-02T18:23:08.560146] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-10-02T18:23:08.560538] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-10-02T18:23:08.560580] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-10-02T18:23:08.561172] [DEBUG] [LOCAL ] DCO: Trimmed 19112 records to 13948 (keeping 200 days of data) [2025-10-02T18:23:08.650660] [DEBUG] [LOCAL ] DCO: Primary data saved (13948 records). [2025-10-02T18:23:08.650817] [INFO ] [MAIN ] DCO: Full history saved. [2025-10-02T18:23:08.650909] [INFO ] [MAIN ] Update Progress: 596/2370 symbols completed. DCO took 34.8s. Estimated remaining: 4h 7m 17s. Rate: 7.2 symbols/min [2025-10-02T18:23:08.842275] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:08.900283] [DEBUG] [LOCAL ] DDD: Loaded 50889 existing records from primary storage. [2025-10-02T18:23:08.900701] [INFO ] [MAIN ] DDD: Loaded 50889 existing records. [2025-10-02T18:23:09.120682] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:09.121032] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-02T18:23:09.121181] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-02T18:23:09.122807] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-02T18:23:09.122871] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-02T18:23:09.206699] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:23:09.246346] [INFO ] [REMOTE ] DBRG: Full fetch complete (71963 records). [2025-10-02T18:23:09.247072] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-02T18:23:09.279361] [FATAL] [VALIDATOR ] DBRG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:23:09.279694] [FATAL] [MAIN ] DBRG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:23:09.279778] [WARN ] [MAIN ] DBRG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:23:09.279867] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-02T18:23:09.279986] [DEBUG] [LOCAL ] DBRG: No primary data file found to delete. [2025-10-02T18:23:09.325217] [INFO ] [LOCAL ] DBRG: Starting deletion of derivative data. [2025-10-02T18:23:09.364566] [DEBUG] [LOCAL ] DBRG: Deleted derivative data file. [2025-10-02T18:23:09.389782] [INFO ] [MAIN ] Update Progress: 597/2370 symbols completed. DBRG took 58.7s. Estimated remaining: 4h 6m 46s. Rate: 7.2 symbols/min [2025-10-02T18:23:09.409122] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-02T18:23:09.487166] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-02T18:23:09.586503] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:09.586909] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-10-02T18:23:09.903146] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T18:23:09.912572] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-02T18:23:11.125401] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T18:23:11.137236] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-02T18:23:11.260273] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T18:23:11.269535] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-02T18:23:11.591492] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-10-02T18:23:11.602586] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-02T18:23:12.256432] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-02T18:23:12.258062] [INFO ] [REMOTE ] DCI: Full fetch complete (53667 records). [2025-10-02T18:23:12.258185] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-02T18:23:12.258905] [FATAL] [VALIDATOR ] DCI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:23:12.258994] [FATAL] [MAIN ] DCI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:23:12.259040] [WARN ] [MAIN ] DCI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:23:12.259083] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-02T18:23:12.259141] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-02T18:23:12.259230] [INFO ] [LOCAL ] DCI: Starting deletion of derivative data. [2025-10-02T18:23:12.259695] [DEBUG] [LOCAL ] DCI: Deleted derivative data file. [2025-10-02T18:23:12.260107] [INFO ] [MAIN ] Update Progress: 598/2370 symbols completed. DCI took 42.8s. Estimated remaining: 4h 6m 22s. Rate: 7.2 symbols/min [2025-10-02T18:23:12.686547] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T18:23:12.698078] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-02T18:23:13.046344] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T18:23:13.057408] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-02T18:23:14.180509] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T18:23:14.192213] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-02T18:23:14.409017] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T18:23:14.419555] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-02T18:23:16.035997] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T18:23:16.047561] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-02T18:23:16.123167] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T18:23:16.135024] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-02T18:23:17.838178] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:23:17.851407] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-02T18:23:17.886594] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:23:17.899263] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-02T18:23:19.740184] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T18:23:19.752250] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-02T18:23:19.804919] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T18:23:19.816301] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-02T18:23:21.474831] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T18:23:21.487914] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-02T18:23:21.595001] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T18:23:21.606268] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-02T18:23:23.012447] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T18:23:23.015268] [INFO ] [REMOTE ] DD: Full fetch complete (76335 records). [2025-10-02T18:23:23.015437] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-02T18:23:23.480601] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-02T18:23:23.480750] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-02T18:23:23.481796] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-02T18:23:23.481896] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-02T18:23:23.515798] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T18:23:23.514183] [DEBUG] [LOCAL ] DD: Trimmed 76335 records to 53213 (keeping 200 days of data) [2025-10-02T18:23:23.527971] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-02T18:23:23.878302] [DEBUG] [LOCAL ] DD: Primary data saved (53213 records). [2025-10-02T18:23:23.878452] [INFO ] [MAIN ] DD: Full history saved. [2025-10-02T18:23:23.878535] [INFO ] [MAIN ] Update Progress: 599/2370 symbols completed. DD took 35.6s. Estimated remaining: 4h 6m 23s. Rate: 7.2 symbols/min [2025-10-02T18:23:25.509729] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T18:23:25.527390] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-02T18:23:27.134053] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T18:23:27.146121] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-02T18:23:28.807050] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T18:23:28.809235] [INFO ] [REMOTE ] DDD: Full fetch complete (73693 records). [2025-10-02T18:23:28.809377] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-02T18:23:29.248595] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-02T18:23:29.248729] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-02T18:23:29.249564] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-02T18:23:29.249614] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-02T18:23:29.251247] [DEBUG] [LOCAL ] DDD: Trimmed 73693 records to 51270 (keeping 200 days of data) [2025-10-02T18:23:29.564265] [DEBUG] [LOCAL ] DDD: Primary data saved (51270 records). [2025-10-02T18:23:29.564427] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-02T18:23:29.564515] [INFO ] [MAIN ] Update Progress: 600/2370 symbols completed. DDD took 20.9s. Estimated remaining: 4h 6m 7s. Rate: 7.2 symbols/min [2025-10-02T18:23:30.275058] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:30.430293] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:30.556619] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:30.559168] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:30.562859] [DEBUG] [LOCAL ] DDT: Loaded 2079 existing records from primary storage. [2025-10-02T18:23:30.563266] [INFO ] [MAIN ] DDT: Loaded 2079 existing records. [2025-10-02T18:23:30.700136] [DEBUG] [LOCAL ] DDS: Loaded 13050 existing records from primary storage. [2025-10-02T18:23:30.715502] [INFO ] [MAIN ] DDS: Loaded 13050 existing records. [2025-10-02T18:23:30.856878] [DEBUG] [LOCAL ] DDL: Loaded 36749 existing records from primary storage. [2025-10-02T18:23:30.855914] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:30.889880] [INFO ] [MAIN ] DDL: Loaded 36749 existing records. [2025-10-02T18:23:30.896703] [DEBUG] [LOCAL ] DE: Loaded 47563 existing records from primary storage. [2025-10-02T18:23:30.922214] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-02T18:23:30.944584] [INFO ] [MAIN ] DE: Loaded 47563 existing records. [2025-10-02T18:23:30.949854] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-02T18:23:31.097764] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-02T18:23:31.168881] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-02T18:23:31.194464] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:31.318735] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-02T18:23:31.360335] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-02T18:23:31.533781] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:31.530259] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-02T18:23:31.565113] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-02T18:23:31.565037] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-02T18:23:31.654635] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-02T18:23:31.736601] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-10-02T18:23:31.803099] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-02T18:23:31.809256] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:31.876315] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-02T18:23:31.939141] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-02T18:23:32.058818] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-02T18:23:32.085669] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-02T18:23:32.721230] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:32.819355] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-10-02T18:23:32.988970] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:33.032787] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-10-02T18:23:33.226027] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:33.242134] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-10-02T18:23:33.286441] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:33.286873] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-10-02T18:23:33.493001] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-02T18:23:33.494210] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-02T18:23:33.898364] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T18:23:33.902227] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-02T18:23:33.945217] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-02T18:23:33.946899] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-02T18:23:34.393864] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:23:34.395480] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-02T18:23:34.664970] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T18:23:34.668608] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-02T18:23:34.751779] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:23:34.762086] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-02T18:23:34.855946] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-02T18:23:34.857238] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-02T18:23:35.031950] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T18:23:35.041507] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-02T18:23:35.435042] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T18:23:35.436753] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-02T18:23:35.631246] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T18:23:35.634746] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-02T18:23:35.731067] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-02T18:23:35.732267] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-02T18:23:36.174446] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T18:23:36.175722] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-02T18:23:36.212811] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T18:23:36.220603] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-02T18:23:36.297710] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T18:23:36.309256] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-02T18:23:36.391049] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T18:23:36.395009] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-02T18:23:36.699414] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-02T18:23:36.700974] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-02T18:23:37.158168] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T18:23:37.159270] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-02T18:23:37.283202] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T18:23:37.291065] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-02T18:23:37.485943] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T18:23:37.495901] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-02T18:23:37.577357] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-02T18:23:37.578597] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-02T18:23:37.647739] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T18:23:37.653812] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-02T18:23:37.985551] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T18:23:37.986480] [INFO ] [REMOTE ] DDT: Full fetch complete (2902 records). [2025-10-02T18:23:37.986577] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-02T18:23:38.418451] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-02T18:23:38.418561] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-02T18:23:38.418745] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-02T18:23:38.418909] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-02T18:23:38.419625] [DEBUG] [LOCAL ] DDT: Trimmed 2902 records to 2086 (keeping 200 days of data) [2025-10-02T18:23:38.462517] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T18:23:38.463261] [DEBUG] [LOCAL ] DDT: Primary data saved (2086 records). [2025-10-02T18:23:38.472297] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-02T18:23:38.472455] [INFO ] [MAIN ] Update Progress: 601/2370 symbols completed. DDT took 8.9s. Estimated remaining: 4h 6m 0s. Rate: 7.2 symbols/min [2025-10-02T18:23:38.478347] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-02T18:23:38.666972] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:38.678605] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-02T18:23:38.682850] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-02T18:23:38.722749] [DEBUG] [LOCAL ] DEA: Loaded 40853 existing records from primary storage. [2025-10-02T18:23:38.723078] [INFO ] [MAIN ] DEA: Loaded 40853 existing records. [2025-10-02T18:23:38.930126] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:38.930521] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-02T18:23:38.930592] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-02T18:23:38.931906] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-02T18:23:38.931985] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-02T18:23:39.366426] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:39.402073] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T18:23:39.423768] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T18:23:39.473071] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-10-02T18:23:40.109348] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T18:23:40.273023] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-02T18:23:41.073095] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-02T18:23:41.076538] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T18:23:41.709841] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T18:23:41.750133] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-02T18:23:41.873039] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-02T18:23:42.617823] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T18:23:42.673024] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-02T18:23:43.473081] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-02T18:23:44.110054] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T18:23:44.166319] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-02T18:23:44.273189] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-02T18:23:45.073067] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-02T18:23:45.873006] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-02T18:23:46.202930] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T18:23:46.240877] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T18:23:46.673039] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-02T18:23:47.164127] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T18:23:47.165164] [INFO ] [REMOTE ] DDS: Full fetch complete (18977 records). [2025-10-02T18:23:47.165274] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-02T18:23:47.165898] [FATAL] [VALIDATOR ] DDS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:23:47.165985] [FATAL] [MAIN ] DDS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:23:47.166030] [WARN ] [MAIN ] DDS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:23:47.166098] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-02T18:23:47.166163] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-10-02T18:23:47.166202] [INFO ] [LOCAL ] DDS: Starting deletion of derivative data. [2025-10-02T18:23:47.166531] [DEBUG] [LOCAL ] DDS: Deleted derivative data file. [2025-10-02T18:23:47.166628] [INFO ] [MAIN ] Update Progress: 602/2370 symbols completed. DDS took 17.6s. Estimated remaining: 4h 5m 53s. Rate: 7.2 symbols/min [2025-10-02T18:23:47.369934] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:23:47.411301] [DEBUG] [LOCAL ] DEC: Loaded 30451 existing records from primary storage. [2025-10-02T18:23:47.411628] [INFO ] [MAIN ] DEC: Loaded 30451 existing records. [2025-10-02T18:23:47.479437] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-02T18:23:47.608565] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:23:47.608830] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-02T18:23:47.608880] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-02T18:23:47.609830] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-02T18:23:47.609891] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-02T18:23:48.005635] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:23:48.036932] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T18:23:48.273005] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-10-02T18:23:49.073016] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-02T18:23:49.118534] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T18:23:49.616058] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T18:23:49.872996] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-02T18:23:50.428248] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T18:23:50.672969] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-02T18:23:51.130369] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T18:23:51.473037] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-02T18:23:52.273046] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-02T18:23:52.462040] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T18:23:52.501599] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T18:23:53.073000] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-02T18:23:53.563909] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T18:23:53.873008] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-02T18:23:54.020223] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T18:23:54.673051] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-02T18:23:55.423700] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T18:23:55.472983] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-02T18:23:55.946530] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T18:23:56.273004] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-02T18:23:56.884440] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T18:23:57.073024] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-02T18:23:57.873003] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-02T18:23:58.505812] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-02T18:23:58.554415] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T18:23:58.673005] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-02T18:23:59.201092] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T18:23:59.473009] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-02T18:24:00.101826] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T18:24:00.273007] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-02T18:24:00.623689] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T18:24:00.626062] [INFO ] [REMOTE ] DDL: Full fetch complete (53236 records). [2025-10-02T18:24:00.626371] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-02T18:24:01.072759] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-02T18:24:01.072933] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-02T18:24:01.073799] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-02T18:24:01.073879] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-02T18:24:01.072972] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-02T18:24:01.075946] [DEBUG] [LOCAL ] DDL: Trimmed 53236 records to 37057 (keeping 200 days of data) [2025-10-02T18:24:01.315041] [DEBUG] [LOCAL ] DDL: Primary data saved (37057 records). [2025-10-02T18:24:01.315203] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-02T18:24:01.315316] [INFO ] [MAIN ] Update Progress: 603/2370 symbols completed. DDL took 31.7s. Estimated remaining: 4h 6m 2s. Rate: 7.2 symbols/min [2025-10-02T18:24:01.521624] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:01.521924] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-10-02T18:24:01.522007] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-10-02T18:24:01.522135] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-02T18:24:01.522182] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-02T18:24:01.522252] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-02T18:24:01.522316] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-02T18:24:01.873273] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-02T18:24:01.944924] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:02.226935] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T18:24:02.673004] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-10-02T18:24:02.830224] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T18:24:03.075542] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T18:24:03.473018] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-02T18:24:04.272992] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-02T18:24:04.390134] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T18:24:04.720272] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T18:24:05.073045] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-02T18:24:05.831367] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T18:24:05.833403] [INFO ] [REMOTE ] DE: Full fetch complete (69596 records). [2025-10-02T18:24:05.833535] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-02T18:24:05.881114] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-02T18:24:06.282293] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-02T18:24:06.282474] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-02T18:24:06.283320] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-02T18:24:06.283390] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-02T18:24:06.284924] [DEBUG] [LOCAL ] DE: Trimmed 69596 records to 47908 (keeping 200 days of data) [2025-10-02T18:24:06.625908] [DEBUG] [LOCAL ] DE: Primary data saved (47908 records). [2025-10-02T18:24:06.626067] [INFO ] [MAIN ] DE: Full history saved. [2025-10-02T18:24:06.626157] [INFO ] [MAIN ] Update Progress: 604/2370 symbols completed. DE took 37.1s. Estimated remaining: 4h 5m 44s. Rate: 7.2 symbols/min [2025-10-02T18:24:06.675154] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-02T18:24:06.831180] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:06.881286] [DEBUG] [LOCAL ] DEI: Loaded 48359 existing records from primary storage. [2025-10-02T18:24:06.881626] [INFO ] [MAIN ] DEI: Loaded 48359 existing records. [2025-10-02T18:24:07.106891] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:24:07.107782] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-02T18:24:07.108158] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-02T18:24:07.111811] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-02T18:24:07.111920] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-02T18:24:07.222405] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-02T18:24:07.333485] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T18:24:07.478812] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-02T18:24:07.642929] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:07.838056] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-02T18:24:08.273002] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-02T18:24:09.072994] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-02T18:24:09.361441] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T18:24:09.749924] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T18:24:09.872999] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-02T18:24:10.081446] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T18:24:10.085834] [INFO ] [REMOTE ] DEA: Full fetch complete (62192 records). [2025-10-02T18:24:10.086011] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-02T18:24:10.087046] [FATAL] [VALIDATOR ] DEA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:24:10.087154] [FATAL] [MAIN ] DEA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:24:10.087220] [WARN ] [MAIN ] DEA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:24:10.087308] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-02T18:24:10.087401] [DEBUG] [LOCAL ] DEA: No primary data file found to delete. [2025-10-02T18:24:10.087480] [INFO ] [LOCAL ] DEA: Starting deletion of derivative data. [2025-10-02T18:24:10.087930] [DEBUG] [LOCAL ] DEA: Deleted derivative data file. [2025-10-02T18:24:10.088103] [INFO ] [MAIN ] Update Progress: 605/2370 symbols completed. DEA took 31.6s. Estimated remaining: 4h 5m 22s. Rate: 7.2 symbols/min [2025-10-02T18:24:10.285237] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:10.357407] [DEBUG] [LOCAL ] DELL: Loaded 53735 existing records from primary storage. [2025-10-02T18:24:10.357754] [INFO ] [MAIN ] DELL: Loaded 53735 existing records. [2025-10-02T18:24:10.566454] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:24:10.566687] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-02T18:24:10.566748] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-02T18:24:10.569021] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-02T18:24:10.569087] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-02T18:24:10.682561] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-10-02T18:24:10.972170] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:11.473046] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-10-02T18:24:12.086394] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-02T18:24:12.278134] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-02T18:24:12.301806] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T18:24:13.073081] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-02T18:24:13.873048] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-02T18:24:14.001967] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-10-02T18:24:14.041952] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-02T18:24:14.173044] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T18:24:14.673012] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-02T18:24:15.473000] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-02T18:24:15.523856] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T18:24:16.273061] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-02T18:24:16.651472] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T18:24:17.073009] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-02T18:24:17.262738] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-10-02T18:24:17.873001] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-02T18:24:18.181376] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T18:24:18.410899] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T18:24:18.673066] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-02T18:24:18.967443] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T18:24:19.473014] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-02T18:24:20.272999] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-02T18:24:20.729160] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-02T18:24:21.073078] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-02T18:24:21.214803] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T18:24:21.569131] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T18:24:21.873035] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-02T18:24:22.461075] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T18:24:22.463359] [INFO ] [REMOTE ] DEC: Full fetch complete (43318 records). [2025-10-02T18:24:22.463499] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-02T18:24:22.716405] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-02T18:24:22.957116] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-10-02T18:24:22.957209] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-10-02T18:24:22.958070] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-10-02T18:24:22.958134] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-10-02T18:24:22.959565] [DEBUG] [LOCAL ] DEC: Trimmed 43318 records to 30765 (keeping 200 days of data) [2025-10-02T18:24:23.179409] [DEBUG] [LOCAL ] DEC: Primary data saved (30765 records). [2025-10-02T18:24:23.179559] [INFO ] [MAIN ] DEC: Full history saved. [2025-10-02T18:24:23.180558] [INFO ] [MAIN ] Update Progress: 606/2370 symbols completed. DEC took 36.0s. Estimated remaining: 4h 5m 27s. Rate: 7.2 symbols/min [2025-10-02T18:24:23.379777] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:23.379980] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-10-02T18:24:23.380058] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-10-02T18:24:23.380458] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-02T18:24:23.380539] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-02T18:24:23.380672] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-02T18:24:23.380827] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-02T18:24:23.474190] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-02T18:24:23.759816] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T18:24:23.865261] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:24.273047] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-02T18:24:25.058513] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-02T18:24:25.072963] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-02T18:24:25.627420] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T18:24:25.739310] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-10-02T18:24:25.873017] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-02T18:24:26.673061] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-10-02T18:24:26.978692] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T18:24:27.473026] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-02T18:24:28.035944] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-02T18:24:28.273040] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-02T18:24:28.413400] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:24:29.014557] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T18:24:29.073027] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-02T18:24:29.872968] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-02T18:24:30.129419] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T18:24:30.484730] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T18:24:30.673185] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-02T18:24:31.473068] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-02T18:24:32.180716] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-10-02T18:24:32.272974] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-02T18:24:32.464397] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T18:24:32.922693] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T18:24:33.073004] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-02T18:24:33.873040] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-02T18:24:34.525681] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-02T18:24:34.678360] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-02T18:24:34.701827] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T18:24:35.472985] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-02T18:24:35.601817] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:24:36.273023] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-02T18:24:36.494635] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T18:24:36.497009] [INFO ] [REMOTE ] DECK: Full fetch complete (76699 records). [2025-10-02T18:24:36.497206] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-02T18:24:36.937388] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-02T18:24:36.937485] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-02T18:24:36.938454] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-02T18:24:36.938522] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-02T18:24:36.940082] [DEBUG] [LOCAL ] DECK: Trimmed 76699 records to 53683 (keeping 200 days of data) [2025-10-02T18:24:37.073075] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-02T18:24:37.304765] [DEBUG] [LOCAL ] DECK: Primary data saved (53683 records). [2025-10-02T18:24:37.304921] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-02T18:24:37.305100] [INFO ] [MAIN ] Update Progress: 607/2370 symbols completed. DECK took 36.0s. Estimated remaining: 4h 5m 36s. Rate: 7.2 symbols/min [2025-10-02T18:24:37.502182] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:37.534956] [DEBUG] [LOCAL ] DFH: Loaded 32278 existing records from primary storage. [2025-10-02T18:24:37.535288] [INFO ] [MAIN ] DFH: Loaded 32278 existing records. [2025-10-02T18:24:37.737335] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:24:37.738193] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-02T18:24:37.738282] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-02T18:24:37.739454] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-02T18:24:37.739520] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-02T18:24:38.190221] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:38.220977] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-10-02T18:24:38.228274] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-10-02T18:24:38.241290] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T18:24:38.678142] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-02T18:24:38.691770] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T18:24:39.472986] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-02T18:24:39.571387] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T18:24:40.273003] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-02T18:24:40.700252] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-02T18:24:40.711880] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T18:24:40.714706] [INFO ] [REMOTE ] DEI: Full fetch complete (69699 records). [2025-10-02T18:24:40.714858] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-02T18:24:41.078123] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-02T18:24:41.142382] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-02T18:24:41.142470] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-02T18:24:41.143388] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-02T18:24:41.143473] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-02T18:24:41.145437] [DEBUG] [LOCAL ] DEI: Trimmed 69699 records to 48684 (keeping 200 days of data) [2025-10-02T18:24:41.483896] [DEBUG] [LOCAL ] DEI: Primary data saved (48684 records). [2025-10-02T18:24:41.484095] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-02T18:24:41.484270] [INFO ] [MAIN ] Update Progress: 608/2370 symbols completed. DEI took 34.9s. Estimated remaining: 4h 5m 15s. Rate: 7.2 symbols/min [2025-10-02T18:24:41.695705] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:41.720200] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:24:41.750179] [DEBUG] [LOCAL ] DFIN: Loaded 23029 existing records from primary storage. [2025-10-02T18:24:41.750455] [INFO ] [MAIN ] DFIN: Loaded 23029 existing records. [2025-10-02T18:24:41.878094] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-02T18:24:41.946614] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:24:41.946992] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-02T18:24:41.947050] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-02T18:24:41.947877] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-02T18:24:41.947941] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-02T18:24:42.363066] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:42.673029] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-02T18:24:43.251573] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T18:24:43.456925] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-02T18:24:43.472956] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-02T18:24:43.988682] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T18:24:44.273004] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-02T18:24:45.073017] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-10-02T18:24:45.338664] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-02T18:24:45.341375] [INFO ] [REMOTE ] DELL: Full fetch complete (77820 records). [2025-10-02T18:24:45.341495] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-02T18:24:45.817263] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-10-02T18:24:45.817356] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-10-02T18:24:45.818397] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-10-02T18:24:45.818472] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-10-02T18:24:45.820216] [DEBUG] [LOCAL ] DELL: Trimmed 77820 records to 54125 (keeping 200 days of data) [2025-10-02T18:24:45.894757] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-02T18:24:46.129896] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-02T18:24:46.251615] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-02T18:24:46.282317] [DEBUG] [LOCAL ] DELL: Primary data saved (54125 records). [2025-10-02T18:24:46.282450] [INFO ] [MAIN ] DELL: Full history saved. [2025-10-02T18:24:46.282627] [INFO ] [MAIN ] Update Progress: 609/2370 symbols completed. DELL took 36.2s. Estimated remaining: 4h 4m 57s. Rate: 7.2 symbols/min [2025-10-02T18:24:46.468665] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:24:46.481795] [DEBUG] [LOCAL ] DFP: Loaded 11445 existing records from primary storage. [2025-10-02T18:24:46.482047] [INFO ] [MAIN ] DFP: Loaded 11445 existing records. [2025-10-02T18:24:46.675793] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:24:46.676342] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-02T18:24:46.675909] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-02T18:24:46.676456] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-02T18:24:46.678615] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-02T18:24:46.678735] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-02T18:24:47.122877] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:24:47.473020] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-10-02T18:24:47.523327] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T18:24:48.264441] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T18:24:48.275069] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-02T18:24:48.895559] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T18:24:49.073008] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-02T18:24:49.229461] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T18:24:49.873011] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-02T18:24:50.489533] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T18:24:50.673013] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-02T18:24:51.341686] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T18:24:51.469456] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T18:24:51.479775] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-02T18:24:52.272981] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-02T18:24:52.767783] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T18:24:52.792189] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T18:24:53.073020] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-02T18:24:53.859483] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T18:24:53.872974] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-02T18:24:54.673002] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-02T18:24:55.172853] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T18:24:55.473016] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-02T18:24:56.272973] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-02T18:24:56.693182] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T18:24:56.722422] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T18:24:57.073011] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-02T18:24:57.389242] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T18:24:57.872999] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-02T18:24:58.293301] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T18:24:58.673000] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-02T18:24:59.309515] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:24:59.473000] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-02T18:24:59.528331] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-02T18:25:00.272989] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-02T18:25:00.823617] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T18:25:00.825376] [INFO ] [REMOTE ] DEO: Full fetch complete (71126 records). [2025-10-02T18:25:00.825567] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-02T18:25:00.826595] [FATAL] [VALIDATOR ] DEO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:25:00.826735] [FATAL] [MAIN ] DEO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:25:00.826783] [WARN ] [MAIN ] DEO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:25:00.826856] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-02T18:25:00.826948] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-10-02T18:25:00.827012] [INFO ] [LOCAL ] DEO: Starting deletion of derivative data. [2025-10-02T18:25:00.827060] [DEBUG] [LOCAL ] DEO: No derivative data file found to delete. [2025-10-02T18:25:00.827122] [INFO ] [MAIN ] Update Progress: 610/2370 symbols completed. DEO took 37.6s. Estimated remaining: 4h 5m 6s. Rate: 7.2 symbols/min [2025-10-02T18:25:01.015704] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:01.073744] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-02T18:25:01.076012] [DEBUG] [LOCAL ] DG: Loaded 53283 existing records from primary storage. [2025-10-02T18:25:01.076533] [INFO ] [MAIN ] DG: Loaded 53283 existing records. [2025-10-02T18:25:01.283559] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:25:01.283787] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-02T18:25:01.283841] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-02T18:25:01.285594] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-02T18:25:01.285692] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-02T18:25:01.726296] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:01.747343] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T18:25:01.873000] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-10-02T18:25:02.672999] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-02T18:25:03.473056] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-02T18:25:03.569440] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-02T18:25:04.023275] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-02T18:25:04.043477] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T18:25:04.143901] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T18:25:04.273004] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-02T18:25:05.073030] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-02T18:25:05.175799] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-02T18:25:05.873019] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-02T18:25:06.673032] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-02T18:25:06.738888] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-02T18:25:07.012194] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T18:25:07.472992] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-02T18:25:07.651600] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T18:25:08.273020] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-02T18:25:09.073028] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-02T18:25:09.236992] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T18:25:09.312495] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:25:09.873102] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-02T18:25:10.385882] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T18:25:10.673012] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-02T18:25:11.472965] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-02T18:25:11.868251] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T18:25:12.195384] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T18:25:12.272980] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-02T18:25:12.314434] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T18:25:12.315861] [INFO ] [REMOTE ] DFH: Full fetch complete (48642 records). [2025-10-02T18:25:12.315949] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-02T18:25:12.771397] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-02T18:25:12.771494] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-02T18:25:12.772202] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-02T18:25:12.772271] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-02T18:25:12.773502] [DEBUG] [LOCAL ] DFH: Trimmed 48642 records to 32447 (keeping 200 days of data) [2025-10-02T18:25:12.984349] [DEBUG] [LOCAL ] DFH: Primary data saved (32447 records). [2025-10-02T18:25:12.984501] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-02T18:25:12.984588] [INFO ] [MAIN ] Update Progress: 611/2370 symbols completed. DFH took 35.7s. Estimated remaining: 4h 5m 9s. Rate: 7.2 symbols/min [2025-10-02T18:25:13.078250] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-02T18:25:13.186794] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:13.232699] [DEBUG] [LOCAL ] DGX: Loaded 44915 existing records from primary storage. [2025-10-02T18:25:13.233063] [INFO ] [MAIN ] DGX: Loaded 44915 existing records. [2025-10-02T18:25:13.432404] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:25:13.432669] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-02T18:25:13.432735] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-02T18:25:13.434845] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-02T18:25:13.434910] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-02T18:25:13.842992] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:13.872977] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-10-02T18:25:14.236446] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T18:25:14.399398] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-02T18:25:14.673010] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-02T18:25:15.455436] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-02T18:25:15.456487] [INFO ] [REMOTE ] DFP: Full fetch complete (16117 records). [2025-10-02T18:25:15.456572] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-02T18:25:15.480682] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-02T18:25:15.668291] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T18:25:15.914506] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-02T18:25:15.914584] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-02T18:25:15.914989] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-02T18:25:15.915053] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-02T18:25:15.915559] [DEBUG] [LOCAL ] DFP: Trimmed 16117 records to 11492 (keeping 200 days of data) [2025-10-02T18:25:15.988613] [DEBUG] [LOCAL ] DFP: Primary data saved (11492 records). [2025-10-02T18:25:15.988778] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-02T18:25:15.988864] [INFO ] [MAIN ] Update Progress: 612/2370 symbols completed. DFP took 29.7s. Estimated remaining: 4h 4m 45s. Rate: 7.2 symbols/min [2025-10-02T18:25:16.170239] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:16.192433] [DEBUG] [LOCAL ] DHF: Loaded 20944 existing records from primary storage. [2025-10-02T18:25:16.192786] [INFO ] [MAIN ] DHF: Loaded 20944 existing records. [2025-10-02T18:25:16.278768] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-02T18:25:16.393448] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:25:16.393694] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-02T18:25:16.393755] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-02T18:25:16.394632] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-02T18:25:16.394726] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-02T18:25:16.807028] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:17.073001] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-10-02T18:25:17.143281] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T18:25:17.872975] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-02T18:25:18.213410] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-02T18:25:18.350491] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-02T18:25:18.673043] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-02T18:25:18.885797] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T18:25:18.887101] [INFO ] [REMOTE ] DFIN: Full fetch complete (33635 records). [2025-10-02T18:25:18.887187] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-02T18:25:19.293328] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-10-02T18:25:19.293425] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-10-02T18:25:19.294007] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-10-02T18:25:19.294072] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-10-02T18:25:19.295042] [DEBUG] [LOCAL ] DFIN: Trimmed 33635 records to 23174 (keeping 200 days of data) [2025-10-02T18:25:19.438591] [DEBUG] [LOCAL ] DFIN: Primary data saved (23174 records). [2025-10-02T18:25:19.438830] [INFO ] [MAIN ] DFIN: Full history saved. [2025-10-02T18:25:19.438955] [INFO ] [MAIN ] Update Progress: 613/2370 symbols completed. DFIN took 38.0s. Estimated remaining: 4h 4m 23s. Rate: 7.2 symbols/min [2025-10-02T18:25:19.478150] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-02T18:25:19.629376] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:19.629553] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-10-02T18:25:19.629607] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-10-02T18:25:19.629741] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-02T18:25:19.629784] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-02T18:25:19.629827] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-02T18:25:19.629862] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-02T18:25:20.021747] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:20.272973] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-02T18:25:21.072986] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-10-02T18:25:21.174824] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:25:21.223174] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T18:25:21.873009] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-02T18:25:21.963616] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (3.29 seconds). [2025-10-02T18:25:22.672963] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-02T18:25:22.988172] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T18:25:23.027379] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T18:25:23.472987] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-02T18:25:23.709159] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T18:25:24.273018] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-02T18:25:25.081685] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-02T18:25:25.105539] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T18:25:25.872987] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-02T18:25:26.289167] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-02T18:25:26.673062] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-02T18:25:27.473021] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-02T18:25:27.525936] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-10-02T18:25:27.673223] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T18:25:27.699794] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T18:25:28.273041] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-02T18:25:29.072982] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-02T18:25:29.264208] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T18:25:29.835014] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-02T18:25:29.873047] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-02T18:25:30.272332] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-02T18:25:30.673053] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-02T18:25:30.847759] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T18:25:31.473046] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-02T18:25:31.993371] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T18:25:32.272977] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-02T18:25:32.501108] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T18:25:33.072996] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-02T18:25:33.873022] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-02T18:25:33.924041] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T18:25:34.252001] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T18:25:34.651204] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T18:25:34.672968] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-02T18:25:35.472987] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-02T18:25:35.795547] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T18:25:36.273024] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-02T18:25:37.010875] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T18:25:37.072974] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-02T18:25:37.422229] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-02T18:25:37.873003] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-02T18:25:37.948787] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T18:25:37.950384] [INFO ] [REMOTE ] DHF: Full fetch complete (30021 records). [2025-10-02T18:25:37.950552] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-02T18:25:38.359798] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-10-02T18:25:38.359882] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-10-02T18:25:38.360403] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-10-02T18:25:38.360444] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-10-02T18:25:38.361315] [DEBUG] [LOCAL ] DHF: Trimmed 30021 records to 21198 (keeping 200 days of data) [2025-10-02T18:25:38.491127] [DEBUG] [LOCAL ] DHF: Primary data saved (21198 records). [2025-10-02T18:25:38.491264] [INFO ] [MAIN ] DHF: Full history saved. [2025-10-02T18:25:38.491356] [INFO ] [MAIN ] Update Progress: 614/2370 symbols completed. DHF took 22.5s. Estimated remaining: 4h 4m 45s. Rate: 7.2 symbols/min [2025-10-02T18:25:38.684996] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-02T18:25:38.689546] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:38.749880] [DEBUG] [LOCAL ] DHR: Loaded 53366 existing records from primary storage. [2025-10-02T18:25:38.750246] [INFO ] [MAIN ] DHR: Loaded 53366 existing records. [2025-10-02T18:25:38.955946] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:25:38.956206] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-02T18:25:38.956310] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-02T18:25:38.957976] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-02T18:25:38.958082] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-02T18:25:39.346297] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:39.472999] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-10-02T18:25:40.119391] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-02T18:25:40.273750] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-02T18:25:40.276927] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T18:25:41.073003] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-02T18:25:41.152710] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T18:25:41.872995] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-02T18:25:42.301956] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T18:25:42.346278] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T18:25:42.672998] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-02T18:25:43.231563] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T18:25:43.234022] [INFO ] [REMOTE ] DG: Full fetch complete (77215 records). [2025-10-02T18:25:43.234150] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-02T18:25:43.479249] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-02T18:25:43.673826] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-02T18:25:43.673924] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-02T18:25:43.674790] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-02T18:25:43.674860] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-02T18:25:43.676540] [DEBUG] [LOCAL ] DG: Trimmed 77215 records to 53672 (keeping 200 days of data) [2025-10-02T18:25:43.922633] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T18:25:43.926628] [INFO ] [REMOTE ] DGX: Full fetch complete (65120 records). [2025-10-02T18:25:43.927331] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-02T18:25:44.274743] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-02T18:25:44.388901] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-10-02T18:25:44.390660] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-10-02T18:25:44.392712] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-10-02T18:25:44.394897] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-10-02T18:25:44.409214] [DEBUG] [LOCAL ] DGX: Trimmed 65120 records to 45232 (keeping 200 days of data) [2025-10-02T18:25:44.592354] [DEBUG] [LOCAL ] DG: Primary data saved (53672 records). [2025-10-02T18:25:44.592763] [INFO ] [MAIN ] DG: Full history saved. [2025-10-02T18:25:44.594240] [INFO ] [MAIN ] Update Progress: 615/2370 symbols completed. DG took 43.8s. Estimated remaining: 4h 4m 30s. Rate: 7.2 symbols/min [2025-10-02T18:25:44.838714] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:44.911260] [DEBUG] [LOCAL ] DHT: Loaded 47876 existing records from primary storage. [2025-10-02T18:25:44.913886] [INFO ] [MAIN ] DHT: Loaded 47876 existing records. [2025-10-02T18:25:45.218123] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:25:45.219948] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-02T18:25:45.221504] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-02T18:25:45.224786] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-02T18:25:45.227936] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-02T18:25:45.778581] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-02T18:25:45.780043] [DEBUG] [LOCAL ] DGX: Primary data saved (45232 records). [2025-10-02T18:25:45.785365] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:45.785570] [INFO ] [MAIN ] DGX: Full history saved. [2025-10-02T18:25:45.797483] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-10-02T18:25:45.797099] [INFO ] [MAIN ] Update Progress: 616/2370 symbols completed. DGX took 32.8s. Estimated remaining: 4h 4m 1s. Rate: 7.2 symbols/min [2025-10-02T18:25:45.873745] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-02T18:25:45.996519] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:25:46.011689] [DEBUG] [LOCAL ] DHX: Loaded 13054 existing records from primary storage. [2025-10-02T18:25:46.011952] [INFO ] [MAIN ] DHX: Loaded 13054 existing records. [2025-10-02T18:25:46.214587] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:25:46.214932] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-02T18:25:46.215004] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-02T18:25:46.215523] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-02T18:25:46.215587] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-02T18:25:46.371550] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-02T18:25:46.668027] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:25:46.672959] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-10-02T18:25:47.225769] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T18:25:47.322860] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T18:25:47.472971] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-02T18:25:47.499953] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T18:25:48.273043] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-02T18:25:49.072993] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-02T18:25:49.145083] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T18:25:49.360746] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T18:25:49.873018] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-02T18:25:50.646134] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T18:25:50.673025] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-02T18:25:51.472983] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-02T18:25:51.713741] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T18:25:52.077670] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T18:25:52.273003] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-02T18:25:52.578682] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T18:25:53.072996] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-02T18:25:53.873011] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-02T18:25:54.072819] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T18:25:54.104336] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T18:25:54.673003] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-02T18:25:55.473170] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-02T18:25:55.927481] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-02T18:25:56.272986] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-02T18:25:56.547543] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T18:25:57.008271] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T18:25:57.072987] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-02T18:25:57.873047] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-02T18:25:57.985883] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T18:25:58.063458] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T18:25:58.673020] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-02T18:25:59.473027] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-02T18:25:59.673687] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T18:26:00.273070] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-02T18:26:00.576393] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-02T18:26:00.579283] [INFO ] [REMOTE ] DHI: Full fetch complete (77212 records). [2025-10-02T18:26:00.579481] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-02T18:26:01.039804] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-02T18:26:01.040109] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-02T18:26:01.041100] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-02T18:26:01.041238] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-02T18:26:01.043429] [DEBUG] [LOCAL ] DHI: Trimmed 77212 records to 53731 (keeping 200 days of data) [2025-10-02T18:26:01.107788] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-02T18:26:01.449398] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T18:26:01.474297] [DEBUG] [LOCAL ] DHI: Primary data saved (53731 records). [2025-10-02T18:26:01.474525] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-02T18:26:01.474623] [INFO ] [MAIN ] Update Progress: 617/2370 symbols completed. DHI took 42.0s. Estimated remaining: 4h 4m 14s. Rate: 7.2 symbols/min [2025-10-02T18:26:01.719743] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:01.719987] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-10-02T18:26:01.720034] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-10-02T18:26:01.720148] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-02T18:26:01.720191] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-02T18:26:01.720277] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-10-02T18:26:01.720335] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-02T18:26:01.878396] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-02T18:26:02.169076] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:02.199391] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T18:26:02.226452] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T18:26:02.673043] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-02T18:26:03.397609] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T18:26:03.473001] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-02T18:26:04.105731] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-02T18:26:04.272997] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-02T18:26:05.072971] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-02T18:26:05.157477] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T18:26:05.872976] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-10-02T18:26:05.948526] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T18:26:06.203511] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T18:26:06.673006] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-02T18:26:06.901067] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T18:26:07.472991] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-02T18:26:08.256319] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T18:26:08.274586] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-02T18:26:08.276781] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:26:09.073011] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-02T18:26:09.784698] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T18:26:09.873064] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-02T18:26:10.384444] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-02T18:26:10.673012] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-02T18:26:10.915523] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T18:26:11.193289] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-02T18:26:11.473007] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-02T18:26:12.273063] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-02T18:26:12.836204] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-02T18:26:13.073002] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-02T18:26:13.259254] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T18:26:13.618065] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T18:26:13.872998] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-02T18:26:14.643720] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T18:26:14.673006] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-02T18:26:15.473053] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-02T18:26:16.156793] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T18:26:16.158906] [INFO ] [REMOTE ] DHT: Full fetch complete (69982 records). [2025-10-02T18:26:16.159054] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-02T18:26:16.273553] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-02T18:26:16.561438] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T18:26:16.630952] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-02T18:26:16.631062] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-02T18:26:16.632021] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-02T18:26:16.632097] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-02T18:26:16.633797] [DEBUG] [LOCAL ] DHT: Trimmed 69982 records to 48248 (keeping 200 days of data) [2025-10-02T18:26:16.963448] [DEBUG] [LOCAL ] DHT: Primary data saved (48248 records). [2025-10-02T18:26:16.963598] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-02T18:26:16.964574] [INFO ] [MAIN ] Update Progress: 618/2370 symbols completed. DHT took 32.4s. Estimated remaining: 4h 4m 26s. Rate: 7.2 symbols/min [2025-10-02T18:26:17.079039] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-02T18:26:17.168332] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:17.209688] [DEBUG] [LOCAL ] DIN: Loaded 37210 existing records from primary storage. [2025-10-02T18:26:17.210009] [INFO ] [MAIN ] DIN: Loaded 37210 existing records. [2025-10-02T18:26:17.432414] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:26:17.432624] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-02T18:26:17.432704] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-02T18:26:17.433984] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-02T18:26:17.434046] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-02T18:26:17.834148] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T18:26:17.857907] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:17.860533] [INFO ] [REMOTE ] DHR: Full fetch complete (77275 records). [2025-10-02T18:26:17.860668] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-02T18:26:17.878120] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-10-02T18:26:17.962113] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T18:26:17.990694] [INFO ] [REMOTE ] DHX: Full fetch complete (20693 records). [2025-10-02T18:26:18.001141] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-02T18:26:18.032921] [FATAL] [VALIDATOR ] DHX: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:26:18.074979] [FATAL] [MAIN ] DHX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:26:18.143577] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:26:18.188928] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-02T18:26:18.219027] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-10-02T18:26:18.225103] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-10-02T18:26:18.246727] [DEBUG] [LOCAL ] DHX: Deleted derivative data file. [2025-10-02T18:26:18.273457] [INFO ] [MAIN ] Update Progress: 619/2370 symbols completed. DHX took 32.5s. Estimated remaining: 4h 3m 57s. Rate: 7.2 symbols/min [2025-10-02T18:26:18.432559] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-02T18:26:18.447639] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-02T18:26:18.466318] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-02T18:26:18.470496] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-02T18:26:18.515046] [DEBUG] [LOCAL ] DHR: Trimmed 77275 records to 53756 (keeping 200 days of data) [2025-10-02T18:26:18.555210] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:18.673307] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-02T18:26:18.726121] [DEBUG] [LOCAL ] DINO: Loaded 52932 existing records from primary storage. [2025-10-02T18:26:18.726549] [INFO ] [MAIN ] DINO: Loaded 52932 existing records. [2025-10-02T18:26:19.041867] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:26:19.042876] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-02T18:26:19.043464] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-02T18:26:19.046995] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-02T18:26:19.047516] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-02T18:26:19.532828] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:19.540064] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-10-02T18:26:19.571109] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-02T18:26:19.624267] [DEBUG] [LOCAL ] DHR: Primary data saved (53756 records). [2025-10-02T18:26:19.622097] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:26:19.632676] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-02T18:26:19.633463] [INFO ] [MAIN ] Update Progress: 620/2370 symbols completed. DHR took 41.1s. Estimated remaining: 4h 3m 29s. Rate: 7.2 symbols/min [2025-10-02T18:26:19.820869] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:19.879269] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-02T18:26:19.879707] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-02T18:26:20.081314] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:26:20.081570] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-02T18:26:20.081621] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-02T18:26:20.084069] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-02T18:26:20.084138] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-02T18:26:20.285772] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-02T18:26:20.493040] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:21.072972] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-02T18:26:21.159772] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T18:26:21.554702] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-02T18:26:21.873041] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-02T18:26:22.180373] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T18:26:22.673018] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-02T18:26:23.224348] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:26:23.473086] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-02T18:26:24.023144] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T18:26:24.049280] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T18:26:24.272989] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-02T18:26:25.073004] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-02T18:26:25.621960] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T18:26:25.795064] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-02T18:26:25.873009] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-02T18:26:26.672985] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-02T18:26:26.852572] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T18:26:27.473012] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-02T18:26:28.042273] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T18:26:28.043680] [INFO ] [REMOTE ] DIAX: Full fetch complete (17747 records). [2025-10-02T18:26:28.043801] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-02T18:26:28.219054] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T18:26:28.279187] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-02T18:26:28.536068] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-02T18:26:28.536151] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-02T18:26:28.536663] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-02T18:26:28.536805] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-02T18:26:28.537465] [DEBUG] [LOCAL ] DIAX: Trimmed 17747 records to 13011 (keeping 200 days of data) [2025-10-02T18:26:28.628600] [DEBUG] [LOCAL ] DIAX: Primary data saved (13011 records). [2025-10-02T18:26:28.628785] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-02T18:26:28.628915] [INFO ] [MAIN ] Update Progress: 621/2370 symbols completed. DIAX took 27.2s. Estimated remaining: 4h 3m 23s. Rate: 7.2 symbols/min [2025-10-02T18:26:28.822554] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:28.822886] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-02T18:26:28.822945] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-02T18:26:28.823074] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-02T18:26:28.823130] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-02T18:26:28.823200] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-02T18:26:28.823250] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-02T18:26:29.083218] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-10-02T18:26:29.209257] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:29.873038] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-02T18:26:30.030473] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T18:26:30.673045] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-10-02T18:26:31.046914] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-02T18:26:31.473025] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-02T18:26:31.558954] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T18:26:31.678407] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-10-02T18:26:32.273038] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-02T18:26:33.073062] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-02T18:26:33.374347] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T18:26:33.873021] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-02T18:26:34.323376] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-02T18:26:34.477167] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T18:26:34.586562] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-02T18:26:34.672994] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-02T18:26:35.472997] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-02T18:26:36.273056] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-02T18:26:36.899454] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T18:26:36.943777] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-02T18:26:37.073005] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-02T18:26:37.712252] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T18:26:37.873004] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-02T18:26:38.673036] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-02T18:26:39.095597] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-02T18:26:39.473016] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-02T18:26:39.604594] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-10-02T18:26:40.180716] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T18:26:40.273100] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-02T18:26:41.073028] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-02T18:26:41.873003] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-02T18:26:41.949759] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-02T18:26:42.114351] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T18:26:42.575749] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-02T18:26:42.608604] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T18:26:42.673061] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-02T18:26:43.473031] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-02T18:26:44.273110] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-02T18:26:44.709933] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T18:26:45.073004] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-02T18:26:45.189758] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-10-02T18:26:45.389368] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T18:26:45.873027] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-02T18:26:46.127160] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T18:26:46.129826] [INFO ] [REMOTE ] DIN: Full fetch complete (55236 records). [2025-10-02T18:26:46.129963] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-02T18:26:46.604104] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-02T18:26:46.604237] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-02T18:26:46.605267] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-02T18:26:46.605341] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-02T18:26:46.607416] [DEBUG] [LOCAL ] DIN: Trimmed 55236 records to 37507 (keeping 200 days of data) [2025-10-02T18:26:46.677896] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-02T18:26:46.854214] [DEBUG] [LOCAL ] DIN: Primary data saved (37507 records). [2025-10-02T18:26:46.854430] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-02T18:26:46.855179] [INFO ] [MAIN ] Update Progress: 622/2370 symbols completed. DIN took 29.9s. Estimated remaining: 4h 3m 42s. Rate: 7.2 symbols/min [2025-10-02T18:26:47.033059] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:47.097789] [DEBUG] [LOCAL ] DK: Loaded 49338 existing records from primary storage. [2025-10-02T18:26:47.098223] [INFO ] [MAIN ] DK: Loaded 49338 existing records. [2025-10-02T18:26:47.275171] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:26:47.275470] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-02T18:26:47.275531] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-02T18:26:47.276985] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-02T18:26:47.277059] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-02T18:26:47.484699] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-02T18:26:47.638192] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:47.994274] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-02T18:26:48.273004] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-10-02T18:26:48.331977] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-02T18:26:48.542665] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T18:26:49.073043] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-02T18:26:49.331336] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-02T18:26:49.764129] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T18:26:49.873017] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-02T18:26:49.975182] [DEBUG] [REMOTE ] DIS: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-02T18:26:49.975575] [WARN ] [REMOTE ] DIS: No data returned for month 2025-07 [2025-10-02T18:26:49.975748] [FATAL] [REMOTE ] DIS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:26:49.975864] [FATAL] [MAIN ] DIS: Failed to fetch primary data. [2025-10-02T18:26:49.975935] [WARN ] [MAIN ] DIS: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:26:49.976008] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-02T18:26:49.976084] [DEBUG] [LOCAL ] DIS: No primary data file found to delete. [2025-10-02T18:26:49.976140] [INFO ] [LOCAL ] DIS: Starting deletion of derivative data. [2025-10-02T18:26:49.976751] [DEBUG] [LOCAL ] DIS: Deleted derivative data file. [2025-10-02T18:26:49.976840] [INFO ] [MAIN ] Update Progress: 623/2370 symbols completed. DIS took 30.3s. Estimated remaining: 4h 3m 19s. Rate: 7.2 symbols/min [2025-10-02T18:26:50.159682] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:50.181804] [DEBUG] [LOCAL ] DKL: Loaded 18651 existing records from primary storage. [2025-10-02T18:26:50.182057] [INFO ] [MAIN ] DKL: Loaded 18651 existing records. [2025-10-02T18:26:50.379570] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:26:50.379820] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-02T18:26:50.379872] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-02T18:26:50.380525] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-10-02T18:26:50.380589] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-02T18:26:50.678268] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-02T18:26:50.786719] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:51.065195] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-02T18:26:51.473037] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-02T18:26:51.822967] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-02T18:26:52.273045] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-02T18:26:52.886200] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T18:26:53.073082] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-02T18:26:53.456823] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-02T18:26:53.872988] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-02T18:26:54.275045] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-02T18:26:54.275927] [INFO ] [REMOTE ] DIVY: Full fetch complete (1727 records). [2025-10-02T18:26:54.276037] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-02T18:26:54.486660] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T18:26:54.486862] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:26:54.486932] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:26:54.487007] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-02T18:26:54.487106] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-02T18:26:54.487165] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-02T18:26:54.487240] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-02T18:26:54.487343] [INFO ] [MAIN ] Update Progress: 624/2370 symbols completed. DIVY took 25.9s. Estimated remaining: 4h 2m 60s. Rate: 7.2 symbols/min [2025-10-02T18:26:54.678319] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-02T18:26:54.678250] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:26:54.743102] [DEBUG] [LOCAL ] DKS: Loaded 49749 existing records from primary storage. [2025-10-02T18:26:54.743445] [INFO ] [MAIN ] DKS: Loaded 49749 existing records. [2025-10-02T18:26:54.974534] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:26:54.974823] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-02T18:26:54.974881] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-02T18:26:54.976487] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-02T18:26:54.976551] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-02T18:26:55.432550] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:26:55.472958] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-10-02T18:26:56.272981] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-02T18:26:56.369304] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T18:26:57.072995] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-10-02T18:26:57.345636] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T18:26:57.445630] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T18:26:57.873002] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-02T18:26:58.018164] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T18:26:58.673008] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-02T18:26:59.472995] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-02T18:26:59.566709] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T18:26:59.661312] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T18:27:00.273120] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-02T18:27:00.943743] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T18:27:00.947254] [INFO ] [REMOTE ] DINO: Full fetch complete (76288 records). [2025-10-02T18:27:00.947477] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-02T18:27:00.948854] [FATAL] [VALIDATOR ] DINO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:27:00.949004] [FATAL] [MAIN ] DINO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:27:00.949077] [WARN ] [MAIN ] DINO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:27:00.949158] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-02T18:27:00.949272] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-02T18:27:00.949322] [INFO ] [LOCAL ] DINO: Starting deletion of derivative data. [2025-10-02T18:27:00.949890] [DEBUG] [LOCAL ] DINO: Deleted derivative data file. [2025-10-02T18:27:00.950016] [INFO ] [MAIN ] Update Progress: 625/2370 symbols completed. DINO took 42.7s. Estimated remaining: 4h 2m 46s. Rate: 7.2 symbols/min [2025-10-02T18:27:01.078130] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-02T18:27:01.151180] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:27:01.190753] [DEBUG] [LOCAL ] DLB: Loaded 32001 existing records from primary storage. [2025-10-02T18:27:01.191175] [INFO ] [MAIN ] DLB: Loaded 32001 existing records. [2025-10-02T18:27:01.409686] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:27:01.409952] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-02T18:27:01.410004] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-02T18:27:01.411058] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-02T18:27:01.411122] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-02T18:27:01.867019] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:27:01.873013] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-10-02T18:27:02.110396] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-02T18:27:02.212287] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T18:27:02.673045] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-02T18:27:03.362312] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T18:27:03.472997] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-02T18:27:04.272995] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-02T18:27:04.487138] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T18:27:04.810739] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T18:27:05.073025] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-02T18:27:05.873058] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-02T18:27:05.936336] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T18:27:06.633532] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T18:27:06.672996] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-02T18:27:06.710894] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T18:27:07.473051] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-02T18:27:08.273077] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-02T18:27:08.688126] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T18:27:09.037840] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T18:27:09.072972] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-02T18:27:09.698803] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T18:27:09.873032] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-02T18:27:10.353916] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-02T18:27:10.672986] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-02T18:27:10.877172] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T18:27:11.472968] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-02T18:27:11.876269] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T18:27:12.273054] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-02T18:27:12.998881] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T18:27:13.072997] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-02T18:27:13.161460] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T18:27:13.873005] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-02T18:27:14.587727] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T18:27:14.673054] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-02T18:27:15.134008] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T18:27:15.380593] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-02T18:27:15.473024] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-02T18:27:16.273009] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-02T18:27:16.437866] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-02T18:27:17.073045] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-02T18:27:17.795421] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T18:27:17.873108] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-02T18:27:17.991618] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T18:27:18.673061] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-02T18:27:19.365434] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T18:27:19.391379] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T18:27:19.392833] [INFO ] [REMOTE ] DKL: Full fetch complete (28709 records). [2025-10-02T18:27:19.392991] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-02T18:27:19.478112] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-02T18:27:19.785231] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-02T18:27:19.785323] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-02T18:27:19.785866] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-02T18:27:19.785932] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-02T18:27:19.786661] [DEBUG] [LOCAL ] DKL: Trimmed 28709 records to 18727 (keeping 200 days of data) [2025-10-02T18:27:19.909919] [DEBUG] [LOCAL ] DKL: Primary data saved (18727 records). [2025-10-02T18:27:19.910075] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-02T18:27:19.910162] [INFO ] [MAIN ] Update Progress: 626/2370 symbols completed. DKL took 29.9s. Estimated remaining: 4h 3m 7s. Rate: 7.2 symbols/min [2025-10-02T18:27:20.099171] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:27:20.108381] [DEBUG] [LOCAL ] DLNG: Loaded 6106 existing records from primary storage. [2025-10-02T18:27:20.108607] [INFO ] [MAIN ] DLNG: Loaded 6106 existing records. [2025-10-02T18:27:20.279890] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-02T18:27:20.313561] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:27:20.314103] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-02T18:27:20.314219] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-02T18:27:20.314879] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-02T18:27:20.314944] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-02T18:27:20.712483] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:27:21.073055] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-02T18:27:21.712624] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-10-02T18:27:21.873046] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-02T18:27:22.157711] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T18:27:22.486472] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T18:27:22.673081] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-02T18:27:23.473030] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-02T18:27:23.667263] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T18:27:23.733920] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T18:27:24.272999] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-02T18:27:25.072980] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-10-02T18:27:25.263628] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:27:25.682694] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:27:25.685219] [INFO ] [REMOTE ] DKS: Full fetch complete (71618 records). [2025-10-02T18:27:25.685478] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-02T18:27:25.889192] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-02T18:27:26.089548] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T18:27:26.143925] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-02T18:27:26.144060] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-02T18:27:26.145107] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-02T18:27:26.145176] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-02T18:27:26.146817] [DEBUG] [LOCAL ] DKS: Trimmed 71618 records to 50084 (keeping 200 days of data) [2025-10-02T18:27:26.584403] [DEBUG] [LOCAL ] DKS: Primary data saved (50084 records). [2025-10-02T18:27:26.584549] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-02T18:27:26.584638] [INFO ] [MAIN ] Update Progress: 627/2370 symbols completed. DKS took 32.1s. Estimated remaining: 4h 2m 54s. Rate: 7.2 symbols/min [2025-10-02T18:27:26.678216] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-02T18:27:26.776598] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:27:26.838721] [DEBUG] [LOCAL ] DLR: Loaded 50958 existing records from primary storage. [2025-10-02T18:27:26.839142] [INFO ] [MAIN ] DLR: Loaded 50958 existing records. [2025-10-02T18:27:27.042425] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:27:27.042714] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-02T18:27:27.042778] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-02T18:27:27.044678] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-02T18:27:27.044742] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-02T18:27:27.452086] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:27:27.479265] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-10-02T18:27:27.485895] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T18:27:27.978404] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T18:27:28.273017] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-02T18:27:29.075568] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-02T18:27:29.082693] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T18:27:29.229069] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T18:27:29.873015] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-02T18:27:30.303716] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T18:27:30.604359] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T18:27:30.673037] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-02T18:27:31.359013] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-02T18:27:31.473023] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-02T18:27:32.273017] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-02T18:27:32.309801] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T18:27:33.073018] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-02T18:27:33.872993] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-02T18:27:33.934908] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T18:27:34.639564] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T18:27:34.672964] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-02T18:27:35.473001] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-02T18:27:35.896219] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T18:27:35.898549] [INFO ] [REMOTE ] DK: Full fetch complete (70846 records). [2025-10-02T18:27:35.898742] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-02T18:27:36.278142] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-02T18:27:36.338425] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-02T18:27:36.338699] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-02T18:27:36.339615] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-02T18:27:36.339704] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-02T18:27:36.341221] [DEBUG] [LOCAL ] DK: Trimmed 70846 records to 49690 (keeping 200 days of data) [2025-10-02T18:27:36.603600] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (3.53 seconds). [2025-10-02T18:27:36.713014] [DEBUG] [LOCAL ] DK: Primary data saved (49690 records). [2025-10-02T18:27:36.713164] [INFO ] [MAIN ] DK: Full history saved. [2025-10-02T18:27:36.714164] [INFO ] [MAIN ] Update Progress: 628/2370 symbols completed. DK took 49.9s. Estimated remaining: 4h 2m 51s. Rate: 7.2 symbols/min [2025-10-02T18:27:36.921360] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:27:36.954681] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T18:27:36.991141] [DEBUG] [LOCAL ] DLX: Loaded 28490 existing records from primary storage. [2025-10-02T18:27:36.991525] [INFO ] [MAIN ] DLX: Loaded 28490 existing records. [2025-10-02T18:27:37.075681] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-02T18:27:37.113963] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T18:27:37.202363] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:27:37.202609] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-02T18:27:37.202689] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-02T18:27:37.203717] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-10-02T18:27:37.203779] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-02T18:27:37.604846] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:27:37.872999] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-10-02T18:27:38.672992] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-02T18:27:38.908115] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-02T18:27:39.078955] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T18:27:39.274863] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T18:27:39.473016] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-02T18:27:40.273029] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-02T18:27:40.603901] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T18:27:41.072995] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-02T18:27:41.646392] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T18:27:41.872979] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-02T18:27:42.283498] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-02T18:27:42.489618] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T18:27:42.673009] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-02T18:27:43.473018] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-02T18:27:44.029149] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T18:27:44.031922] [INFO ] [REMOTE ] DLB: Full fetch complete (46931 records). [2025-10-02T18:27:44.032128] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-02T18:27:44.278134] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-02T18:27:44.452914] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-10-02T18:27:44.453000] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-10-02T18:27:44.453776] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-10-02T18:27:44.453846] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-10-02T18:27:44.455032] [DEBUG] [LOCAL ] DLB: Trimmed 46931 records to 32228 (keeping 200 days of data) [2025-10-02T18:27:44.676921] [DEBUG] [LOCAL ] DLB: Primary data saved (32228 records). [2025-10-02T18:27:44.677075] [INFO ] [MAIN ] DLB: Full history saved. [2025-10-02T18:27:44.677163] [INFO ] [MAIN ] Update Progress: 629/2370 symbols completed. DLB took 43.7s. Estimated remaining: 4h 2m 41s. Rate: 7.2 symbols/min [2025-10-02T18:27:44.789743] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-02T18:27:44.815036] [INFO ] [REMOTE ] DLNG: Full fetch complete (11957 records). [2025-10-02T18:27:44.825846] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-02T18:27:44.972611] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:27:45.075333] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-02T18:27:45.176154] [DEBUG] [LOCAL ] DLY: Loaded 19878 existing records from primary storage. [2025-10-02T18:27:45.181731] [INFO ] [MAIN ] DLY: Loaded 19878 existing records. [2025-10-02T18:27:45.544990] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:27:45.545385] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-02T18:27:45.545800] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-02T18:27:45.545597] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-02T18:27:45.546019] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-02T18:27:45.546725] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-02T18:27:45.546945] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-02T18:27:45.547628] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-02T18:27:45.548090] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-02T18:27:45.548341] [DEBUG] [LOCAL ] DLNG: Trimmed 11957 records to 6130 (keeping 200 days of data) [2025-10-02T18:27:45.744510] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-02T18:27:45.878152] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-02T18:27:45.958488] [DEBUG] [LOCAL ] DLNG: Primary data saved (6130 records). [2025-10-02T18:27:45.977980] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-02T18:27:45.983069] [INFO ] [MAIN ] Update Progress: 630/2370 symbols completed. DLNG took 26.1s. Estimated remaining: 4h 2m 14s. Rate: 7.2 symbols/min [2025-10-02T18:27:46.201993] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:27:46.295138] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:27:46.316204] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T18:27:46.327950] [DEBUG] [LOCAL ] DMA: Loaded 4559 existing records from primary storage. [2025-10-02T18:27:46.328592] [INFO ] [MAIN ] DMA: Loaded 4559 existing records. [2025-10-02T18:27:46.526608] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:27:46.526892] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-02T18:27:46.527021] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-02T18:27:46.527360] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-02T18:27:46.527432] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-02T18:27:46.678116] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-02T18:27:46.947542] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:27:47.473005] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-10-02T18:27:47.651171] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T18:27:47.700147] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T18:27:48.273001] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-02T18:27:48.450950] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T18:27:49.072992] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-10-02T18:27:49.602846] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T18:27:49.796246] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-02T18:27:49.873008] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-02T18:27:50.672990] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-02T18:27:50.923973] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T18:27:51.472971] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-02T18:27:51.964703] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T18:27:52.273003] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-02T18:27:52.583265] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-10-02T18:27:53.072970] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-02T18:27:53.196117] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T18:27:53.665730] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T18:27:53.873021] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-02T18:27:54.673041] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-02T18:27:55.473016] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-02T18:27:55.521022] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T18:27:55.870524] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T18:27:56.009798] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T18:27:56.273009] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-02T18:27:57.073030] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-02T18:27:57.452821] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-02T18:27:57.873006] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-02T18:27:58.673004] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-02T18:27:58.741862] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-02T18:27:59.318610] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-10-02T18:27:59.472993] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-02T18:27:59.856117] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T18:28:00.117192] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-02T18:28:00.273073] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-02T18:28:01.073001] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-02T18:28:01.165631] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T18:28:01.872988] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-02T18:28:02.118936] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T18:28:02.318393] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T18:28:02.673011] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-02T18:28:03.473211] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-02T18:28:04.272976] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-02T18:28:04.398931] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T18:28:04.587144] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T18:28:05.073004] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-02T18:28:05.599422] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T18:28:05.873053] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-02T18:28:06.078373] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T18:28:06.673035] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-02T18:28:07.178685] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T18:28:07.473006] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-02T18:28:07.768378] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T18:28:08.273000] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-02T18:28:08.781799] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T18:28:08.783780] [INFO ] [REMOTE ] DLR: Full fetch complete (74064 records). [2025-10-02T18:28:08.783887] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-02T18:28:09.080187] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-02T18:28:09.255532] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-02T18:28:09.255669] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-02T18:28:09.256854] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-02T18:28:09.256941] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-02T18:28:09.269432] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T18:28:09.274697] [DEBUG] [LOCAL ] DLR: Trimmed 74064 records to 51291 (keeping 200 days of data) [2025-10-02T18:28:09.625888] [DEBUG] [LOCAL ] DLR: Primary data saved (51291 records). [2025-10-02T18:28:09.626032] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-02T18:28:09.626119] [INFO ] [MAIN ] Update Progress: 631/2370 symbols completed. DLR took 43.0s. Estimated remaining: 4h 2m 47s. Rate: 7.2 symbols/min [2025-10-02T18:28:09.705103] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T18:28:09.826835] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:28:09.841587] [DEBUG] [LOCAL ] DMB: Loaded 10218 existing records from primary storage. [2025-10-02T18:28:09.841878] [INFO ] [MAIN ] DMB: Loaded 10218 existing records. [2025-10-02T18:28:09.878105] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-02T18:28:10.042231] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:28:10.042454] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-02T18:28:10.042502] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-02T18:28:10.042991] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-02T18:28:10.043066] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-02T18:28:10.442015] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:28:10.673009] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-02T18:28:10.792719] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T18:28:10.794034] [INFO ] [REMOTE ] DLX: Full fetch complete (41381 records). [2025-10-02T18:28:10.794116] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-02T18:28:11.233231] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-02T18:28:11.233334] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-02T18:28:11.234017] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-02T18:28:11.234116] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-02T18:28:11.235188] [DEBUG] [LOCAL ] DLX: Trimmed 41381 records to 28713 (keeping 200 days of data) [2025-10-02T18:28:11.342405] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T18:28:11.442479] [DEBUG] [LOCAL ] DLX: Primary data saved (28713 records). [2025-10-02T18:28:11.442623] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-02T18:28:11.443497] [INFO ] [MAIN ] Update Progress: 632/2370 symbols completed. DLX took 34.7s. Estimated remaining: 4h 2m 21s. Rate: 7.2 symbols/min [2025-10-02T18:28:11.478083] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-10-02T18:28:11.638281] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:28:11.638457] [DEBUG] [LOCAL ] DMO: No existing data file found in primary storage. [2025-10-02T18:28:11.638496] [WARN ] [MAIN ] DMO: No existing data found, performing full refresh instead. [2025-10-02T18:28:11.638611] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-02T18:28:11.638682] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-02T18:28:11.638745] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-10-02T18:28:11.638781] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-02T18:28:12.039950] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:28:12.273001] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-02T18:28:12.470140] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T18:28:12.639177] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-02T18:28:13.073013] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-02T18:28:13.873029] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-10-02T18:28:13.976671] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T18:28:14.673019] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-02T18:28:14.705779] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T18:28:15.473026] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-02T18:28:15.600767] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T18:28:15.602500] [INFO ] [REMOTE ] DLY: Full fetch complete (28439 records). [2025-10-02T18:28:15.602633] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-02T18:28:16.030220] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-10-02T18:28:16.030328] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-10-02T18:28:16.030917] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-10-02T18:28:16.030984] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-10-02T18:28:16.031972] [DEBUG] [LOCAL ] DLY: Trimmed 28439 records to 20149 (keeping 200 days of data) [2025-10-02T18:28:16.164075] [DEBUG] [LOCAL ] DLY: Primary data saved (20149 records). [2025-10-02T18:28:16.164203] [INFO ] [MAIN ] DLY: Full history saved. [2025-10-02T18:28:16.164284] [INFO ] [MAIN ] Update Progress: 633/2370 symbols completed. DLY took 31.5s. Estimated remaining: 4h 2m 3s. Rate: 7.2 symbols/min [2025-10-02T18:28:16.274222] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-02T18:28:16.384100] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:28:16.384418] [DEBUG] [LOCAL ] DNA: No existing data file found in primary storage. [2025-10-02T18:28:16.384518] [WARN ] [MAIN ] DNA: No existing data found, performing full refresh instead. [2025-10-02T18:28:16.384931] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-02T18:28:16.393601] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-02T18:28:16.394731] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T18:28:16.398518] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-10-02T18:28:16.398639] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-02T18:28:16.825005] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:28:17.072987] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-02T18:28:17.228746] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-02T18:28:17.831057] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T18:28:17.873054] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-10-02T18:28:18.673000] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-02T18:28:19.396336] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T18:28:19.472981] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-02T18:28:19.602339] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T18:28:20.259106] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T18:28:20.272958] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-02T18:28:21.073004] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-02T18:28:21.168085] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T18:28:21.872998] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-02T18:28:22.527336] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:28:22.563389] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-02T18:28:22.673013] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-02T18:28:23.473036] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-02T18:28:23.604863] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-02T18:28:24.056322] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T18:28:24.057214] [INFO ] [REMOTE ] DMA: Full fetch complete (6637 records). [2025-10-02T18:28:24.057368] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-02T18:28:24.278183] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-02T18:28:24.465515] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-02T18:28:24.465613] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-02T18:28:24.465836] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-02T18:28:24.465894] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-02T18:28:24.466376] [DEBUG] [LOCAL ] DMA: Trimmed 6637 records to 4570 (keeping 200 days of data) [2025-10-02T18:28:24.494935] [DEBUG] [LOCAL ] DMA: Primary data saved (4570 records). [2025-10-02T18:28:24.495069] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-02T18:28:24.495171] [INFO ] [MAIN ] Update Progress: 634/2370 symbols completed. DMA took 38.5s. Estimated remaining: 4h 1m 54s. Rate: 7.2 symbols/min [2025-10-02T18:28:24.677925] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:28:24.678117] [DEBUG] [LOCAL ] DNOW: No existing data file found in primary storage. [2025-10-02T18:28:24.678208] [WARN ] [MAIN ] DNOW: No existing data found, performing full refresh instead. [2025-10-02T18:28:24.678293] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-02T18:28:24.678331] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-02T18:28:24.678374] [DEBUG] [LOCAL ] DNOW: No primary data file found to delete. [2025-10-02T18:28:24.678407] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-02T18:28:25.061812] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:28:25.072961] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-10-02T18:28:25.274592] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T18:28:25.873021] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-02T18:28:26.366214] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T18:28:26.487493] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T18:28:26.673031] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-02T18:28:27.473015] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-02T18:28:28.273034] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-02T18:28:28.590038] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-02T18:28:28.997274] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T18:28:29.072997] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-02T18:28:29.629214] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-10-02T18:28:29.791437] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T18:28:29.873002] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-02T18:28:30.673005] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-02T18:28:31.324306] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T18:28:31.472998] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-02T18:28:31.528464] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-02T18:28:32.273009] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-02T18:28:33.072997] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-02T18:28:33.110878] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T18:28:33.515202] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-02T18:28:33.605016] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T18:28:33.873037] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-02T18:28:34.651198] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T18:28:34.672974] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-02T18:28:35.438546] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T18:28:35.439509] [INFO ] [REMOTE ] DMO: Full fetch complete (14461 records). [2025-10-02T18:28:35.439581] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-02T18:28:35.478102] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-02T18:28:35.832243] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-02T18:28:35.832324] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-02T18:28:35.832699] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-02T18:28:35.832761] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-02T18:28:35.833298] [DEBUG] [LOCAL ] DMO: Trimmed 14461 records to 9961 (keeping 200 days of data) [2025-10-02T18:28:35.897492] [DEBUG] [LOCAL ] DMO: Primary data saved (9961 records). [2025-10-02T18:28:35.897638] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-02T18:28:35.897755] [INFO ] [MAIN ] Update Progress: 635/2370 symbols completed. DMO took 24.5s. Estimated remaining: 4h 1m 54s. Rate: 7.2 symbols/min [2025-10-02T18:28:36.084166] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:28:36.119633] [DEBUG] [LOCAL ] DNP: Loaded 33239 existing records from primary storage. [2025-10-02T18:28:36.119978] [INFO ] [MAIN ] DNP: Loaded 33239 existing records. [2025-10-02T18:28:36.281132] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-02T18:28:36.316799] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:28:36.317414] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-02T18:28:36.317502] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-02T18:28:36.319035] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-02T18:28:36.319109] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-02T18:28:36.498869] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T18:28:36.737163] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:28:37.073032] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-02T18:28:37.830774] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T18:28:37.873003] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-02T18:28:38.118753] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T18:28:38.392135] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T18:28:38.393057] [INFO ] [REMOTE ] DMB: Full fetch complete (15004 records). [2025-10-02T18:28:38.393132] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-02T18:28:38.678907] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-02T18:28:38.814880] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-10-02T18:28:38.814957] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-10-02T18:28:38.815403] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-10-02T18:28:38.815521] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-10-02T18:28:38.818779] [DEBUG] [LOCAL ] DMB: Trimmed 15004 records to 10281 (keeping 200 days of data) [2025-10-02T18:28:38.889030] [DEBUG] [LOCAL ] DMB: Primary data saved (10281 records). [2025-10-02T18:28:38.889176] [INFO ] [MAIN ] DMB: Full history saved. [2025-10-02T18:28:38.889311] [INFO ] [MAIN ] Update Progress: 636/2370 symbols completed. DMB took 29.3s. Estimated remaining: 4h 1m 31s. Rate: 7.2 symbols/min [2025-10-02T18:28:39.071913] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:28:39.135876] [DEBUG] [LOCAL ] DOC: Loaded 53542 existing records from primary storage. [2025-10-02T18:28:39.136219] [INFO ] [MAIN ] DOC: Loaded 53542 existing records. [2025-10-02T18:28:39.330272] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:28:39.330590] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-02T18:28:39.330669] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-02T18:28:39.333722] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-02T18:28:39.333836] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-02T18:28:39.478073] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-02T18:28:39.749724] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:28:40.272978] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-10-02T18:28:40.303920] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T18:28:41.073004] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-02T18:28:41.132613] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:28:41.841261] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T18:28:41.872962] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-02T18:28:42.672993] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-10-02T18:28:42.894515] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T18:28:43.259489] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T18:28:43.473001] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-02T18:28:44.272987] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-02T18:28:44.485548] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T18:28:44.590767] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T18:28:45.072995] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-02T18:28:45.873012] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-02T18:28:46.300456] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T18:28:46.506912] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T18:28:46.673039] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-02T18:28:47.405402] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T18:28:47.473032] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-02T18:28:48.272985] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-02T18:28:48.428423] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T18:28:49.073028] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-02T18:28:49.739037] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T18:28:49.873006] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-02T18:28:50.673053] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-02T18:28:50.827481] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T18:28:50.993624] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T18:28:51.473054] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-02T18:28:52.273031] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-02T18:28:52.358972] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (4.89 seconds). [2025-10-02T18:28:52.418755] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:28:52.880061] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:28:52.882155] [INFO ] [REMOTE ] DNA: Full fetch complete (70952 records). [2025-10-02T18:28:52.882331] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-02T18:28:53.079140] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-02T18:28:53.312966] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-02T18:28:53.313155] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-02T18:28:53.314212] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-02T18:28:53.314346] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-02T18:28:53.316155] [DEBUG] [LOCAL ] DNA: Trimmed 70952 records to 48642 (keeping 200 days of data) [2025-10-02T18:28:53.445366] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T18:28:53.656049] [DEBUG] [LOCAL ] DNA: Primary data saved (48642 records). [2025-10-02T18:28:53.656199] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-02T18:28:53.656276] [INFO ] [MAIN ] Update Progress: 637/2370 symbols completed. DNA took 37.5s. Estimated remaining: 4h 1m 40s. Rate: 7.2 symbols/min [2025-10-02T18:28:53.872999] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-02T18:28:54.672985] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-02T18:28:55.139144] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-02T18:28:55.170898] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T18:28:55.473006] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-02T18:28:56.044882] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T18:28:56.273042] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-02T18:28:57.053285] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T18:28:57.073003] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-02T18:28:57.667091] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T18:28:57.873003] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-02T18:28:58.211766] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T18:28:58.673000] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-02T18:28:59.473023] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-02T18:28:59.759955] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T18:29:00.271686] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T18:29:00.282140] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-02T18:29:00.516735] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:29:01.073019] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-02T18:29:01.873072] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-02T18:29:02.099571] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T18:29:02.446078] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:29:02.673027] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-02T18:29:03.028352] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T18:29:03.029944] [INFO ] [REMOTE ] DNP: Full fetch complete (49309 records). [2025-10-02T18:29:03.030038] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-02T18:29:03.467801] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-02T18:29:03.467897] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-02T18:29:03.468676] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-02T18:29:03.468800] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-02T18:29:03.470204] [DEBUG] [LOCAL ] DNP: Trimmed 49309 records to 33447 (keeping 200 days of data) [2025-10-02T18:29:03.473004] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-02T18:29:03.720584] [DEBUG] [LOCAL ] DNP: Primary data saved (33447 records). [2025-10-02T18:29:03.720798] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-02T18:29:03.721994] [INFO ] [MAIN ] Update Progress: 638/2370 symbols completed. DNP took 27.8s. Estimated remaining: 4h 1m 36s. Rate: 7.2 symbols/min [2025-10-02T18:29:04.698766] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T18:29:04.711286] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-02T18:29:05.023204] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T18:29:05.072994] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-02T18:29:06.219980] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T18:29:06.222002] [INFO ] [REMOTE ] DNOW: Full fetch complete (63011 records). [2025-10-02T18:29:06.222105] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-02T18:29:06.674955] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-02T18:29:06.675165] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-02T18:29:06.676017] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-02T18:29:06.676101] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-02T18:29:06.689101] [DEBUG] [LOCAL ] DNOW: Trimmed 63011 records to 44016 (keeping 200 days of data) [2025-10-02T18:29:06.712143] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T18:29:06.782754] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-02T18:29:07.018282] [DEBUG] [LOCAL ] DNOW: Primary data saved (44016 records). [2025-10-02T18:29:07.018427] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-02T18:29:07.018508] [INFO ] [MAIN ] Update Progress: 639/2370 symbols completed. DNOW took 42.5s. Estimated remaining: 4h 1m 14s. Rate: 7.2 symbols/min [2025-10-02T18:29:08.624582] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T18:29:08.644251] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-02T18:29:10.244491] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T18:29:10.246605] [INFO ] [REMOTE ] DOC: Full fetch complete (77390 records). [2025-10-02T18:29:10.246756] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-02T18:29:10.665266] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-02T18:29:10.665350] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-02T18:29:10.666252] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-02T18:29:10.666317] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-02T18:29:10.668033] [DEBUG] [LOCAL ] DOC: Trimmed 77390 records to 53930 (keeping 200 days of data) [2025-10-02T18:29:11.035443] [DEBUG] [LOCAL ] DOC: Primary data saved (53930 records). [2025-10-02T18:29:11.035589] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-02T18:29:11.035699] [INFO ] [MAIN ] Update Progress: 640/2370 symbols completed. DOC took 32.1s. Estimated remaining: 4h 0m 54s. Rate: 7.2 symbols/min [2025-10-02T18:29:11.841771] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:11.808154] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:11.849326] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:11.901945] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:11.938625] [DEBUG] [LOCAL ] DOUG: Loaded 34405 existing records from primary storage. [2025-10-02T18:29:11.939122] [INFO ] [MAIN ] DOUG: Loaded 34405 existing records. [2025-10-02T18:29:12.109245] [DEBUG] [LOCAL ] DOLE: Loaded 38416 existing records from primary storage. [2025-10-02T18:29:12.137376] [DEBUG] [LOCAL ] DOCN: Loaded 50567 existing records from primary storage. [2025-10-02T18:29:12.146043] [DEBUG] [LOCAL ] DOCS: Loaded 51126 existing records from primary storage. [2025-10-02T18:29:12.150922] [INFO ] [MAIN ] DOCS: Loaded 51126 existing records. [2025-10-02T18:29:12.151241] [INFO ] [MAIN ] DOCN: Loaded 50567 existing records. [2025-10-02T18:29:12.151059] [INFO ] [MAIN ] DOLE: Loaded 38416 existing records. [2025-10-02T18:29:12.576477] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:12.592610] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-02T18:29:12.641858] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-02T18:29:12.721579] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:12.752669] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-02T18:29:12.748440] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-02T18:29:12.784983] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-02T18:29:12.784894] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-02T18:29:12.816352] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-02T18:29:12.864358] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-02T18:29:12.864266] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:12.829207] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:12.895056] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-02T18:29:12.943735] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-02T18:29:12.963437] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-02T18:29:12.968760] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-02T18:29:12.984279] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-02T18:29:13.010061] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-10-02T18:29:13.002282] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-02T18:29:13.020785] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-02T18:29:14.227786] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:14.343811] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-10-02T18:29:14.439345] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:14.482836] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:14.467764] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-10-02T18:29:14.483355] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-10-02T18:29:14.565815] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:14.566133] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-10-02T18:29:16.004720] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T18:29:16.013786] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-02T18:29:16.050790] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T18:29:16.063682] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-02T18:29:16.143623] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T18:29:16.151270] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-02T18:29:16.179307] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:29:16.188173] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-02T18:29:17.255074] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T18:29:17.262828] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-02T18:29:17.538187] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T18:29:17.547166] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-02T18:29:17.633150] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T18:29:17.643554] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-02T18:29:17.884985] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:29:17.894743] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-02T18:29:18.827212] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T18:29:18.835425] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-02T18:29:19.132610] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T18:29:19.143451] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-02T18:29:19.610540] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T18:29:19.620735] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-02T18:29:20.177853] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T18:29:20.185890] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-02T18:29:20.634024] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T18:29:20.645763] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-02T18:29:21.211340] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (3.95 seconds). [2025-10-02T18:29:21.219565] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-02T18:29:21.310272] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T18:29:21.377748] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T18:29:21.873001] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-02T18:29:22.186389] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T18:29:22.302398] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T18:29:22.673018] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-02T18:29:23.472989] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-02T18:29:23.563688] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T18:29:23.781130] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T18:29:24.273046] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-02T18:29:24.912845] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T18:29:25.073011] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-02T18:29:25.374537] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T18:29:25.873014] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-02T18:29:26.673011] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-02T18:29:27.099497] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-02T18:29:27.147453] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-02T18:29:27.473037] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-02T18:29:28.218938] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:29:28.273021] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-02T18:29:29.073004] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-02T18:29:29.380103] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T18:29:29.873074] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-02T18:29:30.078320] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T18:29:30.345909] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T18:29:30.673038] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-02T18:29:30.951475] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T18:29:31.473006] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-02T18:29:32.051463] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T18:29:32.273023] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-02T18:29:32.892475] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T18:29:33.072998] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-02T18:29:33.621948] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T18:29:33.872999] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-02T18:29:34.672988] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-02T18:29:34.784145] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T18:29:34.979223] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T18:29:34.980701] [INFO ] [REMOTE ] DOUG: Full fetch complete (51108 records). [2025-10-02T18:29:34.980798] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-02T18:29:35.428299] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-02T18:29:35.428429] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-02T18:29:35.429387] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-02T18:29:35.429455] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-02T18:29:35.430711] [DEBUG] [LOCAL ] DOUG: Trimmed 51108 records to 34608 (keeping 200 days of data) [2025-10-02T18:29:35.476967] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-02T18:29:35.631264] [DEBUG] [LOCAL ] DOUG: Primary data saved (34608 records). [2025-10-02T18:29:35.631407] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-02T18:29:35.631531] [INFO ] [MAIN ] Update Progress: 641/2370 symbols completed. DOUG took 24.6s. Estimated remaining: 4h 1m 30s. Rate: 7.2 symbols/min [2025-10-02T18:29:35.821351] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:35.867115] [DEBUG] [LOCAL ] DOV: Loaded 45454 existing records from primary storage. [2025-10-02T18:29:35.867418] [INFO ] [MAIN ] DOV: Loaded 45454 existing records. [2025-10-02T18:29:36.056464] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:36.056753] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-02T18:29:36.056807] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-02T18:29:36.058619] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-10-02T18:29:36.058722] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-02T18:29:36.286899] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-02T18:29:36.453026] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:36.494933] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T18:29:37.055910] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T18:29:37.072994] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-02T18:29:37.873008] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-10-02T18:29:37.929069] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T18:29:38.673001] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-02T18:29:38.975929] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T18:29:39.067422] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T18:29:39.473022] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-02T18:29:40.241078] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T18:29:40.243487] [INFO ] [REMOTE ] DOLE: Full fetch complete (53894 records). [2025-10-02T18:29:40.243599] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-02T18:29:40.278164] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-02T18:29:40.684128] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-02T18:29:40.684213] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-02T18:29:40.685247] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-02T18:29:40.685331] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-02T18:29:40.687812] [DEBUG] [LOCAL ] DOLE: Trimmed 53894 records to 38730 (keeping 200 days of data) [2025-10-02T18:29:40.948553] [DEBUG] [LOCAL ] DOLE: Primary data saved (38730 records). [2025-10-02T18:29:40.948728] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-02T18:29:40.948845] [INFO ] [MAIN ] Update Progress: 642/2370 symbols completed. DOLE took 29.9s. Estimated remaining: 4h 1m 13s. Rate: 7.2 symbols/min [2025-10-02T18:29:41.074601] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-02T18:29:41.152320] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:41.190360] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T18:29:41.246689] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-02T18:29:41.247077] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-02T18:29:41.452741] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:41.452996] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-02T18:29:41.453068] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-02T18:29:41.454949] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-02T18:29:41.455014] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-02T18:29:41.875040] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-02T18:29:41.889106] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:42.070816] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T18:29:42.672964] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-10-02T18:29:43.193447] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-02T18:29:43.473065] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-02T18:29:44.273010] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-02T18:29:44.783172] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T18:29:44.823980] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-02T18:29:45.073018] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-02T18:29:45.872978] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-02T18:29:46.170207] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T18:29:46.221724] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T18:29:46.258981] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (4.38 seconds). [2025-10-02T18:29:46.261160] [INFO ] [REMOTE ] DOCS: Full fetch complete (74196 records). [2025-10-02T18:29:46.261281] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-02T18:29:46.682348] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-02T18:29:46.710371] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-02T18:29:46.710470] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-02T18:29:46.711475] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-02T18:29:46.711568] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-02T18:29:46.713385] [DEBUG] [LOCAL ] DOCS: Trimmed 74196 records to 51492 (keeping 200 days of data) [2025-10-02T18:29:47.034216] [DEBUG] [LOCAL ] DOCS: Primary data saved (51492 records). [2025-10-02T18:29:47.034368] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-02T18:29:47.035395] [INFO ] [MAIN ] Update Progress: 643/2370 symbols completed. DOCS took 36.0s. Estimated remaining: 4h 0m 59s. Rate: 7.2 symbols/min [2025-10-02T18:29:47.223251] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:47.240932] [DEBUG] [LOCAL ] DPG: Loaded 13579 existing records from primary storage. [2025-10-02T18:29:47.241181] [INFO ] [MAIN ] DPG: Loaded 13579 existing records. [2025-10-02T18:29:47.456999] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:29:47.457537] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-02T18:29:47.457710] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-02T18:29:47.458278] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-02T18:29:47.458340] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-02T18:29:47.480958] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-02T18:29:47.877172] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:47.909024] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-02T18:29:48.273083] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-10-02T18:29:48.580141] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T18:29:48.827346] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T18:29:48.830390] [INFO ] [REMOTE ] DOCN: Full fetch complete (71766 records). [2025-10-02T18:29:48.830548] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-02T18:29:49.079067] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-02T18:29:49.297554] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-02T18:29:49.297731] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-02T18:29:49.299418] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-02T18:29:49.299955] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-02T18:29:49.299855] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T18:29:49.305140] [DEBUG] [LOCAL ] DOCN: Trimmed 71766 records to 50952 (keeping 200 days of data) [2025-10-02T18:29:49.614178] [DEBUG] [LOCAL ] DOCN: Primary data saved (50952 records). [2025-10-02T18:29:49.614315] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-02T18:29:49.614410] [INFO ] [MAIN ] Update Progress: 644/2370 symbols completed. DOCN took 38.6s. Estimated remaining: 4h 0m 35s. Rate: 7.2 symbols/min [2025-10-02T18:29:49.793444] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:29:49.793611] [DEBUG] [LOCAL ] DQ: No existing data file found in primary storage. [2025-10-02T18:29:49.793677] [WARN ] [MAIN ] DQ: No existing data found, performing full refresh instead. [2025-10-02T18:29:49.793861] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-02T18:29:49.793903] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-02T18:29:49.793946] [DEBUG] [LOCAL ] DQ: No primary data file found to delete. [2025-10-02T18:29:49.793980] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-02T18:29:49.878120] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-02T18:29:50.174711] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:29:50.673065] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-10-02T18:29:50.728970] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T18:29:51.478148] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-02T18:29:51.494187] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T18:29:52.273008] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-02T18:29:52.361195] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T18:29:53.073026] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-02T18:29:53.322756] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T18:29:53.675207] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T18:29:53.838385] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T18:29:53.873036] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-02T18:29:54.318995] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:29:54.673061] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-02T18:29:55.280849] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-02T18:29:55.472999] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-02T18:29:56.272978] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-02T18:29:56.354810] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T18:29:57.073043] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-02T18:29:57.873007] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-02T18:29:58.603272] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T18:29:58.668879] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-10-02T18:29:58.672973] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-02T18:29:58.726423] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T18:29:59.473034] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-02T18:30:00.107736] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T18:30:00.273037] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-02T18:30:00.296702] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T18:30:01.073057] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-02T18:30:01.873080] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-02T18:30:01.953682] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T18:30:02.673035] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-02T18:30:03.167568] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-02T18:30:03.473022] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-02T18:30:03.882328] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-02T18:30:04.132520] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T18:30:04.134488] [INFO ] [REMOTE ] DOV: Full fetch complete (65229 records). [2025-10-02T18:30:04.134633] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-02T18:30:04.278134] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-02T18:30:04.575189] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-02T18:30:04.575275] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-02T18:30:04.576115] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-02T18:30:04.576183] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-02T18:30:04.577617] [DEBUG] [LOCAL ] DOV: Trimmed 65229 records to 45755 (keeping 200 days of data) [2025-10-02T18:30:04.850689] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T18:30:04.924817] [DEBUG] [LOCAL ] DOV: Primary data saved (45755 records). [2025-10-02T18:30:04.924967] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-02T18:30:04.925055] [INFO ] [MAIN ] Update Progress: 645/2370 symbols completed. DOV took 29.3s. Estimated remaining: 4h 0m 45s. Rate: 7.2 symbols/min [2025-10-02T18:30:05.078295] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-02T18:30:05.113741] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:05.152962] [DEBUG] [LOCAL ] DRD: Loaded 36953 existing records from primary storage. [2025-10-02T18:30:05.153299] [INFO ] [MAIN ] DRD: Loaded 36953 existing records. [2025-10-02T18:30:05.350134] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:30:05.350431] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-02T18:30:05.350499] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-02T18:30:05.351861] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-02T18:30:05.351924] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-02T18:30:05.763907] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:05.873018] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-10-02T18:30:06.119203] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-02T18:30:06.483772] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-02T18:30:06.673013] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-02T18:30:07.031866] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T18:30:07.473030] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-02T18:30:08.272997] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-02T18:30:08.411426] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T18:30:08.920737] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-02T18:30:09.073022] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-02T18:30:09.478154] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T18:30:09.873025] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-02T18:30:10.673017] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-02T18:30:10.727940] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:30:11.077731] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T18:30:11.473038] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-02T18:30:12.272974] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-02T18:30:12.323791] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T18:30:12.938669] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T18:30:13.073008] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-02T18:30:13.330414] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T18:30:13.873067] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-02T18:30:14.548837] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T18:30:14.550314] [INFO ] [REMOTE ] DPG: Full fetch complete (18961 records). [2025-10-02T18:30:14.550430] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-02T18:30:14.550987] [FATAL] [VALIDATOR ] DPG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:30:14.551107] [FATAL] [MAIN ] DPG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:30:14.551153] [WARN ] [MAIN ] DPG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:30:14.551204] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-02T18:30:14.551307] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-10-02T18:30:14.551361] [INFO ] [LOCAL ] DPG: Starting deletion of derivative data. [2025-10-02T18:30:14.552248] [DEBUG] [LOCAL ] DPG: Deleted derivative data file. [2025-10-02T18:30:14.552348] [INFO ] [MAIN ] Update Progress: 646/2370 symbols completed. DPG took 27.5s. Estimated remaining: 4h 0m 40s. Rate: 7.2 symbols/min [2025-10-02T18:30:14.678092] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-02T18:30:14.768155] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:14.820301] [DEBUG] [LOCAL ] DRH: Loaded 50489 existing records from primary storage. [2025-10-02T18:30:14.820736] [INFO ] [MAIN ] DRH: Loaded 50489 existing records. [2025-10-02T18:30:15.033467] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:30:15.033746] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-02T18:30:15.033803] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-02T18:30:15.035509] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-02T18:30:15.035573] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-02T18:30:15.437055] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:15.472313] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-02T18:30:15.479971] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-02T18:30:16.272965] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-10-02T18:30:16.299145] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T18:30:17.012868] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:30:17.073043] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-02T18:30:17.707312] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T18:30:17.873000] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-02T18:30:18.430200] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-02T18:30:18.673006] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-02T18:30:19.320875] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T18:30:19.473010] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-02T18:30:20.273035] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-02T18:30:20.573874] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T18:30:20.611252] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-02T18:30:20.613845] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-10-02T18:30:20.613972] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-02T18:30:21.040524] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-02T18:30:21.040611] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-02T18:30:21.041607] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-02T18:30:21.041701] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-02T18:30:21.043270] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 54123 (keeping 200 days of data) [2025-10-02T18:30:21.100791] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-02T18:30:21.397686] [DEBUG] [LOCAL ] DOW: Primary data saved (54123 records). [2025-10-02T18:30:21.397842] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-02T18:30:21.397929] [INFO ] [MAIN ] Update Progress: 647/2370 symbols completed. DOW took 40.4s. Estimated remaining: 4h 0m 27s. Rate: 7.2 symbols/min [2025-10-02T18:30:21.593623] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:21.593895] [DEBUG] [LOCAL ] DRI: No existing data file found in primary storage. [2025-10-02T18:30:21.594001] [WARN ] [MAIN ] DRI: No existing data found, performing full refresh instead. [2025-10-02T18:30:21.594177] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-02T18:30:21.594333] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-02T18:30:21.594394] [DEBUG] [LOCAL ] DRI: No primary data file found to delete. [2025-10-02T18:30:21.594433] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-02T18:30:21.881594] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-02T18:30:21.911123] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T18:30:22.092815] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:22.673032] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-10-02T18:30:23.446176] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T18:30:23.472993] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-02T18:30:24.273028] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-02T18:30:24.511675] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T18:30:25.073015] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-02T18:30:25.111740] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (4.01 seconds). [2025-10-02T18:30:25.432280] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T18:30:25.872995] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-02T18:30:26.039604] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T18:30:26.672981] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-02T18:30:26.804777] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T18:30:27.358758] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T18:30:27.473005] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-02T18:30:28.273001] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-02T18:30:28.609567] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T18:30:28.846843] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T18:30:28.848267] [INFO ] [REMOTE ] DRD: Full fetch complete (49583 records). [2025-10-02T18:30:28.848377] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-02T18:30:28.849111] [FATAL] [VALIDATOR ] DRD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:30:28.849208] [FATAL] [MAIN ] DRD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:30:28.849253] [WARN ] [MAIN ] DRD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:30:28.849294] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-02T18:30:28.849353] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-10-02T18:30:28.849390] [INFO ] [LOCAL ] DRD: Starting deletion of derivative data. [2025-10-02T18:30:28.849808] [DEBUG] [LOCAL ] DRD: Deleted derivative data file. [2025-10-02T18:30:28.849915] [INFO ] [MAIN ] Update Progress: 648/2370 symbols completed. DRD took 23.9s. Estimated remaining: 4h 0m 17s. Rate: 7.2 symbols/min [2025-10-02T18:30:29.043296] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:29.055346] [DEBUG] [LOCAL ] DRLL: Loaded 9443 existing records from primary storage. [2025-10-02T18:30:29.055598] [INFO ] [MAIN ] DRLL: Loaded 9443 existing records. [2025-10-02T18:30:29.079011] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-02T18:30:29.251793] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:30:29.251999] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-02T18:30:29.252049] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-02T18:30:29.252436] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-02T18:30:29.252498] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-02T18:30:29.637980] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:29.667350] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T18:30:29.873018] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-10-02T18:30:30.673004] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-02T18:30:30.919372] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T18:30:30.964432] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T18:30:31.472986] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-02T18:30:32.143667] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T18:30:32.264950] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-02T18:30:32.272942] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-02T18:30:33.073024] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-02T18:30:33.100809] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-02T18:30:33.873006] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-02T18:30:34.449708] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T18:30:34.673016] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-02T18:30:34.853158] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T18:30:35.472997] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-02T18:30:36.272990] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-02T18:30:36.448245] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T18:30:36.884464] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:30:36.886851] [INFO ] [REMOTE ] DQ: Full fetch complete (63085 records). [2025-10-02T18:30:36.886978] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-02T18:30:37.080056] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-02T18:30:37.234494] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T18:30:37.326175] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-02T18:30:37.326265] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-02T18:30:37.327102] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-02T18:30:37.327170] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-02T18:30:37.329263] [DEBUG] [LOCAL ] DQ: Trimmed 63085 records to 43712 (keeping 200 days of data) [2025-10-02T18:30:37.595421] [DEBUG] [LOCAL ] DQ: Primary data saved (43712 records). [2025-10-02T18:30:37.595597] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-02T18:30:37.595721] [INFO ] [MAIN ] Update Progress: 649/2370 symbols completed. DQ took 48.0s. Estimated remaining: 4h 0m 9s. Rate: 7.2 symbols/min [2025-10-02T18:30:37.849840] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:37.873136] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-02T18:30:37.890786] [DEBUG] [LOCAL ] DSL: Loaded 28410 existing records from primary storage. [2025-10-02T18:30:37.891135] [INFO ] [MAIN ] DSL: Loaded 28410 existing records. [2025-10-02T18:30:38.133400] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:30:38.133617] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-02T18:30:38.133707] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-02T18:30:38.134708] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-02T18:30:38.134770] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-02T18:30:38.527492] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:38.626894] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T18:30:38.672984] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-02T18:30:38.875584] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T18:30:39.444204] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T18:30:39.472997] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-02T18:30:40.272997] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-02T18:30:40.299988] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-02T18:30:41.072998] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-02T18:30:41.753511] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T18:30:41.873016] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-02T18:30:41.918721] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T18:30:42.673070] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-02T18:30:43.473045] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-02T18:30:43.676070] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T18:30:44.024629] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T18:30:44.273008] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-02T18:30:44.442559] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:30:44.853036] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T18:30:44.854162] [INFO ] [REMOTE ] DRLL: Full fetch complete (15377 records). [2025-10-02T18:30:44.854273] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-02T18:30:45.083123] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-02T18:30:45.254539] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-02T18:30:45.254620] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-02T18:30:45.255034] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-02T18:30:45.255095] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-02T18:30:45.255636] [DEBUG] [LOCAL ] DRLL: Trimmed 15377 records to 9485 (keeping 200 days of data) [2025-10-02T18:30:45.314270] [DEBUG] [LOCAL ] DRLL: Primary data saved (9485 records). [2025-10-02T18:30:45.314412] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-02T18:30:45.314498] [INFO ] [MAIN ] Update Progress: 650/2370 symbols completed. DRLL took 16.5s. Estimated remaining: 3h 59m 59s. Rate: 7.2 symbols/min [2025-10-02T18:30:45.498498] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:45.498752] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-10-02T18:30:45.498803] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-10-02T18:30:45.498932] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-02T18:30:45.498988] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-02T18:30:45.499034] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-02T18:30:45.499070] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-02T18:30:45.882160] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-10-02T18:30:45.888109] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:46.672979] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-10-02T18:30:46.795091] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T18:30:47.320679] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T18:30:47.472955] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-02T18:30:47.857197] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-02T18:30:48.272995] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-02T18:30:48.351359] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-02T18:30:49.073017] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-02T18:30:49.872970] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-02T18:30:50.047896] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T18:30:50.195196] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T18:30:50.673007] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-02T18:30:51.473019] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-02T18:30:51.518984] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T18:30:51.988539] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T18:30:52.273014] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-02T18:30:53.072984] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-02T18:30:53.121868] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T18:30:53.327914] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-02T18:30:53.873076] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-02T18:30:54.484862] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:30:54.487863] [INFO ] [REMOTE ] DRH: Full fetch complete (71881 records). [2025-10-02T18:30:54.488098] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-02T18:30:54.678343] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-02T18:30:54.795427] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T18:30:55.153174] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-02T18:30:55.153315] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-02T18:30:55.154295] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-02T18:30:55.154364] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-02T18:30:55.155965] [DEBUG] [LOCAL ] DRH: Trimmed 71881 records to 50844 (keeping 200 days of data) [2025-10-02T18:30:55.486053] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-02T18:30:55.512671] [DEBUG] [LOCAL ] DRH: Primary data saved (50844 records). [2025-10-02T18:30:55.512847] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-02T18:30:55.513731] [INFO ] [MAIN ] Update Progress: 651/2370 symbols completed. DRH took 41.0s. Estimated remaining: 3h 59m 55s. Rate: 7.2 symbols/min [2025-10-02T18:30:55.740961] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:30:55.742524] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T18:30:55.753372] [DEBUG] [LOCAL ] DSMC: Loaded 1887 existing records from primary storage. [2025-10-02T18:30:55.753592] [INFO ] [MAIN ] DSMC: Loaded 1887 existing records. [2025-10-02T18:30:55.953302] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:30:55.953513] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-02T18:30:55.953565] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-02T18:30:55.953926] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-02T18:30:55.953986] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-02T18:30:56.278377] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-02T18:30:56.366541] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:30:56.576791] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T18:30:57.073043] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-02T18:30:57.813094] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:30:57.828270] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T18:30:57.872986] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-02T18:30:58.441174] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T18:30:58.672994] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-02T18:30:59.472973] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-10-02T18:30:59.606108] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-02T18:30:59.864839] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-02T18:31:00.273014] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-02T18:31:01.073069] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-02T18:31:01.213081] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T18:31:01.597527] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T18:31:01.873051] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-02T18:31:02.343139] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T18:31:02.673001] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-02T18:31:03.106003] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T18:31:03.473056] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-02T18:31:03.781260] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-02T18:31:04.273001] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-02T18:31:04.919481] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-02T18:31:05.072936] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-02T18:31:05.799734] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-02T18:31:05.800779] [INFO ] [REMOTE ] DSM: Full fetch complete (24532 records). [2025-10-02T18:31:05.800858] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-02T18:31:05.878165] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-02T18:31:06.254911] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-02T18:31:06.254999] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-02T18:31:06.255454] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-02T18:31:06.255496] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-02T18:31:06.256354] [DEBUG] [LOCAL ] DSM: Trimmed 24532 records to 15196 (keeping 200 days of data) [2025-10-02T18:31:06.348286] [DEBUG] [LOCAL ] DSM: Primary data saved (15196 records). [2025-10-02T18:31:06.348435] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-02T18:31:06.348513] [INFO ] [MAIN ] Update Progress: 652/2370 symbols completed. DSM took 21.0s. Estimated remaining: 3h 59m 54s. Rate: 7.2 symbols/min [2025-10-02T18:31:06.535917] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:06.559727] [DEBUG] [LOCAL ] DSU: Loaded 22542 existing records from primary storage. [2025-10-02T18:31:06.559994] [INFO ] [MAIN ] DSU: Loaded 22542 existing records. [2025-10-02T18:31:06.680684] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-02T18:31:06.806502] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:31:06.806835] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-02T18:31:06.806942] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-02T18:31:06.807881] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-10-02T18:31:06.821944] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-02T18:31:06.851715] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T18:31:07.254932] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:31:07.472999] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-10-02T18:31:08.272991] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-02T18:31:08.484144] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T18:31:08.541701] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T18:31:08.592116] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-02T18:31:09.073014] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-02T18:31:09.873031] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-02T18:31:10.405397] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-02T18:31:10.673009] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-02T18:31:10.791877] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-02T18:31:11.473002] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-02T18:31:12.120336] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T18:31:12.273033] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-02T18:31:12.589260] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T18:31:13.073014] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-02T18:31:13.433588] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-02T18:31:13.873002] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-02T18:31:14.199086] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T18:31:14.673038] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-02T18:31:15.015067] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T18:31:15.473008] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-02T18:31:15.828054] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-02T18:31:16.273010] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-02T18:31:16.418831] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T18:31:16.709180] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T18:31:17.073019] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-02T18:31:17.872998] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-02T18:31:18.567614] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T18:31:18.569829] [INFO ] [REMOTE ] DRI: Full fetch complete (69616 records). [2025-10-02T18:31:18.570006] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-02T18:31:18.682229] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-02T18:31:18.959521] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T18:31:18.982340] [INFO ] [REMOTE ] DSL: Full fetch complete (41459 records). [2025-10-02T18:31:19.002760] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-02T18:31:19.187626] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-02T18:31:19.192573] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-02T18:31:19.193577] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-02T18:31:19.194003] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-02T18:31:19.260066] [DEBUG] [LOCAL ] DRI: Trimmed 69616 records to 48135 (keeping 200 days of data) [2025-10-02T18:31:19.483194] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-02T18:31:19.624536] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-10-02T18:31:19.625004] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-10-02T18:31:19.626113] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-10-02T18:31:19.626204] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-10-02T18:31:19.631170] [DEBUG] [LOCAL ] DSL: Trimmed 41459 records to 28612 (keeping 200 days of data) [2025-10-02T18:31:19.904861] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T18:31:19.992938] [DEBUG] [LOCAL ] DSL: Primary data saved (28612 records). [2025-10-02T18:31:19.994515] [INFO ] [MAIN ] DSL: Full history saved. [2025-10-02T18:31:19.994976] [INFO ] [MAIN ] Update Progress: 653/2370 symbols completed. DSL took 42.4s. Estimated remaining: 3h 59m 59s. Rate: 7.2 symbols/min [2025-10-02T18:31:20.060253] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T18:31:20.261205] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:20.273058] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-02T18:31:20.287822] [DEBUG] [LOCAL ] DRI: Primary data saved (48135 records). [2025-10-02T18:31:20.288366] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-02T18:31:20.288469] [INFO ] [MAIN ] Update Progress: 654/2370 symbols completed. DRI took 58.9s. Estimated remaining: 3h 59m 29s. Rate: 7.2 symbols/min [2025-10-02T18:31:20.367262] [DEBUG] [LOCAL ] DSX: Loaded 24050 existing records from primary storage. [2025-10-02T18:31:20.390972] [INFO ] [MAIN ] DSX: Loaded 24050 existing records. [2025-10-02T18:31:20.643042] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:20.760515] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:31:20.760917] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-02T18:31:20.760976] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-02T18:31:20.761926] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-02T18:31:20.761999] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-02T18:31:21.000859] [DEBUG] [LOCAL ] DT: Loaded 52927 existing records from primary storage. [2025-10-02T18:31:21.075361] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-02T18:31:21.062347] [INFO ] [MAIN ] DT: Loaded 52927 existing records. [2025-10-02T18:31:21.382571] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:31:21.428509] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:31:21.428843] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-02T18:31:21.428975] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-02T18:31:21.435822] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-02T18:31:21.440252] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-02T18:31:21.503493] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-02T18:31:21.726335] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-02T18:31:21.836724] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:31:21.873008] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-02T18:31:22.247321] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-02T18:31:22.248150] [INFO ] [REMOTE ] DSMC: Full fetch complete (2880 records). [2025-10-02T18:31:22.248241] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-02T18:31:22.248707] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:31:22.248796] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:31:22.248926] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:31:22.249008] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-02T18:31:22.249073] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-02T18:31:22.249111] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-10-02T18:31:22.249382] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-10-02T18:31:22.249488] [INFO ] [MAIN ] Update Progress: 655/2370 symbols completed. DSMC took 26.7s. Estimated remaining: 3h 59m 4s. Rate: 7.2 symbols/min [2025-10-02T18:31:22.445870] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:22.454502] [DEBUG] [LOCAL ] DTB: Loaded 4913 existing records from primary storage. [2025-10-02T18:31:22.454784] [INFO ] [MAIN ] DTB: Loaded 4913 existing records. [2025-10-02T18:31:22.652292] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:31:22.652533] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-02T18:31:22.652581] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-02T18:31:22.652951] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-10-02T18:31:22.653042] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-02T18:31:22.678136] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-10-02T18:31:23.048283] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:31:23.472998] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-02T18:31:24.272989] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-10-02T18:31:24.394161] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T18:31:24.422403] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-02T18:31:25.073001] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-02T18:31:25.873010] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-02T18:31:26.112899] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T18:31:26.303762] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-02T18:31:26.673014] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-02T18:31:26.899442] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T18:31:27.473005] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-10-02T18:31:27.806814] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T18:31:28.155240] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T18:31:28.272997] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-02T18:31:29.072996] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-02T18:31:29.846108] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T18:31:29.872994] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-02T18:31:30.191434] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T18:31:30.673012] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-02T18:31:31.215905] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T18:31:31.473015] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-02T18:31:32.283264] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-02T18:31:32.313008] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T18:31:32.723546] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T18:31:32.869391] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-02T18:31:33.073005] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-02T18:31:33.872994] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-02T18:31:34.025703] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T18:31:34.673002] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-02T18:31:35.472991] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-02T18:31:35.683073] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T18:31:35.712498] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T18:31:36.273000] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-02T18:31:36.725860] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T18:31:37.073004] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-02T18:31:37.872969] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-02T18:31:37.913354] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-02T18:31:38.070857] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T18:31:38.672995] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-02T18:31:38.915828] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T18:31:39.473016] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-02T18:31:40.272985] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-02T18:31:40.584062] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T18:31:40.864197] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T18:31:40.946189] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-02T18:31:41.073042] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-02T18:31:41.872992] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-02T18:31:42.030438] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:31:42.031851] [INFO ] [REMOTE ] DSU: Full fetch complete (32822 records). [2025-10-02T18:31:42.031950] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-02T18:31:42.474456] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-02T18:31:42.474537] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-02T18:31:42.475118] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-02T18:31:42.475181] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-02T18:31:42.476025] [DEBUG] [LOCAL ] DSU: Trimmed 32822 records to 22729 (keeping 200 days of data) [2025-10-02T18:31:42.628261] [DEBUG] [LOCAL ] DSU: Primary data saved (22729 records). [2025-10-02T18:31:42.628407] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-02T18:31:42.628493] [INFO ] [MAIN ] Update Progress: 656/2370 symbols completed. DSU took 36.3s. Estimated remaining: 3h 59m 27s. Rate: 7.2 symbols/min [2025-10-02T18:31:42.676898] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-02T18:31:42.827073] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:42.875118] [DEBUG] [LOCAL ] DTE: Loaded 47740 existing records from primary storage. [2025-10-02T18:31:42.880777] [INFO ] [MAIN ] DTE: Loaded 47740 existing records. [2025-10-02T18:31:42.950927] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T18:31:43.088106] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:31:43.088351] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-02T18:31:43.088410] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-02T18:31:43.089975] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-02T18:31:43.090038] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-02T18:31:43.475843] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-02T18:31:43.490165] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:31:44.082899] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-02T18:31:44.273003] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-10-02T18:31:44.370261] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T18:31:45.073035] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-02T18:31:45.873015] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-02T18:31:46.083813] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T18:31:46.137614] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T18:31:46.672999] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-02T18:31:47.484815] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-02T18:31:47.514091] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T18:31:47.515871] [INFO ] [REMOTE ] DSX: Full fetch complete (36519 records). [2025-10-02T18:31:47.519030] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T18:31:47.519281] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-02T18:31:48.024473] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-02T18:31:48.024666] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-02T18:31:48.025269] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-02T18:31:48.025315] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-02T18:31:48.026368] [DEBUG] [LOCAL ] DSX: Trimmed 36519 records to 24147 (keeping 200 days of data) [2025-10-02T18:31:48.089575] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T18:31:48.178025] [DEBUG] [LOCAL ] DSX: Primary data saved (24147 records). [2025-10-02T18:31:48.178174] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-02T18:31:48.178274] [INFO ] [MAIN ] Update Progress: 657/2370 symbols completed. DSX took 28.2s. Estimated remaining: 3h 59m 12s. Rate: 7.2 symbols/min [2025-10-02T18:31:48.278089] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-02T18:31:48.372692] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:48.372882] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-02T18:31:48.372948] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-02T18:31:48.373078] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-02T18:31:48.373129] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-02T18:31:48.373183] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-02T18:31:48.373224] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-02T18:31:48.770301] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:31:49.073024] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-02T18:31:49.700098] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T18:31:49.863443] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T18:31:49.873023] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-02T18:31:50.331810] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-02T18:31:50.673017] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-10-02T18:31:51.392601] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-10-02T18:31:51.473030] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-02T18:31:52.273017] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-02T18:31:52.917152] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T18:31:52.995454] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T18:31:53.073028] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-02T18:31:53.873002] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-02T18:31:54.675390] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-02T18:31:54.681593] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T18:31:54.708491] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T18:31:55.473017] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-02T18:31:55.777830] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-02T18:31:56.030884] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T18:31:56.273079] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-02T18:31:56.638487] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-02T18:31:57.073012] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-02T18:31:57.729569] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-02T18:31:57.873009] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-02T18:31:58.363954] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T18:31:58.364785] [INFO ] [REMOTE ] DTB: Full fetch complete (6864 records). [2025-10-02T18:31:58.364861] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-02T18:31:58.678091] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-02T18:31:58.754262] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-02T18:31:58.754343] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-02T18:31:58.754533] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-02T18:31:58.754576] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-02T18:31:58.755005] [DEBUG] [LOCAL ] DTB: Trimmed 6864 records to 4947 (keeping 200 days of data) [2025-10-02T18:31:58.788806] [DEBUG] [LOCAL ] DTB: Primary data saved (4947 records). [2025-10-02T18:31:58.788987] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-02T18:31:58.789126] [INFO ] [MAIN ] Update Progress: 658/2370 symbols completed. DTB took 36.5s. Estimated remaining: 3h 59m 9s. Rate: 7.2 symbols/min [2025-10-02T18:31:58.975815] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:31:58.984728] [DEBUG] [LOCAL ] DTG: Loaded 5956 existing records from primary storage. [2025-10-02T18:31:58.984982] [INFO ] [MAIN ] DTG: Loaded 5956 existing records. [2025-10-02T18:31:59.188705] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:31:59.188929] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-02T18:31:59.188981] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-02T18:31:59.189363] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-02T18:31:59.189441] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-02T18:31:59.479138] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-02T18:31:59.583736] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:00.273003] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-02T18:32:00.390545] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T18:32:01.073052] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-10-02T18:32:01.426317] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T18:32:01.696278] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-02T18:32:01.722822] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T18:32:01.873046] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-02T18:32:02.579448] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-02T18:32:02.672997] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-02T18:32:03.473012] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-02T18:32:03.955052] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T18:32:04.181806] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T18:32:04.186474] [INFO ] [REMOTE ] DT: Full fetch complete (76670 records). [2025-10-02T18:32:04.186680] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-02T18:32:04.278106] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-02T18:32:04.643402] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-02T18:32:04.643498] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-02T18:32:04.644545] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-02T18:32:04.644681] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-02T18:32:04.646955] [DEBUG] [LOCAL ] DT: Trimmed 76670 records to 53316 (keeping 200 days of data) [2025-10-02T18:32:04.986210] [DEBUG] [LOCAL ] DT: Primary data saved (53316 records). [2025-10-02T18:32:04.986364] [INFO ] [MAIN ] DT: Full history saved. [2025-10-02T18:32:04.986501] [INFO ] [MAIN ] Update Progress: 659/2370 symbols completed. DT took 44.7s. Estimated remaining: 3h 58m 55s. Rate: 7.2 symbols/min [2025-10-02T18:32:05.078234] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-02T18:32:05.178545] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:05.178771] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-02T18:32:05.178817] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-02T18:32:05.178928] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-02T18:32:05.178970] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-02T18:32:05.179011] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-02T18:32:05.179057] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-02T18:32:05.561269] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-02T18:32:05.589753] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:05.873040] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-02T18:32:05.913603] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T18:32:06.186054] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-02T18:32:06.673027] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-10-02T18:32:06.895434] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:32:06.895906] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-10-02T18:32:06.896001] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:32:06.896052] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-02T18:32:06.896115] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:32:06.896193] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-02T18:32:06.896259] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-02T18:32:06.896298] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-02T18:32:06.896357] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-02T18:32:06.896428] [INFO ] [MAIN ] Update Progress: 660/2370 symbols completed. DTK took 1.9s. Estimated remaining: 3h 58m 30s. Rate: 7.2 symbols/min [2025-10-02T18:32:07.087120] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:07.087385] [DEBUG] [LOCAL ] DTM: No existing data file found in primary storage. [2025-10-02T18:32:07.087444] [WARN ] [MAIN ] DTM: No existing data found, performing full refresh instead. [2025-10-02T18:32:07.087571] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-02T18:32:07.087624] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-02T18:32:07.087718] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-10-02T18:32:07.087760] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-02T18:32:07.470945] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:07.472955] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-10-02T18:32:08.273010] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-02T18:32:09.072974] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-02T18:32:09.193935] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T18:32:09.459614] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-02T18:32:09.664910] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T18:32:09.872997] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-02T18:32:10.557665] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T18:32:10.673013] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-02T18:32:11.023473] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-02T18:32:11.472996] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-02T18:32:11.955868] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-02T18:32:12.273007] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-02T18:32:13.073002] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-02T18:32:13.871624] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T18:32:13.880638] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-02T18:32:14.673008] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-02T18:32:14.801626] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T18:32:14.955514] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-02T18:32:15.473004] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-02T18:32:15.504574] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T18:32:16.273054] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-02T18:32:17.051254] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T18:32:17.072986] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-02T18:32:17.872994] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-02T18:32:18.296184] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-02T18:32:18.395695] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-02T18:32:18.398769] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T18:32:18.673023] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-02T18:32:19.473048] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-02T18:32:20.176729] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-02T18:32:20.273008] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-02T18:32:20.799605] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T18:32:20.959026] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-10-02T18:32:21.072995] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-02T18:32:21.873021] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-02T18:32:22.569560] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:32:22.573532] [INFO ] [REMOTE ] DTE: Full fetch complete (68930 records). [2025-10-02T18:32:22.573687] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-02T18:32:22.682456] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-02T18:32:22.957820] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T18:32:22.992320] [INFO ] [REMOTE ] DTF: Full fetch complete (2074 records). [2025-10-02T18:32:23.010392] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-10-02T18:32:23.010558] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-10-02T18:32:23.011495] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-10-02T18:32:23.010506] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-02T18:32:23.011579] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-10-02T18:32:23.012515] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:32:23.012923] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:32:23.013072] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:32:23.013259] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-02T18:32:23.013703] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-02T18:32:23.013794] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-02T18:32:23.013924] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-02T18:32:23.014010] [INFO ] [MAIN ] Update Progress: 661/2370 symbols completed. DTF took 34.8s. Estimated remaining: 3h 58m 41s. Rate: 7.2 symbols/min [2025-10-02T18:32:23.051008] [DEBUG] [LOCAL ] DTE: Trimmed 68930 records to 48040 (keeping 200 days of data) [2025-10-02T18:32:23.308804] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:23.309765] [DEBUG] [LOCAL ] DTW: No existing data file found in primary storage. [2025-10-02T18:32:23.309836] [WARN ] [MAIN ] DTW: No existing data found, performing full refresh instead. [2025-10-02T18:32:23.310220] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-02T18:32:23.311072] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-02T18:32:23.311440] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-02T18:32:23.311508] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-02T18:32:23.475684] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-02T18:32:23.753789] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:23.950363] [DEBUG] [LOCAL ] DTE: Primary data saved (48040 records). [2025-10-02T18:32:23.950511] [INFO ] [MAIN ] DTE: Full history saved. [2025-10-02T18:32:23.950618] [INFO ] [MAIN ] Update Progress: 662/2370 symbols completed. DTE took 41.3s. Estimated remaining: 3h 58m 14s. Rate: 7.2 symbols/min [2025-10-02T18:32:24.140861] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:24.141220] [DEBUG] [LOCAL ] DUK: No existing data file found in primary storage. [2025-10-02T18:32:24.141297] [WARN ] [MAIN ] DUK: No existing data found, performing full refresh instead. [2025-10-02T18:32:24.141571] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-02T18:32:24.141637] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-02T18:32:24.141754] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-02T18:32:24.141807] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-02T18:32:24.265003] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T18:32:24.276831] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-10-02T18:32:24.579001] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:24.611922] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T18:32:25.017451] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-10-02T18:32:25.072962] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-10-02T18:32:25.873007] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-02T18:32:26.635738] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T18:32:26.673027] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-02T18:32:27.027958] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-02T18:32:27.240514] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T18:32:27.241476] [INFO ] [REMOTE ] DTG: Full fetch complete (8955 records). [2025-10-02T18:32:27.241573] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-02T18:32:27.242084] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:32:27.242212] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:32:27.242318] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:32:27.242406] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-02T18:32:27.242512] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-10-02T18:32:27.242582] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-10-02T18:32:27.243040] [DEBUG] [LOCAL ] DTG: Deleted derivative data file. [2025-10-02T18:32:27.243146] [INFO ] [MAIN ] Update Progress: 663/2370 symbols completed. DTG took 28.5s. Estimated remaining: 3h 57m 52s. Rate: 7.2 symbols/min [2025-10-02T18:32:27.425337] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:27.425557] [DEBUG] [LOCAL ] DUKB: No existing data file found in primary storage. [2025-10-02T18:32:27.425605] [WARN ] [MAIN ] DUKB: No existing data found, performing full refresh instead. [2025-10-02T18:32:27.425791] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-02T18:32:27.425843] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-02T18:32:27.425886] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-02T18:32:27.425919] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-02T18:32:27.483563] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-02T18:32:27.814249] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:28.272992] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-10-02T18:32:29.072982] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-02T18:32:29.226816] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T18:32:29.426863] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T18:32:29.873010] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-02T18:32:30.307226] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T18:32:30.548487] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T18:32:30.673008] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-02T18:32:31.267576] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T18:32:31.472997] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-02T18:32:32.272996] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-02T18:32:32.719424] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T18:32:33.072989] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-02T18:32:33.683268] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T18:32:33.872972] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-02T18:32:33.982587] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T18:32:34.673002] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-02T18:32:35.472145] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:32:35.474976] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-02T18:32:35.673572] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T18:32:36.030825] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T18:32:36.273045] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-02T18:32:37.073023] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-02T18:32:37.873004] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-02T18:32:38.443686] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-02T18:32:38.475379] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T18:32:38.673006] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-02T18:32:38.817958] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T18:32:39.345236] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-02T18:32:39.473060] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-02T18:32:39.916021] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T18:32:40.273009] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-02T18:32:41.059403] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T18:32:41.072957] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-02T18:32:41.741579] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T18:32:41.872985] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-02T18:32:42.572139] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T18:32:42.673053] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-02T18:32:43.473055] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-02T18:32:44.031780] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T18:32:44.273001] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-02T18:32:45.073055] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-02T18:32:45.453921] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T18:32:45.873011] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-02T18:32:46.257913] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-10-02T18:32:46.673017] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-02T18:32:47.234023] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-02T18:32:47.458454] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-02T18:32:47.459412] [INFO ] [REMOTE ] DTW: Full fetch complete (7609 records). [2025-10-02T18:32:47.459489] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-02T18:32:47.483164] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-02T18:32:47.856450] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-10-02T18:32:47.856533] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-10-02T18:32:47.856816] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-10-02T18:32:47.856880] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-10-02T18:32:47.857329] [DEBUG] [LOCAL ] DTW: Trimmed 7609 records to 4936 (keeping 200 days of data) [2025-10-02T18:32:47.893444] [DEBUG] [LOCAL ] DTW: Primary data saved (4936 records). [2025-10-02T18:32:47.893573] [INFO ] [MAIN ] DTW: Full history saved. [2025-10-02T18:32:47.893680] [INFO ] [MAIN ] Update Progress: 664/2370 symbols completed. DTW took 24.9s. Estimated remaining: 3h 58m 16s. Rate: 7.2 symbols/min [2025-10-02T18:32:48.074759] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:48.136198] [DEBUG] [LOCAL ] DV: Loaded 51286 existing records from primary storage. [2025-10-02T18:32:48.136572] [INFO ] [MAIN ] DV: Loaded 51286 existing records. [2025-10-02T18:32:48.278185] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-02T18:32:48.340601] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:32:48.341056] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-02T18:32:48.341109] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-02T18:32:48.342604] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-02T18:32:48.342703] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-02T18:32:48.756162] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:48.793621] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-02T18:32:49.073011] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-10-02T18:32:49.114363] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T18:32:49.248863] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T18:32:49.873004] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-02T18:32:50.673006] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-02T18:32:50.794108] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T18:32:50.797037] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T18:32:51.473088] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-02T18:32:52.064342] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T18:32:52.272974] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-02T18:32:52.418997] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T18:32:53.073026] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-02T18:32:53.625487] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T18:32:53.627476] [INFO ] [REMOTE ] DTM: Full fetch complete (64801 records). [2025-10-02T18:32:53.627599] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-02T18:32:53.878142] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-02T18:32:54.072134] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-02T18:32:54.072221] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-02T18:32:54.073104] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-02T18:32:54.073175] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-02T18:32:54.074867] [DEBUG] [LOCAL ] DTM: Trimmed 64801 records to 44445 (keeping 200 days of data) [2025-10-02T18:32:54.391600] [DEBUG] [LOCAL ] DTM: Primary data saved (44445 records). [2025-10-02T18:32:54.391819] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-02T18:32:54.391951] [INFO ] [MAIN ] Update Progress: 665/2370 symbols completed. DTM took 47.5s. Estimated remaining: 3h 58m 2s. Rate: 7.2 symbols/min [2025-10-02T18:32:54.593795] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:54.599438] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T18:32:54.650001] [DEBUG] [LOCAL ] DVA: Loaded 41054 existing records from primary storage. [2025-10-02T18:32:54.650302] [INFO ] [MAIN ] DVA: Loaded 41054 existing records. [2025-10-02T18:32:54.685505] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-02T18:32:54.861593] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:32:54.861926] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-02T18:32:54.862001] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-02T18:32:54.863448] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-10-02T18:32:54.863514] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-02T18:32:55.018855] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T18:32:55.290382] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:55.473002] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-10-02T18:32:56.273013] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-02T18:32:56.408827] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T18:32:56.854588] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T18:32:56.855555] [INFO ] [REMOTE ] DUKB: Full fetch complete (9517 records). [2025-10-02T18:32:56.855704] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-02T18:32:57.080549] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-02T18:32:57.362317] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-02T18:32:57.385148] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-02T18:32:57.385840] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-02T18:32:57.386332] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-02T18:32:57.387821] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T18:32:57.397306] [DEBUG] [LOCAL ] DUKB: Trimmed 9517 records to 6410 (keeping 200 days of data) [2025-10-02T18:32:57.446361] [DEBUG] [LOCAL ] DUKB: Primary data saved (6410 records). [2025-10-02T18:32:57.446509] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-02T18:32:57.446588] [INFO ] [MAIN ] Update Progress: 666/2370 symbols completed. DUKB took 30.2s. Estimated remaining: 3h 57m 40s. Rate: 7.2 symbols/min [2025-10-02T18:32:57.645324] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:32:57.717918] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-02T18:32:57.718439] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-10-02T18:32:57.878094] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-02T18:32:57.917086] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:32:57.917296] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-02T18:32:57.917344] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-02T18:32:57.919381] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-02T18:32:57.919451] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-02T18:32:58.306212] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:32:58.672982] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-10-02T18:32:58.787536] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T18:32:59.416927] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T18:32:59.473002] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-02T18:33:00.273005] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-02T18:33:00.805958] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-02T18:33:01.073051] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-02T18:33:01.211776] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T18:33:01.870413] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T18:33:01.880986] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-02T18:33:02.673001] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-02T18:33:03.181278] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-02T18:33:03.472981] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-02T18:33:03.570915] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T18:33:04.273021] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-02T18:33:04.776175] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-02T18:33:04.863415] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:33:05.073035] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-02T18:33:05.873053] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-02T18:33:06.468982] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-10-02T18:33:06.673039] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-02T18:33:07.179300] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T18:33:07.473059] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-02T18:33:07.610420] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T18:33:08.273001] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-02T18:33:08.424862] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:33:08.693141] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T18:33:08.695276] [INFO ] [REMOTE ] DUK: Full fetch complete (77405 records). [2025-10-02T18:33:08.695402] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-02T18:33:09.078156] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-02T18:33:09.145085] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-02T18:33:09.145179] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-02T18:33:09.146159] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-02T18:33:09.146230] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-02T18:33:09.147822] [DEBUG] [LOCAL ] DUK: Trimmed 77405 records to 53845 (keeping 200 days of data) [2025-10-02T18:33:09.510729] [DEBUG] [LOCAL ] DUK: Primary data saved (53845 records). [2025-10-02T18:33:09.510896] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-02T18:33:09.511042] [INFO ] [MAIN ] Update Progress: 667/2370 symbols completed. DUK took 45.6s. Estimated remaining: 3h 57m 42s. Rate: 7.2 symbols/min [2025-10-02T18:33:09.715361] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:33:09.748577] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T18:33:09.814445] [DEBUG] [LOCAL ] DX: Loaded 52464 existing records from primary storage. [2025-10-02T18:33:09.814849] [INFO ] [MAIN ] DX: Loaded 52464 existing records. [2025-10-02T18:33:09.884860] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-02T18:33:10.012925] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:33:10.013164] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-02T18:33:10.013214] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-02T18:33:10.015337] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-10-02T18:33:10.015405] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-02T18:33:10.423074] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:33:10.672979] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-02T18:33:11.165246] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T18:33:11.473078] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-02T18:33:11.476080] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T18:33:11.884983] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T18:33:12.273045] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-02T18:33:13.072964] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-02T18:33:13.663575] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-02T18:33:13.819009] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:33:13.873012] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-02T18:33:14.381759] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T18:33:14.673001] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-02T18:33:14.967056] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T18:33:15.473030] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-10-02T18:33:16.032268] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T18:33:16.273010] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-02T18:33:17.073024] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-02T18:33:17.369412] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T18:33:17.704331] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T18:33:17.706624] [INFO ] [REMOTE ] DV: Full fetch complete (73488 records). [2025-10-02T18:33:17.706805] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-02T18:33:17.878125] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-02T18:33:18.160570] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-02T18:33:18.160689] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-02T18:33:18.161556] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-02T18:33:18.161623] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-02T18:33:18.163216] [DEBUG] [LOCAL ] DV: Trimmed 73488 records to 51670 (keeping 200 days of data) [2025-10-02T18:33:18.489849] [DEBUG] [LOCAL ] DV: Primary data saved (51670 records). [2025-10-02T18:33:18.490049] [INFO ] [MAIN ] DV: Full history saved. [2025-10-02T18:33:18.490264] [INFO ] [MAIN ] Update Progress: 668/2370 symbols completed. DV took 30.6s. Estimated remaining: 3h 57m 35s. Rate: 7.2 symbols/min [2025-10-02T18:33:18.679583] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-02T18:33:18.684783] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:33:18.741601] [DEBUG] [LOCAL ] DXC: Loaded 49790 existing records from primary storage. [2025-10-02T18:33:18.741968] [INFO ] [MAIN ] DXC: Loaded 49790 existing records. [2025-10-02T18:33:18.951356] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:33:18.951858] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-02T18:33:18.952052] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-02T18:33:18.953879] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-02T18:33:18.953945] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-02T18:33:19.198431] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-02T18:33:19.435522] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:33:19.472954] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-10-02T18:33:19.824084] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-02T18:33:19.997075] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T18:33:20.273004] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-02T18:33:20.936587] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:33:21.073012] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-02T18:33:21.692155] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T18:33:21.873020] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-02T18:33:22.220387] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T18:33:22.673012] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-02T18:33:23.472980] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-02T18:33:23.873482] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-02T18:33:24.272985] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-02T18:33:24.360435] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T18:33:24.515384] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T18:33:25.073014] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-02T18:33:25.870764] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T18:33:25.879430] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-02T18:33:26.672976] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-02T18:33:26.951893] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-02T18:33:27.432426] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T18:33:27.472961] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-02T18:33:28.273002] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-02T18:33:28.482042] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T18:33:29.075633] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-02T18:33:29.081765] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T18:33:29.586555] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T18:33:29.588724] [INFO ] [REMOTE ] DVA: Full fetch complete (59775 records). [2025-10-02T18:33:29.588816] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-02T18:33:29.878099] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-02T18:33:30.012527] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-02T18:33:30.012606] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-02T18:33:30.013569] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-02T18:33:30.013635] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-02T18:33:30.014875] [DEBUG] [LOCAL ] DVA: Trimmed 59775 records to 41335 (keeping 200 days of data) [2025-10-02T18:33:30.269278] [DEBUG] [LOCAL ] DVA: Primary data saved (41335 records). [2025-10-02T18:33:30.269411] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-02T18:33:30.269490] [INFO ] [MAIN ] Update Progress: 669/2370 symbols completed. DVA took 35.9s. Estimated remaining: 3h 57m 35s. Rate: 7.2 symbols/min [2025-10-02T18:33:30.457829] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:33:30.495001] [DEBUG] [LOCAL ] DXYZ: Loaded 36866 existing records from primary storage. [2025-10-02T18:33:30.495300] [INFO ] [MAIN ] DXYZ: Loaded 36866 existing records. [2025-10-02T18:33:30.678091] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-02T18:33:30.682099] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:33:30.683095] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-02T18:33:30.683160] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-02T18:33:30.684428] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-02T18:33:30.684493] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-02T18:33:31.088153] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:33:31.323411] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-02T18:33:31.473003] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-02T18:33:31.640948] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T18:33:32.272986] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-02T18:33:32.630793] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-02T18:33:33.072943] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-02T18:33:33.364617] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T18:33:33.717932] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T18:33:33.872999] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-02T18:33:34.537196] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T18:33:34.672997] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-10-02T18:33:35.473025] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-02T18:33:35.592981] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-02T18:33:36.273010] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-02T18:33:37.073030] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-02T18:33:37.343363] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-10-02T18:33:37.343700] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-02T18:33:37.357724] [INFO ] [REMOTE ] DVN: Full fetch complete (77766 records). [2025-10-02T18:33:37.357868] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-02T18:33:37.782476] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-02T18:33:37.782568] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-02T18:33:37.783488] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-02T18:33:37.783567] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-02T18:33:37.785184] [DEBUG] [LOCAL ] DVN: Trimmed 77766 records to 54089 (keeping 200 days of data) [2025-10-02T18:33:37.888328] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-02T18:33:38.162301] [DEBUG] [LOCAL ] DVN: Primary data saved (54089 records). [2025-10-02T18:33:38.162504] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-02T18:33:38.164108] [INFO ] [MAIN ] Update Progress: 670/2370 symbols completed. DVN took 40.7s. Estimated remaining: 3h 57m 25s. Rate: 7.2 symbols/min [2025-10-02T18:33:38.353903] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:33:38.392825] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-10-02T18:33:38.432336] [DEBUG] [LOCAL ] DY: Loaded 29088 existing records from primary storage. [2025-10-02T18:33:38.432633] [INFO ] [MAIN ] DY: Loaded 29088 existing records. [2025-10-02T18:33:38.594369] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T18:33:38.678697] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-02T18:33:38.685638] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:33:38.686703] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-02T18:33:38.686783] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-02T18:33:38.688139] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-02T18:33:38.688204] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-02T18:33:39.077921] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:33:39.473038] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-10-02T18:33:40.266838] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-10-02T18:33:40.277500] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-02T18:33:40.313180] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T18:33:40.685877] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T18:33:41.072998] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-02T18:33:41.873016] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-02T18:33:42.257200] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-02T18:33:42.673038] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-02T18:33:42.804826] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T18:33:43.190539] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T18:33:43.192201] [INFO ] [REMOTE ] DXC: Full fetch complete (68921 records). [2025-10-02T18:33:43.192318] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-02T18:33:43.193175] [FATAL] [VALIDATOR ] DXC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:33:43.193320] [FATAL] [MAIN ] DXC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:33:43.193403] [WARN ] [MAIN ] DXC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:33:43.193527] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-02T18:33:43.193608] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-10-02T18:33:43.193677] [INFO ] [LOCAL ] DXC: Starting deletion of derivative data. [2025-10-02T18:33:43.194252] [DEBUG] [LOCAL ] DXC: Deleted derivative data file. [2025-10-02T18:33:43.194353] [INFO ] [MAIN ] Update Progress: 671/2370 symbols completed. DXC took 24.7s. Estimated remaining: 3h 57m 9s. Rate: 7.2 symbols/min [2025-10-02T18:33:43.383691] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:33:43.417562] [DEBUG] [LOCAL ] E: Loaded 33300 existing records from primary storage. [2025-10-02T18:33:43.417902] [INFO ] [MAIN ] E: Loaded 33300 existing records. [2025-10-02T18:33:43.485599] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-02T18:33:43.620526] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:33:43.620782] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-02T18:33:43.620836] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-02T18:33:43.621977] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-02T18:33:43.622040] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-02T18:33:44.008618] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:33:44.272977] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-10-02T18:33:44.548882] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T18:33:45.073031] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-02T18:33:45.592719] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-02T18:33:45.873002] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-02T18:33:45.953590] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-10-02T18:33:46.673037] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-02T18:33:47.011338] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-02T18:33:47.013431] [INFO ] [REMOTE ] DX: Full fetch complete (75462 records). [2025-10-02T18:33:47.013553] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-02T18:33:47.450494] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-02T18:33:47.450715] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-02T18:33:47.451769] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-02T18:33:47.451957] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-02T18:33:47.470917] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T18:33:47.478125] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-02T18:33:47.479804] [DEBUG] [LOCAL ] DX: Trimmed 75462 records to 52848 (keeping 200 days of data) [2025-10-02T18:33:47.830469] [DEBUG] [LOCAL ] DX: Primary data saved (52848 records). [2025-10-02T18:33:47.830622] [INFO ] [MAIN ] DX: Full history saved. [2025-10-02T18:33:47.830743] [INFO ] [MAIN ] Update Progress: 672/2370 symbols completed. DX took 38.3s. Estimated remaining: 3h 56m 51s. Rate: 7.2 symbols/min [2025-10-02T18:33:48.041669] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:33:48.041948] [DEBUG] [LOCAL ] EAF: No existing data file found in primary storage. [2025-10-02T18:33:48.042118] [WARN ] [MAIN ] EAF: No existing data found, performing full refresh instead. [2025-10-02T18:33:48.042386] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-02T18:33:48.042602] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-02T18:33:48.042799] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-10-02T18:33:48.043001] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-02T18:33:48.145515] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T18:33:48.279457] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-02T18:33:48.563035] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:33:48.910110] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:33:49.073041] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-02T18:33:49.691589] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T18:33:49.873017] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-02T18:33:50.600473] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T18:33:50.673024] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-10-02T18:33:51.304688] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T18:33:51.473016] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-02T18:33:52.272987] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-02T18:33:52.369893] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:33:53.072982] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-02T18:33:53.195828] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T18:33:53.750067] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:33:53.873006] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-02T18:33:54.335144] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T18:33:54.673017] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-02T18:33:55.234789] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T18:33:55.473060] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-02T18:33:56.052102] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T18:33:56.272999] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-02T18:33:56.998362] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T18:33:57.073007] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-02T18:33:57.873041] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-02T18:33:57.876314] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T18:33:57.988375] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T18:33:58.672999] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-02T18:33:59.017588] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T18:33:59.473012] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-02T18:34:00.273017] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-02T18:34:00.636432] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T18:34:01.073027] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-02T18:34:01.224601] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T18:34:01.306980] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T18:34:01.872976] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-02T18:34:02.673027] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-02T18:34:02.794175] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T18:34:03.050686] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-02T18:34:03.472997] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-02T18:34:03.980239] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T18:34:04.273015] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-02T18:34:04.849672] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T18:34:05.073044] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-02T18:34:05.577733] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T18:34:05.873013] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-02T18:34:06.673061] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-02T18:34:07.365212] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-02T18:34:07.473026] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-02T18:34:07.512474] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T18:34:08.151799] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T18:34:08.273009] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-02T18:34:09.073058] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-02T18:34:09.352560] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-02T18:34:09.794399] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T18:34:09.873032] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-02T18:34:10.109006] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T18:34:10.110461] [INFO ] [REMOTE ] DY: Full fetch complete (44552 records). [2025-10-02T18:34:10.110558] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-02T18:34:10.543434] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-02T18:34:10.543520] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-02T18:34:10.544152] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-02T18:34:10.544218] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-02T18:34:10.545472] [DEBUG] [LOCAL ] DY: Trimmed 44552 records to 29225 (keeping 200 days of data) [2025-10-02T18:34:10.673558] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-02T18:34:10.734163] [DEBUG] [LOCAL ] DY: Primary data saved (29225 records). [2025-10-02T18:34:10.734291] [INFO ] [MAIN ] DY: Full history saved. [2025-10-02T18:34:10.735095] [INFO ] [MAIN ] Update Progress: 673/2370 symbols completed. DY took 32.6s. Estimated remaining: 3h 57m 19s. Rate: 7.2 symbols/min [2025-10-02T18:34:10.910172] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:10.917225] [DEBUG] [LOCAL ] EAI: Loaded 3969 existing records from primary storage. [2025-10-02T18:34:10.917447] [INFO ] [MAIN ] EAI: Loaded 3969 existing records. [2025-10-02T18:34:11.115688] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:34:11.115994] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-02T18:34:11.116062] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-02T18:34:11.116508] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-02T18:34:11.116587] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-02T18:34:11.473382] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-02T18:34:11.512977] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:11.953621] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-02T18:34:12.272999] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-10-02T18:34:12.499737] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T18:34:12.713856] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T18:34:12.715601] [INFO ] [REMOTE ] E: Full fetch complete (48268 records). [2025-10-02T18:34:12.715731] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-02T18:34:13.059572] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T18:34:13.092399] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-02T18:34:13.150082] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-02T18:34:13.150166] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-02T18:34:13.150842] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-02T18:34:13.150906] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-02T18:34:13.152167] [DEBUG] [LOCAL ] E: Trimmed 48268 records to 33524 (keeping 200 days of data) [2025-10-02T18:34:13.365327] [DEBUG] [LOCAL ] E: Primary data saved (33524 records). [2025-10-02T18:34:13.365474] [INFO ] [MAIN ] E: Full history saved. [2025-10-02T18:34:13.365558] [INFO ] [MAIN ] Update Progress: 674/2370 symbols completed. E took 30.2s. Estimated remaining: 3h 56m 56s. Rate: 7.2 symbols/min [2025-10-02T18:34:13.566787] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:13.598455] [DEBUG] [LOCAL ] EARN: Loaded 29659 existing records from primary storage. [2025-10-02T18:34:13.598791] [INFO ] [MAIN ] EARN: Loaded 29659 existing records. [2025-10-02T18:34:13.713163] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T18:34:13.816696] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:34:13.816930] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-02T18:34:13.816980] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-02T18:34:13.818050] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-02T18:34:13.818129] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-02T18:34:13.879438] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-02T18:34:14.258543] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:14.673025] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-02T18:34:15.473015] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-02T18:34:15.887885] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-02T18:34:15.890132] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57789 records). [2025-10-02T18:34:15.890232] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-02T18:34:16.084626] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-02T18:34:16.281071] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-10-02T18:34:16.318627] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-02T18:34:16.318732] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-02T18:34:16.319440] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-02T18:34:16.319609] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-02T18:34:16.320960] [DEBUG] [LOCAL ] DXYZ: Trimmed 57789 records to 37235 (keeping 200 days of data) [2025-10-02T18:34:16.548512] [DEBUG] [LOCAL ] DXYZ: Primary data saved (37235 records). [2025-10-02T18:34:16.548678] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-02T18:34:16.548797] [INFO ] [MAIN ] Update Progress: 675/2370 symbols completed. DXYZ took 46.3s. Estimated remaining: 3h 56m 35s. Rate: 7.2 symbols/min [2025-10-02T18:34:16.746540] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:16.836697] [DEBUG] [LOCAL ] EAT: Loaded 49771 existing records from primary storage. [2025-10-02T18:34:16.839169] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-02T18:34:16.839507] [INFO ] [MAIN ] EAT: Loaded 49771 existing records. [2025-10-02T18:34:17.091817] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-02T18:34:17.097211] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:34:17.098525] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-02T18:34:17.098626] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-02T18:34:17.100271] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-02T18:34:17.100337] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-02T18:34:17.496114] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:17.722434] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-02T18:34:17.873010] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-02T18:34:18.318155] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T18:34:18.535665] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-02T18:34:18.673016] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-02T18:34:19.473037] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-10-02T18:34:20.150176] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T18:34:20.273000] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-02T18:34:21.073002] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-02T18:34:21.527374] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T18:34:21.592509] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-02T18:34:21.635320] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-10-02T18:34:21.872999] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-02T18:34:22.673008] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-02T18:34:23.473011] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-02T18:34:23.552572] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T18:34:23.629209] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:34:23.630982] [INFO ] [REMOTE ] EAF: Full fetch complete (63579 records). [2025-10-02T18:34:23.631102] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-02T18:34:24.089003] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-02T18:34:24.089084] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-02T18:34:24.089842] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-02T18:34:24.089905] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-02T18:34:24.091230] [DEBUG] [LOCAL ] EAF: Trimmed 63579 records to 42985 (keeping 200 days of data) [2025-10-02T18:34:24.294022] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-02T18:34:24.356150] [DEBUG] [LOCAL ] EAF: Primary data saved (42985 records). [2025-10-02T18:34:24.356355] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-02T18:34:24.356503] [INFO ] [MAIN ] Update Progress: 676/2370 symbols completed. EAF took 36.5s. Estimated remaining: 3h 56m 25s. Rate: 7.2 symbols/min [2025-10-02T18:34:24.576053] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:24.613795] [DEBUG] [LOCAL ] EB: Loaded 37100 existing records from primary storage. [2025-10-02T18:34:24.614180] [INFO ] [MAIN ] EB: Loaded 37100 existing records. [2025-10-02T18:34:24.837024] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:34:24.837244] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-02T18:34:24.837295] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-02T18:34:24.838513] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-02T18:34:24.838592] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-02T18:34:25.081098] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-02T18:34:25.203104] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T18:34:25.296961] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:25.832574] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-02T18:34:25.873014] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-10-02T18:34:26.235381] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-02T18:34:26.673010] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-02T18:34:27.250625] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T18:34:27.472968] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-02T18:34:27.669508] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T18:34:27.869291] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-02T18:34:28.272999] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-02T18:34:28.862840] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T18:34:29.072999] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-02T18:34:29.458618] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T18:34:29.459600] [INFO ] [REMOTE ] EAI: Full fetch complete (6131 records). [2025-10-02T18:34:29.459700] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-02T18:34:29.460129] [FATAL] [VALIDATOR ] EAI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:34:29.460214] [FATAL] [MAIN ] EAI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:34:29.460323] [WARN ] [MAIN ] EAI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:34:29.460400] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-02T18:34:29.460490] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-02T18:34:29.460553] [INFO ] [LOCAL ] EAI: Starting deletion of derivative data. [2025-10-02T18:34:29.461029] [DEBUG] [LOCAL ] EAI: Deleted derivative data file. [2025-10-02T18:34:29.461122] [INFO ] [MAIN ] Update Progress: 677/2370 symbols completed. EAI took 18.7s. Estimated remaining: 3h 56m 8s. Rate: 7.2 symbols/min [2025-10-02T18:34:29.872986] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-02T18:34:30.673004] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-02T18:34:31.423604] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:34:31.472989] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-02T18:34:32.239534] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T18:34:32.273030] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-02T18:34:33.073175] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-02T18:34:33.074550] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T18:34:33.759985] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T18:34:33.872997] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-02T18:34:34.672982] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-02T18:34:34.854558] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T18:34:35.306808] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:34:35.473012] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-02T18:34:36.258949] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:34:36.272974] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-02T18:34:36.945903] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T18:34:37.073056] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-02T18:34:37.748367] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T18:34:37.873067] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-02T18:34:38.661864] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:34:38.672952] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-02T18:34:38.994434] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T18:34:39.472995] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-02T18:34:40.070794] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T18:34:40.273124] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-02T18:34:40.980718] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T18:34:41.073066] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-02T18:34:41.629940] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T18:34:41.873051] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-02T18:34:42.673042] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-02T18:34:43.139861] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-02T18:34:43.300881] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T18:34:43.472965] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-02T18:34:44.275128] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-02T18:34:44.276869] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T18:34:45.015175] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T18:34:45.073028] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-02T18:34:45.417144] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T18:34:45.873002] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-02T18:34:46.673056] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-02T18:34:46.971351] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-02T18:34:47.285791] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T18:34:47.473051] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-02T18:34:47.590887] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-02T18:34:47.592489] [INFO ] [REMOTE ] EARN: Full fetch complete (46022 records). [2025-10-02T18:34:47.592590] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-02T18:34:47.999792] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-10-02T18:34:47.999888] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-10-02T18:34:48.000524] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-10-02T18:34:48.000574] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-10-02T18:34:48.001762] [DEBUG] [LOCAL ] EARN: Trimmed 46022 records to 29843 (keeping 200 days of data) [2025-10-02T18:34:48.191505] [DEBUG] [LOCAL ] EARN: Primary data saved (29843 records). [2025-10-02T18:34:48.191686] [INFO ] [MAIN ] EARN: Full history saved. [2025-10-02T18:34:48.191788] [INFO ] [MAIN ] Update Progress: 678/2370 symbols completed. EARN took 34.8s. Estimated remaining: 3h 56m 26s. Rate: 7.2 symbols/min [2025-10-02T18:34:48.273019] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-02T18:34:49.163575] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:34:49.174406] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-02T18:34:49.717449] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T18:34:49.873003] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-02T18:34:50.943719] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:34:50.945447] [INFO ] [REMOTE ] EB: Full fetch complete (55971 records). [2025-10-02T18:34:50.945569] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-02T18:34:50.946453] [FATAL] [VALIDATOR ] EB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:34:50.946580] [FATAL] [MAIN ] EB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:34:50.946637] [WARN ] [MAIN ] EB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:34:50.946752] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-02T18:34:50.946833] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-10-02T18:34:50.946883] [INFO ] [LOCAL ] EB: Starting deletion of derivative data. [2025-10-02T18:34:50.947534] [DEBUG] [LOCAL ] EB: Deleted derivative data file. [2025-10-02T18:34:50.947686] [INFO ] [MAIN ] Update Progress: 679/2370 symbols completed. EB took 26.6s. Estimated remaining: 3h 56m 3s. Rate: 7.2 symbols/min [2025-10-02T18:34:51.063536] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T18:34:51.075205] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-02T18:34:52.587844] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T18:34:52.589965] [INFO ] [REMOTE ] EAT: Full fetch complete (71954 records). [2025-10-02T18:34:52.590131] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-02T18:34:53.019141] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-02T18:34:53.019248] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-02T18:34:53.020244] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-02T18:34:53.020316] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-02T18:34:53.022000] [DEBUG] [LOCAL ] EAT: Trimmed 71954 records to 50148 (keeping 200 days of data) [2025-10-02T18:34:53.341349] [DEBUG] [LOCAL ] EAT: Primary data saved (50148 records). [2025-10-02T18:34:53.341512] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-02T18:34:53.341614] [INFO ] [MAIN ] Update Progress: 680/2370 symbols completed. EAT took 36.8s. Estimated remaining: 3h 55m 40s. Rate: 7.2 symbols/min [2025-10-02T18:34:53.977170] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:54.060095] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:54.095406] [DEBUG] [LOCAL ] EBS: No existing data file found in primary storage. [2025-10-02T18:34:54.110456] [WARN ] [MAIN ] EBS: No existing data found, performing full refresh instead. [2025-10-02T18:34:54.136424] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-02T18:34:54.137674] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:54.158786] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-02T18:34:54.159213] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-02T18:34:54.158687] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:34:54.159838] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-02T18:34:54.159957] [DEBUG] [LOCAL ] EC: No existing data file found in primary storage. [2025-10-02T18:34:54.187471] [WARN ] [MAIN ] EC: No existing data found, performing full refresh instead. [2025-10-02T18:34:54.187811] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-02T18:34:54.187870] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-02T18:34:54.200202] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-02T18:34:54.200409] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-02T18:34:54.274370] [DEBUG] [LOCAL ] EBF: Loaded 19238 existing records from primary storage. [2025-10-02T18:34:54.322369] [INFO ] [MAIN ] EBF: Loaded 19238 existing records. [2025-10-02T18:34:54.759229] [DEBUG] [LOCAL ] EBR: Loaded 43061 existing records from primary storage. [2025-10-02T18:34:54.878082] [INFO ] [MAIN ] EBR: Loaded 43061 existing records. [2025-10-02T18:34:55.044226] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:34:55.102330] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-02T18:34:55.132075] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-02T18:34:55.267314] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:55.274778] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-10-02T18:34:55.274453] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-02T18:34:55.302539] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-02T18:34:55.473476] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:55.518634] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-10-02T18:34:55.562997] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:34:55.573200] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-02T18:34:55.582975] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-02T18:34:55.592892] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-10-02T18:34:55.592995] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-02T18:34:56.191006] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:56.204253] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-10-02T18:34:56.295871] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:34:56.296239] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-10-02T18:34:57.092761] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T18:34:57.102597] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-02T18:34:57.567839] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T18:34:57.578860] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-02T18:34:57.662090] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:34:57.665903] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-02T18:34:58.171540] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T18:34:58.181835] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-02T18:34:58.209188] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T18:34:58.219699] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-02T18:34:58.603121] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T18:34:58.673018] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-02T18:34:58.862005] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T18:34:59.457839] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T18:34:59.472957] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-02T18:34:59.502313] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-02T18:34:59.551563] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T18:35:00.273033] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-02T18:35:01.072973] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-02T18:35:01.503909] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-02T18:35:01.557273] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T18:35:01.873022] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-02T18:35:02.673032] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-02T18:35:03.099027] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-02T18:35:03.473001] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-02T18:35:03.826829] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-02T18:35:04.043813] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T18:35:04.272972] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-02T18:35:04.597717] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T18:35:05.073016] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-02T18:35:05.872980] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-02T18:35:05.942081] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T18:35:06.683234] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-02T18:35:06.705901] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T18:35:07.473013] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-02T18:35:07.654490] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T18:35:08.100791] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T18:35:08.272994] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-02T18:35:08.616602] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T18:35:09.073009] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-02T18:35:09.852030] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T18:35:09.872964] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-02T18:35:10.533449] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T18:35:10.673013] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-02T18:35:11.472987] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-02T18:35:11.516083] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T18:35:11.750318] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-02T18:35:12.273003] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-02T18:35:12.958323] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T18:35:13.073030] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-02T18:35:13.575245] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T18:35:13.872995] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-02T18:35:14.396476] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T18:35:14.672994] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-02T18:35:15.269591] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T18:35:15.473029] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-02T18:35:16.249419] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T18:35:16.280761] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-02T18:35:16.286883] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T18:35:17.072960] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-02T18:35:17.389476] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T18:35:17.873010] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-02T18:35:18.442368] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T18:35:18.673057] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-02T18:35:19.472983] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-02T18:35:19.571548] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T18:35:20.272972] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-02T18:35:20.344059] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T18:35:21.073013] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-02T18:35:21.392130] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T18:35:21.442604] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:35:21.444138] [INFO ] [REMOTE ] EBS: Full fetch complete (67029 records). [2025-10-02T18:35:21.444305] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-02T18:35:21.445229] [FATAL] [VALIDATOR ] EBS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:35:21.445339] [FATAL] [MAIN ] EBS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:35:21.445401] [WARN ] [MAIN ] EBS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:35:21.445479] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-02T18:35:21.445554] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-10-02T18:35:21.445603] [INFO ] [LOCAL ] EBS: Starting deletion of derivative data. [2025-10-02T18:35:21.445708] [DEBUG] [LOCAL ] EBS: No derivative data file found to delete. [2025-10-02T18:35:21.445804] [INFO ] [MAIN ] Update Progress: 681/2370 symbols completed. EBS took 28.1s. Estimated remaining: 3h 56m 21s. Rate: 7.1 symbols/min [2025-10-02T18:35:21.630634] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:35:21.672998] [DEBUG] [LOCAL ] ECAT: Loaded 29543 existing records from primary storage. [2025-10-02T18:35:21.673257] [INFO ] [MAIN ] ECAT: Loaded 29543 existing records. [2025-10-02T18:35:21.870429] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:35:21.871064] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-02T18:35:21.871115] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-02T18:35:21.872209] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-02T18:35:21.872274] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-02T18:35:21.884189] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-02T18:35:22.324631] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:35:22.325876] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T18:35:22.673000] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-02T18:35:23.460939] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T18:35:23.472967] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-02T18:35:24.273010] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-02T18:35:24.319183] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T18:35:24.736847] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:35:24.900812] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T18:35:24.901826] [INFO ] [REMOTE ] EBF: Full fetch complete (27347 records). [2025-10-02T18:35:24.901903] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-02T18:35:24.902450] [FATAL] [VALIDATOR ] EBF: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:35:24.902535] [FATAL] [MAIN ] EBF: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:35:24.902580] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:35:24.902621] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-02T18:35:24.902711] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-02T18:35:24.902761] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-10-02T18:35:24.903158] [DEBUG] [LOCAL ] EBF: Deleted derivative data file. [2025-10-02T18:35:24.903248] [INFO ] [MAIN ] Update Progress: 682/2370 symbols completed. EBF took 31.6s. Estimated remaining: 3h 56m 0s. Rate: 7.2 symbols/min [2025-10-02T18:35:25.082161] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-02T18:35:25.115057] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:35:25.159786] [DEBUG] [LOCAL ] ECC: Loaded 43320 existing records from primary storage. [2025-10-02T18:35:25.160105] [INFO ] [MAIN ] ECC: Loaded 43320 existing records. [2025-10-02T18:35:25.406931] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:35:25.407202] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-02T18:35:25.407262] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-02T18:35:25.408612] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-10-02T18:35:25.408708] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-02T18:35:25.817275] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:35:25.872984] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-02T18:35:26.365977] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T18:35:26.367760] [INFO ] [REMOTE ] EBR: Full fetch complete (62615 records). [2025-10-02T18:35:26.367852] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-02T18:35:26.678095] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-10-02T18:35:26.803599] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-02T18:35:26.803724] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-02T18:35:26.804616] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-02T18:35:26.804743] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-02T18:35:26.806125] [DEBUG] [LOCAL ] EBR: Trimmed 62615 records to 43379 (keeping 200 days of data) [2025-10-02T18:35:27.075291] [DEBUG] [LOCAL ] EBR: Primary data saved (43379 records). [2025-10-02T18:35:27.075460] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-02T18:35:27.075578] [INFO ] [MAIN ] Update Progress: 683/2370 symbols completed. EBR took 33.7s. Estimated remaining: 3h 55m 36s. Rate: 7.2 symbols/min [2025-10-02T18:35:27.279768] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:35:27.280104] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-02T18:35:27.280164] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-02T18:35:27.280284] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-02T18:35:27.280338] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-02T18:35:27.280392] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-02T18:35:27.280434] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-02T18:35:27.385989] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T18:35:27.410339] [INFO ] [REMOTE ] EC: Full fetch complete (71911 records). [2025-10-02T18:35:27.420770] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-02T18:35:27.483569] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-10-02T18:35:27.997669] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:35:28.227401] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-10-02T18:35:28.227517] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-10-02T18:35:28.228527] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-10-02T18:35:28.228636] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-10-02T18:35:28.230326] [DEBUG] [LOCAL ] EC: Trimmed 71911 records to 49591 (keeping 200 days of data) [2025-10-02T18:35:28.283775] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-10-02T18:35:28.476223] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T18:35:28.578725] [DEBUG] [LOCAL ] EC: Primary data saved (49591 records). [2025-10-02T18:35:28.578873] [INFO ] [MAIN ] EC: Full history saved. [2025-10-02T18:35:28.578966] [INFO ] [MAIN ] Update Progress: 684/2370 symbols completed. EC took 35.2s. Estimated remaining: 3h 55m 11s. Rate: 7.2 symbols/min [2025-10-02T18:35:28.776058] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:35:28.776439] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-10-02T18:35:28.776602] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-10-02T18:35:28.776806] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-02T18:35:28.776875] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-02T18:35:28.777039] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-02T18:35:28.777181] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-02T18:35:28.911790] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T18:35:29.015887] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:35:29.078578] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-02T18:35:29.207487] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:35:29.872997] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-10-02T18:35:30.411204] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-02T18:35:30.429773] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:35:30.673004] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-02T18:35:31.071667] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T18:35:31.473048] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-02T18:35:31.900419] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T18:35:32.273055] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-02T18:35:33.073072] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-02T18:35:33.589963] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T18:35:33.873002] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-02T18:35:34.201443] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-02T18:35:34.633264] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T18:35:34.672977] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-02T18:35:35.472947] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-02T18:35:36.025281] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T18:35:36.273047] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-02T18:35:36.904738] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T18:35:36.904540] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:35:37.073025] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-02T18:35:37.596755] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-02T18:35:37.872998] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-02T18:35:38.673014] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-02T18:35:39.263285] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:35:39.473027] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-02T18:35:40.273011] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-02T18:35:40.323162] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:35:40.507475] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T18:35:40.645241] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-02T18:35:41.073010] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-02T18:35:41.553220] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-02T18:35:41.873018] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-02T18:35:42.230084] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-02T18:35:42.673036] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-02T18:35:43.473016] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-02T18:35:43.929422] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T18:35:44.273060] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-02T18:35:45.073009] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-02T18:35:45.410322] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T18:35:45.616546] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-02T18:35:45.637795] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T18:35:45.872989] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-02T18:35:46.673095] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-02T18:35:47.035036] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-02T18:35:47.478122] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-02T18:35:47.491491] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T18:35:48.258152] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T18:35:48.272990] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-02T18:35:48.637932] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-02T18:35:49.073042] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-02T18:35:49.872990] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-02T18:35:50.185473] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-02T18:35:50.573375] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T18:35:50.673020] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-02T18:35:51.473000] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-02T18:35:51.921608] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T18:35:52.229738] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T18:35:52.272967] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-02T18:35:53.073007] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-02T18:35:53.511871] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T18:35:53.513118] [INFO ] [REMOTE ] ECCC: Full fetch complete (1296 records). [2025-10-02T18:35:53.513206] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-02T18:35:53.728832] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-02T18:35:53.729026] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:35:53.729218] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:35:53.729417] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-02T18:35:53.729516] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-02T18:35:53.729584] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-02T18:35:53.729674] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-02T18:35:53.729871] [INFO ] [MAIN ] Update Progress: 685/2370 symbols completed. ECCC took 26.7s. Estimated remaining: 3h 55m 44s. Rate: 7.1 symbols/min [2025-10-02T18:35:53.892984] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-02T18:35:53.925454] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:35:53.925836] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-02T18:35:53.927180] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-02T18:35:53.955346] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-02T18:35:53.955694] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-02T18:35:53.957503] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T18:35:53.956187] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-02T18:35:53.968245] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-02T18:35:54.372468] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:35:54.673058] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-02T18:35:55.125741] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T18:35:55.127168] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T18:35:55.473052] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-02T18:35:56.273041] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-10-02T18:35:56.905350] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-02T18:35:57.073074] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-02T18:35:57.303491] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T18:35:57.402198] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-02T18:35:57.873002] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-02T18:35:58.420350] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-02T18:35:58.673002] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-02T18:35:59.473046] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-02T18:35:59.999316] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T18:36:00.273012] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-02T18:36:00.351368] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T18:36:00.948899] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-02T18:36:01.072986] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-02T18:36:01.873013] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-02T18:36:02.522813] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T18:36:02.524822] [INFO ] [REMOTE ] ECC: Full fetch complete (61061 records). [2025-10-02T18:36:02.525004] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-02T18:36:02.680108] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-02T18:36:02.950170] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-02T18:36:02.950263] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-02T18:36:02.951088] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-02T18:36:02.951186] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-02T18:36:02.952736] [DEBUG] [LOCAL ] ECC: Trimmed 61061 records to 43668 (keeping 200 days of data) [2025-10-02T18:36:03.048800] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-02T18:36:03.055134] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T18:36:03.062049] [INFO ] [REMOTE ] ECAT: Full fetch complete (42721 records). [2025-10-02T18:36:03.063685] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-02T18:36:03.067267] [FATAL] [VALIDATOR ] ECAT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:36:03.068303] [FATAL] [MAIN ] ECAT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:36:03.069242] [WARN ] [MAIN ] ECAT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:36:03.069327] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-02T18:36:03.070252] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-02T18:36:03.070952] [INFO ] [LOCAL ] ECAT: Starting deletion of derivative data. [2025-10-02T18:36:03.071868] [DEBUG] [LOCAL ] ECAT: Deleted derivative data file. [2025-10-02T18:36:03.072680] [INFO ] [MAIN ] Update Progress: 686/2370 symbols completed. ECAT took 41.6s. Estimated remaining: 3h 55m 38s. Rate: 7.1 symbols/min [2025-10-02T18:36:03.308478] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:03.309411] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-02T18:36:03.310071] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-02T18:36:03.310774] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-02T18:36:03.311135] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-02T18:36:03.311685] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-02T18:36:03.312376] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-02T18:36:03.504032] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-02T18:36:03.832226] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:03.878288] [DEBUG] [LOCAL ] ECC: Primary data saved (43668 records). [2025-10-02T18:36:03.878453] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-02T18:36:03.879348] [INFO ] [MAIN ] Update Progress: 687/2370 symbols completed. ECC took 39.0s. Estimated remaining: 3h 55m 11s. Rate: 7.2 symbols/min [2025-10-02T18:36:04.062254] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:04.109140] [DEBUG] [LOCAL ] ECG: Loaded 33834 existing records from primary storage. [2025-10-02T18:36:04.109427] [INFO ] [MAIN ] ECG: Loaded 33834 existing records. [2025-10-02T18:36:04.278235] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-10-02T18:36:04.310026] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:36:04.310540] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-02T18:36:04.310603] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-02T18:36:04.311752] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-02T18:36:04.311815] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-02T18:36:04.592368] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T18:36:04.717277] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:04.991586] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T18:36:05.072998] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-10-02T18:36:05.872988] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-02T18:36:06.315677] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-02T18:36:06.472553] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T18:36:06.672999] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-02T18:36:07.075422] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T18:36:07.473009] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-02T18:36:07.982488] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-02T18:36:08.273004] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-02T18:36:08.774037] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T18:36:08.774791] [INFO ] [REMOTE ] ECCU: Full fetch complete (4487 records). [2025-10-02T18:36:08.774864] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-02T18:36:08.968510] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-02T18:36:08.968744] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:36:08.968815] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:36:08.968887] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-02T18:36:08.968986] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-10-02T18:36:08.969043] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-10-02T18:36:08.969088] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-10-02T18:36:08.969147] [INFO ] [MAIN ] Update Progress: 688/2370 symbols completed. ECCU took 40.4s. Estimated remaining: 3h 54m 54s. Rate: 7.2 symbols/min [2025-10-02T18:36:09.078169] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-02T18:36:09.156456] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:09.231133] [DEBUG] [LOCAL ] ECL: Loaded 46734 existing records from primary storage. [2025-10-02T18:36:09.231473] [INFO ] [MAIN ] ECL: Loaded 46734 existing records. [2025-10-02T18:36:09.452436] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:36:09.452681] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-02T18:36:09.452742] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-02T18:36:09.454280] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-02T18:36:09.454362] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-02T18:36:09.867149] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:09.872957] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-10-02T18:36:10.457015] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T18:36:10.673027] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-02T18:36:11.071881] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-02T18:36:11.472984] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-02T18:36:11.784975] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T18:36:11.805458] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-02T18:36:12.272998] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-02T18:36:13.072985] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-02T18:36:13.403543] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T18:36:13.872996] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-02T18:36:13.971200] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T18:36:14.567496] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-02T18:36:14.673017] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-02T18:36:15.473047] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-02T18:36:16.147619] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T18:36:16.273024] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-02T18:36:16.824882] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T18:36:16.827888] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:36:17.072992] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-02T18:36:17.562325] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T18:36:17.873005] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-02T18:36:18.673007] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-02T18:36:19.257402] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T18:36:19.420069] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T18:36:19.472996] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-02T18:36:19.810326] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-02T18:36:20.272995] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-02T18:36:20.596001] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-02T18:36:21.072999] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-02T18:36:21.872995] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-02T18:36:22.291938] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-02T18:36:22.673001] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-02T18:36:22.859042] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T18:36:22.991901] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-02T18:36:23.473006] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-02T18:36:23.887715] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-02T18:36:24.273008] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-02T18:36:24.638879] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-10-02T18:36:24.639564] [INFO ] [REMOTE ] ECCX: Full fetch complete (1523 records). [2025-10-02T18:36:24.639634] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-02T18:36:24.855061] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-02T18:36:24.855257] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:36:24.855320] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:36:24.855389] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-02T18:36:24.855502] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-02T18:36:24.855555] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-02T18:36:24.855599] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-02T18:36:24.855756] [INFO ] [MAIN ] Update Progress: 689/2370 symbols completed. ECCX took 21.8s. Estimated remaining: 3h 55m 4s. Rate: 7.2 symbols/min [2025-10-02T18:36:25.040193] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:25.068426] [DEBUG] [LOCAL ] ECO: Loaded 18402 existing records from primary storage. [2025-10-02T18:36:25.068796] [INFO ] [MAIN ] ECO: Loaded 18402 existing records. [2025-10-02T18:36:25.081597] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-02T18:36:25.273405] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:36:25.273698] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-02T18:36:25.273763] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-02T18:36:25.274509] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-02T18:36:25.274569] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-02T18:36:25.574563] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T18:36:25.575776] [INFO ] [REMOTE ] ECCW: Full fetch complete (1424 records). [2025-10-02T18:36:25.591623] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-02T18:36:25.782831] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:25.863911] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-02T18:36:25.864103] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:36:25.864172] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:36:25.864245] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-02T18:36:25.864311] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-02T18:36:25.864348] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-02T18:36:25.864388] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-02T18:36:25.864446] [INFO ] [MAIN ] Update Progress: 690/2370 symbols completed. ECCW took 32.1s. Estimated remaining: 3h 54m 38s. Rate: 7.2 symbols/min [2025-10-02T18:36:25.878095] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-10-02T18:36:26.048382] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:26.048546] [DEBUG] [LOCAL ] ECVT: No existing data file found in primary storage. [2025-10-02T18:36:26.048583] [WARN ] [MAIN ] ECVT: No existing data found, performing full refresh instead. [2025-10-02T18:36:26.048724] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-02T18:36:26.048807] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-02T18:36:26.048866] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-02T18:36:26.048901] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-02T18:36:26.434059] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:26.673046] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-10-02T18:36:27.384637] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T18:36:27.472942] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-02T18:36:28.278377] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-02T18:36:28.290121] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T18:36:29.046491] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T18:36:29.072962] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-02T18:36:29.304897] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T18:36:29.872999] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-02T18:36:30.314318] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T18:36:30.673014] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-02T18:36:31.035529] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T18:36:31.473039] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-02T18:36:31.724509] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T18:36:32.273003] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-02T18:36:32.341402] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T18:36:33.072995] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-02T18:36:33.708399] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:36:33.873000] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-02T18:36:34.139459] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T18:36:34.673006] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-02T18:36:35.292590] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T18:36:35.416951] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T18:36:35.473006] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-02T18:36:36.273022] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-02T18:36:36.664141] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:36:37.073007] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-02T18:36:37.509505] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T18:36:37.872966] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-02T18:36:38.179198] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T18:36:38.673050] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-02T18:36:39.473008] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-02T18:36:39.881309] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-02T18:36:39.896385] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T18:36:39.898139] [INFO ] [REMOTE ] ECG: Full fetch complete (51308 records). [2025-10-02T18:36:39.898249] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-02T18:36:40.279507] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-02T18:36:40.328808] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-02T18:36:40.328891] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-02T18:36:40.329783] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-02T18:36:40.329853] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-02T18:36:40.331246] [DEBUG] [LOCAL ] ECG: Trimmed 51308 records to 34056 (keeping 200 days of data) [2025-10-02T18:36:40.550553] [DEBUG] [LOCAL ] ECG: Primary data saved (34056 records). [2025-10-02T18:36:40.550746] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-02T18:36:40.551627] [INFO ] [MAIN ] Update Progress: 691/2370 symbols completed. ECG took 36.7s. Estimated remaining: 3h 54m 45s. Rate: 7.2 symbols/min [2025-10-02T18:36:40.738254] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:40.795704] [DEBUG] [LOCAL ] ED: Loaded 52758 existing records from primary storage. [2025-10-02T18:36:40.796025] [INFO ] [MAIN ] ED: Loaded 52758 existing records. [2025-10-02T18:36:41.016752] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:36:41.018690] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:36:41.026298] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-02T18:36:41.026769] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-02T18:36:41.028415] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-02T18:36:41.028476] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-02T18:36:41.078138] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-02T18:36:41.510868] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:41.512017] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T18:36:41.872985] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-02T18:36:42.678169] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-02T18:36:42.698280] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T18:36:43.473088] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-02T18:36:43.778901] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-02T18:36:43.831065] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T18:36:44.273044] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-02T18:36:44.728450] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T18:36:45.073013] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-02T18:36:45.872984] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-10-02T18:36:45.950948] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T18:36:45.983818] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T18:36:45.985040] [INFO ] [REMOTE ] ECO: Full fetch complete (28986 records). [2025-10-02T18:36:45.985122] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-02T18:36:46.418503] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-02T18:36:46.418595] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-02T18:36:46.419223] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-02T18:36:46.419295] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-02T18:36:46.420116] [DEBUG] [LOCAL ] ECO: Trimmed 28986 records to 18558 (keeping 200 days of data) [2025-10-02T18:36:46.543338] [DEBUG] [LOCAL ] ECO: Primary data saved (18558 records). [2025-10-02T18:36:46.543507] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-02T18:36:46.543605] [INFO ] [MAIN ] Update Progress: 692/2370 symbols completed. ECO took 21.7s. Estimated remaining: 3h 54m 31s. Rate: 7.2 symbols/min [2025-10-02T18:36:46.678120] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-02T18:36:46.737699] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:46.765247] [DEBUG] [LOCAL ] EDD: Loaded 27172 existing records from primary storage. [2025-10-02T18:36:46.765521] [INFO ] [MAIN ] EDD: Loaded 27172 existing records. [2025-10-02T18:36:46.953569] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:36:46.953862] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-02T18:36:46.953916] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-02T18:36:46.955002] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-10-02T18:36:46.955062] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-02T18:36:47.396740] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:47.473022] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-02T18:36:47.762813] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T18:36:48.272968] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-02T18:36:48.507846] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T18:36:48.730961] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T18:36:49.073029] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-02T18:36:49.754816] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T18:36:49.873015] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-02T18:36:50.268065] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T18:36:50.673028] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-02T18:36:51.333983] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T18:36:51.473028] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-02T18:36:52.273024] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-02T18:36:52.337893] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T18:36:52.908980] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:36:53.073027] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-02T18:36:53.872980] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-10-02T18:36:54.132720] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T18:36:54.673015] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-02T18:36:54.825928] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T18:36:55.198344] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T18:36:55.473053] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-02T18:36:56.208462] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T18:36:56.272974] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-02T18:36:56.853751] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T18:36:56.857548] [INFO ] [REMOTE ] ECL: Full fetch complete (68023 records). [2025-10-02T18:36:56.857687] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-02T18:36:57.080518] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-02T18:36:57.296126] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-02T18:36:57.296252] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-02T18:36:57.297110] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-02T18:36:57.297174] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-02T18:36:57.298624] [DEBUG] [LOCAL ] ECL: Trimmed 68023 records to 47096 (keeping 200 days of data) [2025-10-02T18:36:57.559597] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T18:36:57.646868] [DEBUG] [LOCAL ] ECL: Primary data saved (47096 records). [2025-10-02T18:36:57.647005] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-02T18:36:57.647090] [INFO ] [MAIN ] Update Progress: 693/2370 symbols completed. ECL took 48.7s. Estimated remaining: 3h 54m 29s. Rate: 7.2 symbols/min [2025-10-02T18:36:57.849563] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:36:57.864398] [DEBUG] [LOCAL ] EDF: Loaded 13369 existing records from primary storage. [2025-10-02T18:36:57.864660] [INFO ] [MAIN ] EDF: Loaded 13369 existing records. [2025-10-02T18:36:57.878226] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-02T18:36:58.070559] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:36:58.070834] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-02T18:36:58.070900] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-02T18:36:58.071512] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-10-02T18:36:58.071577] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-02T18:36:58.455812] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:36:58.672989] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-02T18:36:59.033223] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-02T18:36:59.301947] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T18:36:59.304300] [INFO ] [REMOTE ] ECVT: Full fetch complete (60184 records). [2025-10-02T18:36:59.304402] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-02T18:36:59.473752] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-02T18:36:59.732301] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-10-02T18:36:59.732420] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-10-02T18:36:59.733189] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-10-02T18:36:59.733253] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-10-02T18:36:59.735499] [DEBUG] [LOCAL ] ECVT: Trimmed 60184 records to 43382 (keeping 200 days of data) [2025-10-02T18:36:59.852080] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T18:37:00.022497] [DEBUG] [LOCAL ] ECVT: Primary data saved (43382 records). [2025-10-02T18:37:00.022665] [INFO ] [MAIN ] ECVT: Full history saved. [2025-10-02T18:37:00.022760] [INFO ] [MAIN ] Update Progress: 694/2370 symbols completed. ECVT took 34.2s. Estimated remaining: 3h 54m 6s. Rate: 7.2 symbols/min [2025-10-02T18:37:00.208779] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:37:00.229370] [DEBUG] [LOCAL ] EDN: Loaded 18154 existing records from primary storage. [2025-10-02T18:37:00.229701] [INFO ] [MAIN ] EDN: Loaded 18154 existing records. [2025-10-02T18:37:00.278200] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-10-02T18:37:00.437572] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:37:00.437864] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-02T18:37:00.437927] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-02T18:37:00.438689] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-02T18:37:00.438752] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-02T18:37:00.854726] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:37:01.072990] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-10-02T18:37:01.570573] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-02T18:37:01.583917] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T18:37:01.872994] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-02T18:37:02.638219] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T18:37:02.673035] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-02T18:37:03.472973] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-02T18:37:03.713408] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T18:37:03.756748] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T18:37:04.272986] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-02T18:37:04.375016] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T18:37:05.073015] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-02T18:37:05.675008] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T18:37:05.873014] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-02T18:37:06.266143] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-02T18:37:06.673023] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-02T18:37:06.952854] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T18:37:07.473003] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-02T18:37:08.177900] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T18:37:08.219400] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T18:37:08.273028] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-02T18:37:09.073009] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-02T18:37:09.419266] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T18:37:09.858344] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-02T18:37:09.872959] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-02T18:37:10.673005] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-02T18:37:11.147534] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T18:37:11.473015] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-02T18:37:11.811549] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T18:37:12.272990] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-02T18:37:12.567762] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T18:37:13.073000] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-02T18:37:13.445006] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T18:37:13.873010] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-02T18:37:14.672985] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-02T18:37:14.863238] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T18:37:15.006047] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T18:37:15.421084] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T18:37:15.473001] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-02T18:37:16.272986] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-02T18:37:16.295329] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T18:37:17.072997] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-02T18:37:17.615170] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T18:37:17.872984] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-02T18:37:18.194129] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T18:37:18.673012] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-02T18:37:18.850482] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T18:37:19.411090] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T18:37:19.472988] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-02T18:37:20.246271] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T18:37:20.272956] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-02T18:37:21.073003] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-02T18:37:21.652808] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T18:37:21.872988] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-02T18:37:22.672995] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-02T18:37:22.837099] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T18:37:23.162864] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-02T18:37:23.472993] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-02T18:37:23.528742] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-02T18:37:24.273927] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-02T18:37:24.277288] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T18:37:25.072976] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-02T18:37:25.235526] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-02T18:37:25.872999] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-02T18:37:26.069227] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-02T18:37:26.070782] [INFO ] [REMOTE ] EDD: Full fetch complete (38815 records). [2025-10-02T18:37:26.070864] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-02T18:37:26.482475] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-02T18:37:26.482612] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-02T18:37:26.483498] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-02T18:37:26.483578] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-02T18:37:26.485002] [DEBUG] [LOCAL ] EDD: Trimmed 38815 records to 27357 (keeping 200 days of data) [2025-10-02T18:37:26.663593] [DEBUG] [LOCAL ] EDD: Primary data saved (27357 records). [2025-10-02T18:37:26.663782] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-02T18:37:26.663876] [INFO ] [MAIN ] Update Progress: 695/2370 symbols completed. EDD took 40.1s. Estimated remaining: 3h 54m 42s. Rate: 7.1 symbols/min [2025-10-02T18:37:26.678841] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-02T18:37:26.855248] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:37:26.901679] [DEBUG] [LOCAL ] EDU: Loaded 44983 existing records from primary storage. [2025-10-02T18:37:26.902076] [INFO ] [MAIN ] EDU: Loaded 44983 existing records. [2025-10-02T18:37:27.115911] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:37:27.116291] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-02T18:37:27.116477] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-02T18:37:27.118784] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-02T18:37:27.118912] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-02T18:37:27.260088] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T18:37:27.478186] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-02T18:37:27.553327] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:37:28.273106] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-02T18:37:28.304773] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T18:37:28.305724] [INFO ] [REMOTE ] EDF: Full fetch complete (20847 records). [2025-10-02T18:37:28.305799] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-02T18:37:28.747889] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-10-02T18:37:28.748050] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-10-02T18:37:28.748833] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-10-02T18:37:28.749002] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-10-02T18:37:28.750461] [DEBUG] [LOCAL ] EDF: Trimmed 20847 records to 13420 (keeping 200 days of data) [2025-10-02T18:37:28.844994] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-02T18:37:28.879854] [DEBUG] [LOCAL ] EDF: Primary data saved (13420 records). [2025-10-02T18:37:28.879997] [INFO ] [MAIN ] EDF: Full history saved. [2025-10-02T18:37:28.880125] [INFO ] [MAIN ] Update Progress: 696/2370 symbols completed. EDF took 31.2s. Estimated remaining: 3h 54m 18s. Rate: 7.1 symbols/min [2025-10-02T18:37:29.078197] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-10-02T18:37:29.082056] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:37:29.117469] [DEBUG] [LOCAL ] EE: Loaded 32474 existing records from primary storage. [2025-10-02T18:37:29.117810] [INFO ] [MAIN ] EE: Loaded 32474 existing records. [2025-10-02T18:37:29.311415] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:37:29.311679] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-02T18:37:29.311741] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-02T18:37:29.314142] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-02T18:37:29.314204] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-02T18:37:29.433487] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T18:37:29.435258] [INFO ] [REMOTE ] EDN: Full fetch complete (30141 records). [2025-10-02T18:37:29.445870] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-02T18:37:29.885731] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-02T18:37:30.011928] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:37:30.138140] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-02T18:37:30.138233] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-02T18:37:30.138832] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-02T18:37:30.138901] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-02T18:37:30.139768] [DEBUG] [LOCAL ] EDN: Trimmed 30141 records to 18336 (keeping 200 days of data) [2025-10-02T18:37:30.252438] [DEBUG] [LOCAL ] EDN: Primary data saved (18336 records). [2025-10-02T18:37:30.252589] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-02T18:37:30.252703] [INFO ] [MAIN ] Update Progress: 697/2370 symbols completed. EDN took 30.2s. Estimated remaining: 3h 53m 53s. Rate: 7.2 symbols/min [2025-10-02T18:37:30.446594] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:37:30.446969] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-02T18:37:30.447092] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-02T18:37:30.447226] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-02T18:37:30.447270] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-02T18:37:30.447314] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-02T18:37:30.447347] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-02T18:37:30.681906] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-10-02T18:37:30.890563] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:37:30.909780] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T18:37:31.473023] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-02T18:37:31.526442] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-02T18:37:31.528864] [INFO ] [REMOTE ] ED: Full fetch complete (76332 records). [2025-10-02T18:37:31.528995] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-02T18:37:31.999463] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-02T18:37:31.999690] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-02T18:37:32.000735] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-02T18:37:32.000822] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-02T18:37:32.019573] [DEBUG] [LOCAL ] ED: Trimmed 76332 records to 53131 (keeping 200 days of data) [2025-10-02T18:37:32.019432] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T18:37:32.274688] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-02T18:37:32.378976] [DEBUG] [LOCAL ] ED: Primary data saved (53131 records). [2025-10-02T18:37:32.379123] [INFO ] [MAIN ] ED: Full history saved. [2025-10-02T18:37:32.379979] [INFO ] [MAIN ] Update Progress: 698/2370 symbols completed. ED took 51.8s. Estimated remaining: 3h 53m 30s. Rate: 7.2 symbols/min [2025-10-02T18:37:32.566897] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:37:32.581012] [DEBUG] [LOCAL ] EEX: Loaded 11493 existing records from primary storage. [2025-10-02T18:37:32.581269] [INFO ] [MAIN ] EEX: Loaded 11493 existing records. [2025-10-02T18:37:32.799381] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:37:32.799839] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-02T18:37:32.799897] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-02T18:37:32.800798] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-10-02T18:37:32.800862] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-02T18:37:33.079177] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-10-02T18:37:33.202177] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:37:33.234751] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T18:37:33.335964] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T18:37:33.742582] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-02T18:37:33.873017] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-02T18:37:34.673001] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-02T18:37:35.024089] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-02T18:37:35.473030] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-02T18:37:35.581877] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T18:37:36.273022] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-02T18:37:36.529441] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T18:37:36.720959] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:37:37.073010] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-02T18:37:37.395180] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-02T18:37:37.873006] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-10-02T18:37:38.673014] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-02T18:37:38.963213] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T18:37:39.473041] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-02T18:37:40.273018] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-02T18:37:40.360860] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T18:37:40.403437] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T18:37:40.853373] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T18:37:41.073025] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-02T18:37:41.549317] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-02T18:37:41.872993] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-02T18:37:42.404528] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T18:37:42.673000] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-02T18:37:43.288159] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T18:37:43.473030] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-02T18:37:44.047264] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T18:37:44.273038] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-02T18:37:45.073004] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-02T18:37:45.675197] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-02T18:37:45.694333] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T18:37:45.872982] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-02T18:37:46.271610] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-02T18:37:46.272732] [INFO ] [REMOTE ] EEA: Full fetch complete (3908 records). [2025-10-02T18:37:46.272835] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-02T18:37:46.479224] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T18:37:46.479454] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:37:46.479525] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:37:46.479627] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-02T18:37:46.479753] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-02T18:37:46.479810] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-02T18:37:46.479855] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-02T18:37:46.479921] [INFO ] [MAIN ] Update Progress: 699/2370 symbols completed. EEA took 16.2s. Estimated remaining: 3h 53m 35s. Rate: 7.2 symbols/min [2025-10-02T18:37:46.667952] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:37:46.668117] [DEBUG] [LOCAL ] EFC: No existing data file found in primary storage. [2025-10-02T18:37:46.668190] [WARN ] [MAIN ] EFC: No existing data found, performing full refresh instead. [2025-10-02T18:37:46.668436] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-02T18:37:46.668490] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-02T18:37:46.668538] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-10-02T18:37:46.668572] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-02T18:37:46.681733] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-02T18:37:47.063698] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:37:47.473012] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-02T18:37:48.273014] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-10-02T18:37:48.513704] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T18:37:48.954378] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:37:49.073024] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-02T18:37:49.872990] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-02T18:37:49.973344] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:37:50.586916] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T18:37:50.672979] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-02T18:37:50.775341] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T18:37:51.473039] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-02T18:37:52.110360] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T18:37:52.273024] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-02T18:37:52.551442] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T18:37:53.073050] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-02T18:37:53.277579] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T18:37:53.872998] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-02T18:37:54.470402] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T18:37:54.673024] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-02T18:37:55.148184] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T18:37:55.473012] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-02T18:37:56.273004] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-02T18:37:56.374209] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T18:37:56.545275] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T18:37:57.072996] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-02T18:37:57.854719] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T18:37:57.881079] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-02T18:37:57.886459] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T18:37:58.673021] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-02T18:37:59.443442] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T18:37:59.473033] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-02T18:37:59.948593] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-02T18:38:00.121270] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T18:38:00.273015] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-02T18:38:01.072991] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-02T18:38:01.872986] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-02T18:38:01.938668] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T18:38:02.673897] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-02T18:38:02.680108] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T18:38:02.733820] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-02T18:38:03.473016] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-02T18:38:04.178052] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T18:38:04.273000] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-02T18:38:04.419392] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-02T18:38:05.073012] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-02T18:38:05.466354] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T18:38:05.468191] [INFO ] [REMOTE ] EDU: Full fetch complete (66486 records). [2025-10-02T18:38:05.468329] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-02T18:38:05.873132] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-02T18:38:05.890597] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-02T18:38:05.890739] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-02T18:38:05.891600] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-02T18:38:05.891801] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-02T18:38:05.893235] [DEBUG] [LOCAL ] EDU: Trimmed 66486 records to 45267 (keeping 200 days of data) [2025-10-02T18:38:06.175781] [DEBUG] [LOCAL ] EDU: Primary data saved (45267 records). [2025-10-02T18:38:06.175923] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-02T18:38:06.176020] [INFO ] [MAIN ] Update Progress: 700/2370 symbols completed. EDU took 39.5s. Estimated remaining: 3h 53m 54s. Rate: 7.1 symbols/min [2025-10-02T18:38:06.367344] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:06.386139] [DEBUG] [LOCAL ] EFR: Loaded 14641 existing records from primary storage. [2025-10-02T18:38:06.386402] [INFO ] [MAIN ] EFR: Loaded 14641 existing records. [2025-10-02T18:38:06.539035] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T18:38:06.545931] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-02T18:38:06.640537] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:38:06.640871] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-02T18:38:06.640963] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-02T18:38:06.641904] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-02T18:38:06.641975] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-02T18:38:06.678145] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-02T18:38:07.049487] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:07.472998] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-10-02T18:38:07.491469] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T18:38:08.273006] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-02T18:38:08.622020] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T18:38:09.073011] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-02T18:38:09.159605] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T18:38:09.161616] [INFO ] [REMOTE ] EE: Full fetch complete (43608 records). [2025-10-02T18:38:09.161805] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-02T18:38:09.610538] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-02T18:38:09.610618] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-02T18:38:09.611334] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-02T18:38:09.611395] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-02T18:38:09.612472] [DEBUG] [LOCAL ] EE: Trimmed 43608 records to 32660 (keeping 200 days of data) [2025-10-02T18:38:09.828812] [DEBUG] [LOCAL ] EE: Primary data saved (32660 records). [2025-10-02T18:38:09.828970] [INFO ] [MAIN ] EE: Full history saved. [2025-10-02T18:38:09.829064] [INFO ] [MAIN ] Update Progress: 701/2370 symbols completed. EE took 40.9s. Estimated remaining: 3h 53m 34s. Rate: 7.1 symbols/min [2025-10-02T18:38:09.878249] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-02T18:38:10.022042] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:10.036982] [DEBUG] [LOCAL ] EFT: Loaded 12910 existing records from primary storage. [2025-10-02T18:38:10.037222] [INFO ] [MAIN ] EFT: Loaded 12910 existing records. [2025-10-02T18:38:10.237191] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:38:10.237494] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-02T18:38:10.237548] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-02T18:38:10.238229] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-02T18:38:10.238292] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-02T18:38:10.643114] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:10.672976] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-10-02T18:38:10.712888] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T18:38:10.730337] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T18:38:11.406315] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:38:11.472976] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-02T18:38:12.273004] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-02T18:38:13.007379] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T18:38:13.072974] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-02T18:38:13.120897] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T18:38:13.872986] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-02T18:38:14.506683] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T18:38:14.673039] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-02T18:38:14.705162] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T18:38:15.473006] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-02T18:38:15.527902] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T18:38:16.273006] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-02T18:38:17.072967] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-02T18:38:17.092730] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T18:38:17.182846] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T18:38:17.869205] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T18:38:17.870118] [INFO ] [REMOTE ] EEX: Full fetch complete (19251 records). [2025-10-02T18:38:17.870203] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-02T18:38:17.870738] [FATAL] [VALIDATOR ] EEX: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:38:17.870830] [FATAL] [MAIN ] EEX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:38:17.870874] [WARN ] [MAIN ] EEX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:38:17.870914] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-02T18:38:17.870970] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-02T18:38:17.871004] [INFO ] [LOCAL ] EEX: Starting deletion of derivative data. [2025-10-02T18:38:17.871564] [DEBUG] [LOCAL ] EEX: Deleted derivative data file. [2025-10-02T18:38:17.871697] [INFO ] [MAIN ] Update Progress: 702/2370 symbols completed. EEX took 45.5s. Estimated remaining: 3h 53m 25s. Rate: 7.1 symbols/min [2025-10-02T18:38:17.876988] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-02T18:38:18.066305] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:18.119444] [DEBUG] [LOCAL ] EFX: Loaded 44522 existing records from primary storage. [2025-10-02T18:38:18.119808] [INFO ] [MAIN ] EFX: Loaded 44522 existing records. [2025-10-02T18:38:18.315256] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:38:18.315506] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-02T18:38:18.315567] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-02T18:38:18.317082] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-02T18:38:18.317145] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-02T18:38:18.681166] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-02T18:38:18.715919] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:19.473001] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-02T18:38:19.755138] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T18:38:19.808315] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T18:38:19.963592] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-02T18:38:20.272932] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-02T18:38:21.073018] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-02T18:38:21.257203] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-02T18:38:21.872987] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-02T18:38:22.675912] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-10-02T18:38:22.677783] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T18:38:22.680002] [INFO ] [REMOTE ] EFC: Full fetch complete (66490 records). [2025-10-02T18:38:22.680116] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-02T18:38:23.033449] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T18:38:23.139664] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-02T18:38:23.139754] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-02T18:38:23.140564] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-02T18:38:23.140686] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-02T18:38:23.144703] [DEBUG] [LOCAL ] EFC: Trimmed 66490 records to 46536 (keeping 200 days of data) [2025-10-02T18:38:23.445198] [DEBUG] [LOCAL ] EFC: Primary data saved (46536 records). [2025-10-02T18:38:23.445339] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-02T18:38:23.445449] [INFO ] [MAIN ] Update Progress: 703/2370 symbols completed. EFC took 37.0s. Estimated remaining: 3h 53m 10s. Rate: 7.1 symbols/min [2025-10-02T18:38:23.479462] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-02T18:38:23.633768] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:23.664357] [DEBUG] [LOCAL ] EFXT: Loaded 29191 existing records from primary storage. [2025-10-02T18:38:23.664632] [INFO ] [MAIN ] EFXT: Loaded 29191 existing records. [2025-10-02T18:38:23.852814] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:38:23.853052] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-02T18:38:23.853111] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-02T18:38:23.854297] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-02T18:38:23.854370] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-02T18:38:24.272479] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:24.273180] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-02T18:38:24.371326] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:38:24.390074] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T18:38:24.983858] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T18:38:25.073015] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-02T18:38:25.872976] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-02T18:38:26.005710] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-02T18:38:26.673022] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-02T18:38:27.308051] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T18:38:27.462290] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T18:38:27.472944] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-02T18:38:28.273076] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-02T18:38:28.910637] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T18:38:29.073000] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-02T18:38:29.124539] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T18:38:29.873006] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-02T18:38:29.883317] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T18:38:30.673077] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-10-02T18:38:31.473031] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-02T18:38:31.665510] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T18:38:31.786936] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T18:38:32.272968] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-02T18:38:32.316305] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T18:38:33.073020] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-02T18:38:33.872991] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-02T18:38:33.940000] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T18:38:34.077337] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T18:38:34.611698] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T18:38:34.673002] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-02T18:38:35.473039] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-02T18:38:36.273046] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-02T18:38:36.384208] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T18:38:36.385340] [INFO ] [REMOTE ] EFR: Full fetch complete (18971 records). [2025-10-02T18:38:36.385416] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-02T18:38:36.808738] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-02T18:38:36.808936] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-02T18:38:36.809422] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-02T18:38:36.809515] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-02T18:38:36.810391] [DEBUG] [LOCAL ] EFR: Trimmed 18971 records to 14752 (keeping 200 days of data) [2025-10-02T18:38:36.904871] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-02T18:38:36.949371] [DEBUG] [LOCAL ] EFR: Primary data saved (14752 records). [2025-10-02T18:38:36.949531] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-02T18:38:36.949700] [INFO ] [MAIN ] Update Progress: 704/2370 symbols completed. EFR took 30.8s. Estimated remaining: 3h 53m 13s. Rate: 7.1 symbols/min [2025-10-02T18:38:37.078165] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-02T18:38:37.150348] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:37.150548] [DEBUG] [LOCAL ] EG: No existing data file found in primary storage. [2025-10-02T18:38:37.150605] [WARN ] [MAIN ] EG: No existing data found, performing full refresh instead. [2025-10-02T18:38:37.150747] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-02T18:38:37.150801] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-02T18:38:37.150872] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-10-02T18:38:37.150910] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-02T18:38:37.540733] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:37.872985] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-02T18:38:37.971634] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T18:38:37.973206] [INFO ] [REMOTE ] EFT: Full fetch complete (17943 records). [2025-10-02T18:38:37.973295] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-02T18:38:38.295401] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-02T18:38:38.434090] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-02T18:38:38.434183] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-02T18:38:38.434679] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-02T18:38:38.434761] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-02T18:38:38.435537] [DEBUG] [LOCAL ] EFT: Trimmed 17943 records to 13189 (keeping 200 days of data) [2025-10-02T18:38:38.546352] [DEBUG] [LOCAL ] EFT: Primary data saved (13189 records). [2025-10-02T18:38:38.546498] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-02T18:38:38.546585] [INFO ] [MAIN ] Update Progress: 705/2370 symbols completed. EFT took 28.7s. Estimated remaining: 3h 52m 49s. Rate: 7.2 symbols/min [2025-10-02T18:38:38.678184] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-02T18:38:38.743598] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:38.806044] [DEBUG] [LOCAL ] EGO: Loaded 51595 existing records from primary storage. [2025-10-02T18:38:38.806391] [INFO ] [MAIN ] EGO: Loaded 51595 existing records. [2025-10-02T18:38:39.010128] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:38:39.010408] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-02T18:38:39.010539] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-02T18:38:39.013673] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-10-02T18:38:39.013747] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-02T18:38:39.453926] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T18:38:39.458179] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:39.472963] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-10-02T18:38:40.075216] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:38:40.272990] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-02T18:38:40.856714] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T18:38:41.073043] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-10-02T18:38:41.560147] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T18:38:41.873001] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-02T18:38:42.510380] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T18:38:42.673031] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-02T18:38:43.473002] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-02T18:38:43.600381] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T18:38:43.848382] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T18:38:44.273036] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-02T18:38:45.073233] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-02T18:38:45.163201] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T18:38:45.238410] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T18:38:45.873006] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-02T18:38:46.672974] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-02T18:38:46.864635] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T18:38:47.472979] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-02T18:38:47.526301] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T18:38:48.211328] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T18:38:48.273022] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-02T18:38:48.719709] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T18:38:49.073033] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-02T18:38:49.340579] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T18:38:49.873017] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-02T18:38:50.556207] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T18:38:50.672999] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-02T18:38:51.309916] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T18:38:51.313058] [INFO ] [REMOTE ] EFX: Full fetch complete (64499 records). [2025-10-02T18:38:51.313214] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-02T18:38:51.478968] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-02T18:38:51.757825] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-02T18:38:51.758091] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-02T18:38:51.759159] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-02T18:38:51.759296] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-02T18:38:51.760865] [DEBUG] [LOCAL ] EFX: Trimmed 64499 records to 44908 (keeping 200 days of data) [2025-10-02T18:38:52.080359] [DEBUG] [LOCAL ] EFX: Primary data saved (44908 records). [2025-10-02T18:38:52.080560] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-02T18:38:52.081870] [INFO ] [MAIN ] Update Progress: 706/2370 symbols completed. EFX took 34.2s. Estimated remaining: 3h 52m 53s. Rate: 7.1 symbols/min [2025-10-02T18:38:52.136730] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T18:38:52.289871] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-02T18:38:52.326235] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:38:52.366425] [DEBUG] [LOCAL ] EGP: Loaded 30897 existing records from primary storage. [2025-10-02T18:38:52.366733] [INFO ] [MAIN ] EGP: Loaded 30897 existing records. [2025-10-02T18:38:52.580389] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:38:52.580702] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-02T18:38:52.580870] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-02T18:38:52.582491] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-10-02T18:38:52.582572] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-02T18:38:52.806346] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T18:38:53.015182] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:38:53.072996] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-10-02T18:38:53.823688] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:38:53.872963] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-02T18:38:54.412773] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T18:38:54.673041] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-02T18:38:55.125277] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T18:38:55.473022] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-02T18:38:56.272985] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-02T18:38:56.587790] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-02T18:38:56.737853] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T18:38:57.073055] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-02T18:38:57.388519] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T18:38:57.873017] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-02T18:38:58.319334] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T18:38:58.673068] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-02T18:38:58.925485] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T18:38:59.473045] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-02T18:39:00.273005] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-02T18:39:00.480542] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T18:39:00.989788] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T18:39:01.073006] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-02T18:39:01.748886] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T18:39:01.873036] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-02T18:39:02.672994] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-02T18:39:03.026607] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-10-02T18:39:03.091434] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T18:39:03.472998] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-10-02T18:39:03.587242] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T18:39:03.588715] [INFO ] [REMOTE ] EFXT: Full fetch complete (43934 records). [2025-10-02T18:39:03.588817] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-02T18:39:03.589489] [FATAL] [VALIDATOR ] EFXT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:39:03.589605] [FATAL] [MAIN ] EFXT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:39:03.589698] [WARN ] [MAIN ] EFXT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:39:03.589758] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-02T18:39:03.589851] [DEBUG] [LOCAL ] EFXT: No primary data file found to delete. [2025-10-02T18:39:03.589911] [INFO ] [LOCAL ] EFXT: Starting deletion of derivative data. [2025-10-02T18:39:03.590350] [DEBUG] [LOCAL ] EFXT: Deleted derivative data file. [2025-10-02T18:39:03.590475] [INFO ] [MAIN ] Update Progress: 707/2370 symbols completed. EFXT took 40.1s. Estimated remaining: 3h 52m 51s. Rate: 7.1 symbols/min [2025-10-02T18:39:03.789677] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:03.836338] [DEBUG] [LOCAL ] EGY: Loaded 42122 existing records from primary storage. [2025-10-02T18:39:03.836698] [INFO ] [MAIN ] EGY: Loaded 42122 existing records. [2025-10-02T18:39:04.028905] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:39:04.029204] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-02T18:39:04.029277] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-02T18:39:04.030668] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-02T18:39:04.030732] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-02T18:39:04.278247] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-02T18:39:04.444062] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:04.738291] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T18:39:05.072997] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-10-02T18:39:05.605479] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T18:39:05.873003] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-02T18:39:06.317790] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T18:39:06.673022] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-10-02T18:39:07.079576] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-02T18:39:07.473017] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-02T18:39:08.273016] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-02T18:39:08.331318] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T18:39:09.073001] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-10-02T18:39:09.247282] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T18:39:09.460957] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T18:39:09.872996] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-02T18:39:09.966333] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-02T18:39:09.967774] [INFO ] [REMOTE ] EG: Full fetch complete (43566 records). [2025-10-02T18:39:09.967879] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-10-02T18:39:10.378740] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-10-02T18:39:10.378876] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-10-02T18:39:10.379490] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-10-02T18:39:10.379565] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-10-02T18:39:10.380686] [DEBUG] [LOCAL ] EG: Trimmed 43566 records to 28356 (keeping 200 days of data) [2025-10-02T18:39:10.573828] [DEBUG] [LOCAL ] EG: Primary data saved (28356 records). [2025-10-02T18:39:10.573966] [INFO ] [MAIN ] EG: Full history saved. [2025-10-02T18:39:10.574064] [INFO ] [MAIN ] Update Progress: 708/2370 symbols completed. EG took 33.6s. Estimated remaining: 3h 52m 40s. Rate: 7.1 symbols/min [2025-10-02T18:39:10.678073] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-02T18:39:10.763312] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:10.791952] [DEBUG] [LOCAL ] EHAB: Loaded 29662 existing records from primary storage. [2025-10-02T18:39:10.792229] [INFO ] [MAIN ] EHAB: Loaded 29662 existing records. [2025-10-02T18:39:10.980073] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:39:10.980273] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-02T18:39:10.980322] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-02T18:39:10.981167] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-02T18:39:10.981228] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-02T18:39:11.409511] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:11.441257] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T18:39:11.472952] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-10-02T18:39:12.130239] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:39:12.273009] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-02T18:39:12.515857] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T18:39:13.073049] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-02T18:39:13.207632] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-02T18:39:13.873002] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-02T18:39:14.672975] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-02T18:39:14.881532] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T18:39:14.935808] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T18:39:15.472998] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-02T18:39:16.272991] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-02T18:39:16.478939] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-02T18:39:16.978304] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T18:39:17.072974] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-02T18:39:17.309422] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T18:39:17.872993] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-02T18:39:18.673079] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-02T18:39:18.804920] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:39:18.996949] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T18:39:19.473009] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-02T18:39:20.051443] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T18:39:20.272999] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-02T18:39:20.677867] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T18:39:21.073061] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-02T18:39:21.607609] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T18:39:21.873003] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-02T18:39:22.138347] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-02T18:39:22.673047] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-02T18:39:22.850265] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T18:39:22.851865] [INFO ] [REMOTE ] EGP: Full fetch complete (45457 records). [2025-10-02T18:39:22.851964] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-02T18:39:23.280773] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-10-02T18:39:23.280904] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-10-02T18:39:23.281832] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-10-02T18:39:23.281899] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-10-02T18:39:23.283224] [DEBUG] [LOCAL ] EGP: Trimmed 45457 records to 31092 (keeping 200 days of data) [2025-10-02T18:39:23.477808] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-02T18:39:23.492297] [DEBUG] [LOCAL ] EGP: Primary data saved (31092 records). [2025-10-02T18:39:23.492489] [INFO ] [MAIN ] EGP: Full history saved. [2025-10-02T18:39:23.493364] [INFO ] [MAIN ] Update Progress: 709/2370 symbols completed. EGP took 31.4s. Estimated remaining: 3h 52m 42s. Rate: 7.1 symbols/min [2025-10-02T18:39:23.679396] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:23.728386] [DEBUG] [LOCAL ] EHC: Loaded 41099 existing records from primary storage. [2025-10-02T18:39:23.728783] [INFO ] [MAIN ] EHC: Loaded 41099 existing records. [2025-10-02T18:39:23.929671] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:39:23.929885] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-02T18:39:23.929934] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-02T18:39:23.931360] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-02T18:39:23.931425] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-02T18:39:24.150906] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T18:39:24.233733] [INFO ] [REMOTE ] EGO: Full fetch complete (73707 records). [2025-10-02T18:39:24.246358] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-02T18:39:24.293104] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-02T18:39:24.461387] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:24.797911] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-02T18:39:24.798093] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-02T18:39:24.799121] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-02T18:39:24.799278] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-02T18:39:24.801126] [DEBUG] [LOCAL ] EGO: Trimmed 73707 records to 51982 (keeping 200 days of data) [2025-10-02T18:39:25.070880] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T18:39:25.075115] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-10-02T18:39:25.180727] [DEBUG] [LOCAL ] EGO: Primary data saved (51982 records). [2025-10-02T18:39:25.180889] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-02T18:39:25.180977] [INFO ] [MAIN ] Update Progress: 710/2370 symbols completed. EGO took 46.6s. Estimated remaining: 3h 52m 18s. Rate: 7.1 symbols/min [2025-10-02T18:39:25.374709] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:25.394605] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T18:39:25.410500] [DEBUG] [LOCAL ] EHI: Loaded 10613 existing records from primary storage. [2025-10-02T18:39:25.410807] [INFO ] [MAIN ] EHI: Loaded 10613 existing records. [2025-10-02T18:39:25.609273] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:39:25.609524] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-02T18:39:25.609581] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-02T18:39:25.610162] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-02T18:39:25.610226] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-02T18:39:25.878176] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-02T18:39:26.007183] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:26.650604] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T18:39:26.672989] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-02T18:39:27.455622] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T18:39:27.473025] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-10-02T18:39:28.151265] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T18:39:28.273025] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-02T18:39:28.966741] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T18:39:29.073078] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-02T18:39:29.702687] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T18:39:29.873051] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-02T18:39:30.232627] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T18:39:30.673009] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-02T18:39:31.471828] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T18:39:31.480268] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-02T18:39:32.213784] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T18:39:32.272979] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-02T18:39:32.283092] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:39:33.073069] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-02T18:39:33.532665] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T18:39:33.603899] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T18:39:33.873014] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-02T18:39:34.615206] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T18:39:34.673004] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-02T18:39:35.266813] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-02T18:39:35.473091] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-02T18:39:36.273006] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-02T18:39:37.073052] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-02T18:39:37.103850] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T18:39:37.226819] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T18:39:37.873039] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-02T18:39:38.268779] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T18:39:38.270586] [INFO ] [REMOTE ] EGY: Full fetch complete (61444 records). [2025-10-02T18:39:38.270733] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-02T18:39:38.684974] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-02T18:39:38.708394] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-10-02T18:39:38.708499] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-10-02T18:39:38.709317] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-10-02T18:39:38.709384] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-10-02T18:39:38.712247] [DEBUG] [LOCAL ] EGY: Trimmed 61444 records to 42435 (keeping 200 days of data) [2025-10-02T18:39:38.974279] [DEBUG] [LOCAL ] EGY: Primary data saved (42435 records). [2025-10-02T18:39:38.974413] [INFO ] [MAIN ] EGY: Full history saved. [2025-10-02T18:39:38.974515] [INFO ] [MAIN ] Update Progress: 711/2370 symbols completed. EGY took 35.4s. Estimated remaining: 3h 52m 22s. Rate: 7.1 symbols/min [2025-10-02T18:39:39.153242] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:39.153441] [DEBUG] [LOCAL ] EIC: No existing data file found in primary storage. [2025-10-02T18:39:39.153514] [WARN ] [MAIN ] EIC: No existing data found, performing full refresh instead. [2025-10-02T18:39:39.153832] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-02T18:39:39.153985] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-02T18:39:39.154114] [DEBUG] [LOCAL ] EIC: No primary data file found to delete. [2025-10-02T18:39:39.154171] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-02T18:39:39.309472] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T18:39:39.482506] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-02T18:39:39.571833] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:39.640322] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-02T18:39:40.272996] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-10-02T18:39:40.924601] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:39:41.073069] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-02T18:39:41.676694] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T18:39:41.873006] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-02T18:39:42.480221] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T18:39:42.673011] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-02T18:39:42.728614] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-02T18:39:43.472970] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-02T18:39:43.515796] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T18:39:44.273018] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-02T18:39:45.072986] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-02T18:39:45.128483] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T18:39:45.523587] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T18:39:45.873015] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-02T18:39:46.078351] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T18:39:46.079681] [INFO ] [REMOTE ] EHAB: Full fetch complete (41068 records). [2025-10-02T18:39:46.079763] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-02T18:39:46.490339] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-10-02T18:39:46.490428] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-10-02T18:39:46.491093] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-10-02T18:39:46.491169] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-10-02T18:39:46.492305] [DEBUG] [LOCAL ] EHAB: Trimmed 41068 records to 29810 (keeping 200 days of data) [2025-10-02T18:39:46.667341] [DEBUG] [LOCAL ] EHAB: Primary data saved (29810 records). [2025-10-02T18:39:46.667486] [INFO ] [MAIN ] EHAB: Full history saved. [2025-10-02T18:39:46.667571] [INFO ] [MAIN ] Update Progress: 712/2370 symbols completed. EHAB took 36.1s. Estimated remaining: 3h 52m 12s. Rate: 7.1 symbols/min [2025-10-02T18:39:46.680844] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-02T18:39:46.871158] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:46.871415] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-02T18:39:46.871467] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-02T18:39:46.871586] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-02T18:39:46.871631] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-02T18:39:46.871718] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-02T18:39:46.871762] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-02T18:39:47.291546] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:47.315728] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T18:39:47.473005] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-10-02T18:39:47.790192] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T18:39:48.027989] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-02T18:39:48.273035] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-02T18:39:49.013378] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T18:39:49.072991] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-02T18:39:49.872968] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-02T18:39:49.964218] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T18:39:50.294956] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-02T18:39:50.673003] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-02T18:39:51.473020] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-02T18:39:52.040839] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-02T18:39:52.091374] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T18:39:52.092843] [INFO ] [REMOTE ] EHI: Full fetch complete (16319 records). [2025-10-02T18:39:52.092959] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-02T18:39:52.282498] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-02T18:39:52.542174] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-02T18:39:52.542253] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-02T18:39:52.542639] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-02T18:39:52.542724] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-02T18:39:52.543381] [DEBUG] [LOCAL ] EHI: Trimmed 16319 records to 10681 (keeping 200 days of data) [2025-10-02T18:39:52.606680] [DEBUG] [LOCAL ] EHI: Primary data saved (10681 records). [2025-10-02T18:39:52.606819] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-02T18:39:52.606904] [INFO ] [MAIN ] Update Progress: 713/2370 symbols completed. EHI took 27.4s. Estimated remaining: 3h 51m 58s. Rate: 7.1 symbols/min [2025-10-02T18:39:52.792783] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:39:52.792953] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-02T18:39:52.792991] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-02T18:39:52.793106] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-02T18:39:52.793148] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-02T18:39:52.793193] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-02T18:39:52.793226] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-02T18:39:53.081334] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-02T18:39:53.195932] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:39:53.529779] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T18:39:53.873005] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-02T18:39:54.113604] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-02T18:39:54.630708] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T18:39:54.672977] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-10-02T18:39:55.244856] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-02T18:39:55.472961] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-02T18:39:56.273093] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-02T18:39:56.685912] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T18:39:56.722905] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-02T18:39:57.073012] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-02T18:39:57.872991] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-02T18:39:58.222419] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T18:39:58.673039] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-02T18:39:59.174956] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T18:39:59.441937] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T18:39:59.473004] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-02T18:40:00.273002] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-02T18:40:00.732130] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-02T18:40:01.079783] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-02T18:40:01.096225] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T18:40:01.582936] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-02T18:40:01.873067] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-02T18:40:02.672994] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-02T18:40:03.221639] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T18:40:03.473038] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-02T18:40:03.821112] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T18:40:03.937965] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T18:40:03.939736] [INFO ] [REMOTE ] EHC: Full fetch complete (58898 records). [2025-10-02T18:40:03.939824] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-02T18:40:04.278112] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-02T18:40:04.372612] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-02T18:40:04.372735] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-02T18:40:04.373597] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-02T18:40:04.373696] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-02T18:40:04.375110] [DEBUG] [LOCAL ] EHC: Trimmed 58898 records to 41398 (keeping 200 days of data) [2025-10-02T18:40:04.653116] [DEBUG] [LOCAL ] EHC: Primary data saved (41398 records). [2025-10-02T18:40:04.653255] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-02T18:40:04.654099] [INFO ] [MAIN ] Update Progress: 714/2370 symbols completed. EHC took 41.2s. Estimated remaining: 3h 51m 58s. Rate: 7.1 symbols/min [2025-10-02T18:40:04.839213] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:04.839433] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-02T18:40:04.839507] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-02T18:40:04.839718] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-02T18:40:04.839816] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-02T18:40:04.839880] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-02T18:40:04.839918] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-02T18:40:05.078141] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-02T18:40:05.234715] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:05.491444] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T18:40:05.703979] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T18:40:05.873006] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-02T18:40:06.317502] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-02T18:40:06.673008] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-02T18:40:07.097809] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-02T18:40:07.473036] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-10-02T18:40:08.179164] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T18:40:08.272997] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-02T18:40:08.675965] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T18:40:09.073004] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-02T18:40:09.513353] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-02T18:40:09.873043] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-02T18:40:10.672972] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-02T18:40:10.826734] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T18:40:11.266840] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T18:40:11.473002] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-02T18:40:12.054343] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-02T18:40:12.272997] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-02T18:40:12.715411] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-02T18:40:13.073010] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-02T18:40:13.872997] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-02T18:40:14.302498] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-02T18:40:14.672997] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-02T18:40:15.207524] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-02T18:40:15.209739] [INFO ] [REMOTE ] EIC: Full fetch complete (34824 records). [2025-10-02T18:40:15.209917] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-02T18:40:15.478141] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-02T18:40:15.556325] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T18:40:15.663471] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-10-02T18:40:15.663576] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-10-02T18:40:15.664249] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-10-02T18:40:15.664313] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-10-02T18:40:15.665216] [DEBUG] [LOCAL ] EIC: Trimmed 34824 records to 23651 (keeping 200 days of data) [2025-10-02T18:40:15.825254] [DEBUG] [LOCAL ] EIC: Primary data saved (23651 records). [2025-10-02T18:40:15.825709] [INFO ] [MAIN ] EIC: Full history saved. [2025-10-02T18:40:15.825801] [INFO ] [MAIN ] Update Progress: 715/2370 symbols completed. EIC took 36.9s. Estimated remaining: 3h 51m 56s. Rate: 7.1 symbols/min [2025-10-02T18:40:15.948344] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-02T18:40:16.020229] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:16.040805] [DEBUG] [LOCAL ] EIG: Loaded 20325 existing records from primary storage. [2025-10-02T18:40:16.041076] [INFO ] [MAIN ] EIG: Loaded 20325 existing records. [2025-10-02T18:40:16.234076] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:40:16.234394] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-02T18:40:16.234444] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-02T18:40:16.236391] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-02T18:40:16.236465] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-02T18:40:16.278435] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-02T18:40:16.636485] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:16.806270] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T18:40:17.073038] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-10-02T18:40:17.872999] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-02T18:40:18.137255] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T18:40:18.271960] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-02T18:40:18.673025] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-02T18:40:19.286135] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-02T18:40:19.473052] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-02T18:40:20.071724] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-02T18:40:20.273039] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-02T18:40:20.995541] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-02T18:40:21.073052] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-02T18:40:21.652592] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T18:40:21.873047] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-02T18:40:22.673053] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-02T18:40:22.844356] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T18:40:22.987477] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-02T18:40:23.473040] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-02T18:40:24.175829] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-02T18:40:24.273006] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-02T18:40:25.011963] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T18:40:25.073002] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-02T18:40:25.523533] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T18:40:25.524328] [INFO ] [REMOTE ] EICB: Full fetch complete (2725 records). [2025-10-02T18:40:25.524404] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-02T18:40:25.752917] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T18:40:25.753132] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:40:25.753199] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:40:25.753268] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-02T18:40:25.753332] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-02T18:40:25.753367] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-02T18:40:25.753408] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-02T18:40:25.753462] [INFO ] [MAIN ] Update Progress: 716/2370 symbols completed. EICB took 33.1s. Estimated remaining: 3h 51m 51s. Rate: 7.1 symbols/min [2025-10-02T18:40:25.878101] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-02T18:40:25.938912] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:25.993107] [DEBUG] [LOCAL ] EIX: Loaded 53338 existing records from primary storage. [2025-10-02T18:40:25.993469] [INFO ] [MAIN ] EIX: Loaded 53338 existing records. [2025-10-02T18:40:26.178702] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:40:26.178926] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-02T18:40:26.179135] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-02T18:40:26.180715] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-02T18:40:26.180777] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-02T18:40:26.555511] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:26.641806] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T18:40:26.673002] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-02T18:40:27.472984] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-02T18:40:27.693514] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T18:40:27.935374] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T18:40:27.936224] [INFO ] [REMOTE ] EICC: Full fetch complete (8212 records). [2025-10-02T18:40:27.936300] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-02T18:40:27.936720] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:40:27.936811] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:40:27.936865] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:40:27.936917] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-02T18:40:27.936977] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-02T18:40:27.937014] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-02T18:40:27.937087] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-02T18:40:27.937180] [INFO ] [MAIN ] Update Progress: 717/2370 symbols completed. EICC took 23.3s. Estimated remaining: 3h 51m 28s. Rate: 7.1 symbols/min [2025-10-02T18:40:28.273055] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-02T18:40:29.073072] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-02T18:40:29.506178] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-02T18:40:29.526116] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T18:40:29.527051] [INFO ] [REMOTE ] EICA: Full fetch complete (1281 records). [2025-10-02T18:40:29.527141] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-02T18:40:29.527636] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:40:29.527782] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:40:29.527834] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:40:29.527893] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-02T18:40:29.527967] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-02T18:40:29.528079] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-02T18:40:29.528157] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-02T18:40:29.528307] [INFO ] [MAIN ] Update Progress: 718/2370 symbols completed. EICA took 42.9s. Estimated remaining: 3h 51m 4s. Rate: 7.1 symbols/min [2025-10-02T18:40:29.873003] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-02T18:40:30.672982] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-10-02T18:40:31.092217] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T18:40:31.473053] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-02T18:40:32.497131] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T18:40:32.501760] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-02T18:40:32.587370] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-10-02T18:40:33.073033] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-02T18:40:33.538938] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-02T18:40:33.873008] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-02T18:40:34.756592] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T18:40:34.768593] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-02T18:40:34.785802] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T18:40:35.473048] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-02T18:40:36.427264] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T18:40:36.432985] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-02T18:40:36.622994] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T18:40:37.073039] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-02T18:40:37.382512] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T18:40:37.383797] [INFO ] [REMOTE ] EIG: Full fetch complete (27079 records). [2025-10-02T18:40:37.383888] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-02T18:40:37.791589] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-10-02T18:40:37.791698] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-10-02T18:40:37.792273] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-10-02T18:40:37.792324] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-10-02T18:40:37.793180] [DEBUG] [LOCAL ] EIG: Trimmed 27079 records to 20444 (keeping 200 days of data) [2025-10-02T18:40:37.920848] [DEBUG] [LOCAL ] EIG: Primary data saved (20444 records). [2025-10-02T18:40:37.920977] [INFO ] [MAIN ] EIG: Full history saved. [2025-10-02T18:40:37.921059] [INFO ] [MAIN ] Update Progress: 719/2370 symbols completed. EIG took 22.1s. Estimated remaining: 3h 50m 56s. Rate: 7.1 symbols/min [2025-10-02T18:40:38.812675] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T18:40:38.824835] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-02T18:40:40.793902] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T18:40:40.805752] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-02T18:40:42.819786] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-02T18:40:42.831672] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-02T18:40:44.555825] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T18:40:44.571593] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-02T18:40:46.572310] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-02T18:40:46.584389] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-02T18:40:47.969327] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T18:40:47.981128] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-02T18:40:49.783099] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T18:40:49.795288] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-02T18:40:51.238232] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T18:40:51.240429] [INFO ] [REMOTE ] EIX: Full fetch complete (77027 records). [2025-10-02T18:40:51.240570] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-02T18:40:51.683696] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-02T18:40:51.683802] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-02T18:40:51.684827] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-02T18:40:51.684906] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-02T18:40:51.686621] [DEBUG] [LOCAL ] EIX: Trimmed 77027 records to 53730 (keeping 200 days of data) [2025-10-02T18:40:52.033933] [DEBUG] [LOCAL ] EIX: Primary data saved (53730 records). [2025-10-02T18:40:52.034088] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-02T18:40:52.034186] [INFO ] [MAIN ] Update Progress: 720/2370 symbols completed. EIX took 26.3s. Estimated remaining: 3h 51m 1s. Rate: 7.1 symbols/min [2025-10-02T18:40:52.756589] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:52.791690] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:52.828283] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:52.852444] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:40:52.859116] [DEBUG] [LOCAL ] ELC: Loaded 3482 existing records from primary storage. [2025-10-02T18:40:52.859598] [INFO ] [MAIN ] ELC: Loaded 3482 existing records. [2025-10-02T18:40:53.135034] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:40:53.151920] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-02T18:40:53.153785] [DEBUG] [LOCAL ] ELF: Loaded 52195 existing records from primary storage. [2025-10-02T18:40:53.154761] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-02T18:40:53.155436] [INFO ] [MAIN ] ELF: Loaded 52195 existing records. [2025-10-02T18:40:53.208789] [DEBUG] [LOCAL ] ELAN: Loaded 53254 existing records from primary storage. [2025-10-02T18:40:53.182514] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-02T18:40:53.235578] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-02T18:40:53.248349] [INFO ] [MAIN ] ELAN: Loaded 53254 existing records. [2025-10-02T18:40:53.369946] [DEBUG] [LOCAL ] EL: Loaded 53392 existing records from primary storage. [2025-10-02T18:40:53.403556] [INFO ] [MAIN ] EL: Loaded 53392 existing records. [2025-10-02T18:40:53.830880] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:40:53.952400] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-02T18:40:53.957094] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:40:54.002350] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-02T18:40:54.029513] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-02T18:40:54.029279] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-02T18:40:54.029680] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-02T18:40:54.102255] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:40:54.102614] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-02T18:40:54.126033] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-02T18:40:54.153930] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-02T18:40:54.108425] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-02T18:40:54.205148] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-02T18:40:54.210445] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-02T18:40:54.241946] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-02T18:40:54.704488] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:54.776872] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-10-02T18:40:55.348257] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:55.407533] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-10-02T18:40:55.536996] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:55.537382] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-10-02T18:40:55.533585] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:40:55.537805] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-10-02T18:40:55.607435] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T18:40:55.609252] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-02T18:40:56.162710] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-02T18:40:56.164148] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-02T18:40:56.690034] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T18:40:56.691476] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-02T18:40:57.151225] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T18:40:57.162030] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-02T18:40:57.246871] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-02T18:40:57.248383] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-02T18:40:57.468257] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-02T18:40:57.479131] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-02T18:40:57.578140] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T18:40:57.591131] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-02T18:40:57.814159] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-02T18:40:57.815755] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-02T18:40:58.382629] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T18:40:58.384357] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-02T18:40:58.622808] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T18:40:58.634137] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-02T18:40:58.926812] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-02T18:40:58.928427] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-02T18:40:59.140056] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T18:40:59.151905] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-02T18:40:59.182968] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T18:40:59.193987] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-02T18:40:59.497220] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T18:40:59.498904] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-02T18:41:00.022622] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T18:41:00.033439] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-02T18:41:00.091478] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T18:41:00.093420] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-02T18:41:00.668419] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-02T18:41:00.670139] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-02T18:41:01.186820] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-02T18:41:01.197222] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-02T18:41:01.285470] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T18:41:01.287394] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-02T18:41:01.292182] [INFO ] [REMOTE ] ELC: Full fetch complete (5101 records). [2025-10-02T18:41:01.302936] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-02T18:41:01.303064] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-02T18:41:01.756046] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-02T18:41:01.756260] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-02T18:41:01.756672] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-02T18:41:01.756750] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-02T18:41:01.785545] [DEBUG] [LOCAL ] ELC: Trimmed 5101 records to 3504 (keeping 200 days of data) [2025-10-02T18:41:01.791846] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T18:41:01.836742] [DEBUG] [LOCAL ] ELC: Primary data saved (3504 records). [2025-10-02T18:41:01.837388] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-02T18:41:01.837476] [INFO ] [MAIN ] Update Progress: 721/2370 symbols completed. ELC took 9.8s. Estimated remaining: 3h 50m 55s. Rate: 7.1 symbols/min [2025-10-02T18:41:01.885722] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-02T18:41:02.026564] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:02.068319] [DEBUG] [LOCAL ] ELME: Loaded 39181 existing records from primary storage. [2025-10-02T18:41:02.068617] [INFO ] [MAIN ] ELME: Loaded 39181 existing records. [2025-10-02T18:41:02.263217] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:41:02.263447] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-02T18:41:02.263506] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-02T18:41:02.264817] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-10-02T18:41:02.264890] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-02T18:41:02.689017] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:02.689359] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-10-02T18:41:02.990040] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T18:41:03.472974] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-02T18:41:03.658972] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-10-02T18:41:03.785468] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T18:41:04.146491] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:41:04.273031] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-02T18:41:05.073005] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-02T18:41:05.411015] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T18:41:05.466021] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-10-02T18:41:05.873006] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-02T18:41:06.673007] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-02T18:41:07.249930] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-02T18:41:07.473003] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-02T18:41:07.770207] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T18:41:08.273032] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-02T18:41:08.905664] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-10-02T18:41:09.036739] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T18:41:09.072996] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-02T18:41:09.581604] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T18:41:09.873004] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-02T18:41:10.556171] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T18:41:10.673007] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-02T18:41:11.473005] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-02T18:41:11.856126] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T18:41:12.272980] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-02T18:41:12.581176] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T18:41:12.970253] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:41:13.073013] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-02T18:41:13.873013] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-02T18:41:14.315758] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-02T18:41:14.673057] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-02T18:41:14.838995] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T18:41:15.473009] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-02T18:41:15.850902] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T18:41:16.260465] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T18:41:16.272959] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-02T18:41:17.073029] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-02T18:41:17.304102] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T18:41:17.573754] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T18:41:17.873049] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-02T18:41:18.673000] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-02T18:41:19.225599] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-02T18:41:19.473017] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-02T18:41:19.528061] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T18:41:19.530138] [INFO ] [REMOTE ] ELAN: Full fetch complete (76870 records). [2025-10-02T18:41:19.530254] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-02T18:41:19.981252] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-02T18:41:19.981341] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-02T18:41:19.982309] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-02T18:41:19.982380] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-02T18:41:19.984197] [DEBUG] [LOCAL ] ELAN: Trimmed 76870 records to 53643 (keeping 200 days of data) [2025-10-02T18:41:20.259604] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T18:41:20.273042] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-02T18:41:20.363832] [DEBUG] [LOCAL ] ELAN: Primary data saved (53643 records). [2025-10-02T18:41:20.364000] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-02T18:41:20.366213] [INFO ] [MAIN ] Update Progress: 722/2370 symbols completed. ELAN took 28.3s. Estimated remaining: 3h 51m 10s. Rate: 7.1 symbols/min [2025-10-02T18:41:20.552756] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:20.579545] [DEBUG] [LOCAL ] ELP: Loaded 25670 existing records from primary storage. [2025-10-02T18:41:20.579850] [INFO ] [MAIN ] ELP: Loaded 25670 existing records. [2025-10-02T18:41:20.781184] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:41:20.781385] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-02T18:41:20.781433] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-02T18:41:20.782624] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-10-02T18:41:20.782715] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-02T18:41:21.073718] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-02T18:41:21.179835] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:21.220146] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T18:41:21.873068] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-10-02T18:41:22.320250] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-02T18:41:22.418566] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T18:41:22.673083] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-02T18:41:23.331695] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:41:23.473020] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-02T18:41:23.929681] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:41:24.273007] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-02T18:41:25.072986] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-02T18:41:25.161422] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-02T18:41:25.811457] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-02T18:41:25.813537] [INFO ] [REMOTE ] EL: Full fetch complete (77312 records). [2025-10-02T18:41:25.813683] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-02T18:41:25.874704] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-02T18:41:26.180626] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T18:41:26.318179] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-02T18:41:26.318270] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-02T18:41:26.319164] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-02T18:41:26.319230] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-02T18:41:26.320790] [DEBUG] [LOCAL ] EL: Trimmed 77312 records to 53778 (keeping 200 days of data) [2025-10-02T18:41:26.676203] [DEBUG] [LOCAL ] EL: Primary data saved (53778 records). [2025-10-02T18:41:26.676370] [INFO ] [MAIN ] EL: Full history saved. [2025-10-02T18:41:26.677550] [INFO ] [MAIN ] Update Progress: 723/2370 symbols completed. EL took 34.6s. Estimated remaining: 3h 50m 57s. Rate: 7.1 symbols/min [2025-10-02T18:41:26.674756] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-02T18:41:26.875182] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:26.875361] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-02T18:41:26.875411] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-02T18:41:26.875528] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-02T18:41:26.875573] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-02T18:41:26.875617] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-02T18:41:26.875680] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-02T18:41:27.283319] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:27.313280] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T18:41:27.315056] [INFO ] [REMOTE ] ELME: Full fetch complete (56115 records). [2025-10-02T18:41:27.315151] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-02T18:41:27.478115] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-02T18:41:27.755682] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-10-02T18:41:27.755787] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-10-02T18:41:27.756550] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-10-02T18:41:27.756621] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-10-02T18:41:27.758129] [DEBUG] [LOCAL ] ELME: Trimmed 56115 records to 39517 (keeping 200 days of data) [2025-10-02T18:41:28.015557] [DEBUG] [LOCAL ] ELME: Primary data saved (39517 records). [2025-10-02T18:41:28.015759] [INFO ] [MAIN ] ELME: Full history saved. [2025-10-02T18:41:28.015853] [INFO ] [MAIN ] Update Progress: 724/2370 symbols completed. ELME took 26.2s. Estimated remaining: 3h 50m 32s. Rate: 7.1 symbols/min [2025-10-02T18:41:28.197616] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:28.247154] [DEBUG] [LOCAL ] ELS: Loaded 49457 existing records from primary storage. [2025-10-02T18:41:28.247497] [INFO ] [MAIN ] ELS: Loaded 49457 existing records. [2025-10-02T18:41:28.279961] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-10-02T18:41:28.463931] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:41:28.464379] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-02T18:41:28.464440] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-02T18:41:28.465861] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-02T18:41:28.465924] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-02T18:41:28.812012] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T18:41:28.831599] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-02T18:41:28.916474] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:28.951748] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-02T18:41:29.072992] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-02T18:41:29.533837] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-02T18:41:29.873035] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-02T18:41:30.673016] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-10-02T18:41:31.473052] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-02T18:41:31.778139] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T18:41:32.273007] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-02T18:41:32.450118] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T18:41:32.582803] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T18:41:33.073048] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-02T18:41:33.873013] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-02T18:41:34.039801] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-02T18:41:34.042008] [INFO ] [REMOTE ] ELF: Full fetch complete (75328 records). [2025-10-02T18:41:34.042190] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-02T18:41:34.252478] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-02T18:41:34.501682] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-10-02T18:41:34.501954] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-10-02T18:41:34.502858] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-10-02T18:41:34.503004] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-10-02T18:41:34.531186] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T18:41:34.529716] [DEBUG] [LOCAL ] ELF: Trimmed 75328 records to 52560 (keeping 200 days of data) [2025-10-02T18:41:34.718615] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-02T18:41:34.872458] [DEBUG] [LOCAL ] ELF: Primary data saved (52560 records). [2025-10-02T18:41:34.872708] [INFO ] [MAIN ] ELF: Full history saved. [2025-10-02T18:41:34.872802] [INFO ] [MAIN ] Update Progress: 725/2370 symbols completed. ELF took 42.8s. Estimated remaining: 3h 50m 20s. Rate: 7.1 symbols/min [2025-10-02T18:41:35.063315] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:35.100950] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-02T18:41:35.121444] [DEBUG] [LOCAL ] ELV: Loaded 50546 existing records from primary storage. [2025-10-02T18:41:35.121823] [INFO ] [MAIN ] ELV: Loaded 50546 existing records. [2025-10-02T18:41:35.329567] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:41:35.329863] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-02T18:41:35.329939] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-02T18:41:35.331599] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-10-02T18:41:35.331693] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-02T18:41:35.485633] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-02T18:41:35.724915] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:36.273024] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-10-02T18:41:36.920253] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T18:41:37.072992] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-02T18:41:37.531922] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-02T18:41:37.872997] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-02T18:41:38.592955] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-02T18:41:38.673022] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-02T18:41:39.139007] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T18:41:39.473023] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-02T18:41:40.015993] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-02T18:41:40.134057] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T18:41:40.273022] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-02T18:41:40.619494] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T18:41:41.073043] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-02T18:41:41.873027] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-02T18:41:42.471597] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:41:42.673019] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-02T18:41:42.993175] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T18:41:43.473005] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-02T18:41:43.876436] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-02T18:41:44.273000] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-02T18:41:44.320675] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T18:41:45.072968] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-02T18:41:45.523862] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T18:41:45.872999] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-02T18:41:46.672982] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-02T18:41:46.794971] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T18:41:47.006534] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-02T18:41:47.473011] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-02T18:41:47.587122] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T18:41:48.273004] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-02T18:41:48.608569] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T18:41:49.073006] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-02T18:41:49.872984] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-02T18:41:50.273806] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-02T18:41:50.597735] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T18:41:50.672978] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-02T18:41:50.797527] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T18:41:51.473009] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-02T18:41:52.273008] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-02T18:41:52.368710] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T18:41:52.370120] [INFO ] [REMOTE ] ELP: Full fetch complete (37115 records). [2025-10-02T18:41:52.370229] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-02T18:41:52.661947] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-02T18:41:52.818081] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-02T18:41:52.818220] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-02T18:41:52.819093] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-02T18:41:52.819160] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-02T18:41:52.820150] [DEBUG] [LOCAL ] ELP: Trimmed 37115 records to 25797 (keeping 200 days of data) [2025-10-02T18:41:52.953995] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-02T18:41:53.021566] [DEBUG] [LOCAL ] ELP: Primary data saved (25797 records). [2025-10-02T18:41:53.021740] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-02T18:41:53.021837] [INFO ] [MAIN ] Update Progress: 726/2370 symbols completed. ELP took 32.7s. Estimated remaining: 3h 50m 34s. Rate: 7.1 symbols/min [2025-10-02T18:41:53.078985] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-02T18:41:53.211810] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:53.211982] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-02T18:41:53.212020] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-02T18:41:53.212162] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-02T18:41:53.212205] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-02T18:41:53.212247] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-02T18:41:53.212279] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-02T18:41:53.590600] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:53.873001] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-02T18:41:54.673028] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-02T18:41:54.818793] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T18:41:55.472978] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-10-02T18:41:55.555144] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T18:41:55.555925] [INFO ] [REMOTE ] ELPC: Full fetch complete (1433 records). [2025-10-02T18:41:55.555997] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-02T18:41:55.698469] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:41:55.721840] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-10-02T18:41:55.733527] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:41:55.770435] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-02T18:41:55.770089] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-02T18:41:55.770956] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:41:55.771091] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:41:55.771249] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-02T18:41:55.786333] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:41:55.798734] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-02T18:41:55.799150] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-02T18:41:55.799063] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-02T18:41:55.799878] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-02T18:41:55.801756] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T18:41:55.799304] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-02T18:41:55.812822] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-02T18:41:55.812357] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-02T18:41:55.813111] [INFO ] [MAIN ] Update Progress: 727/2370 symbols completed. EMA took 2.8s. Estimated remaining: 3h 50m 13s. Rate: 7.1 symbols/min [2025-10-02T18:41:55.835545] [INFO ] [MAIN ] Update Progress: 728/2370 symbols completed. ELPC took 29.2s. Estimated remaining: 3h 49m 46s. Rate: 7.1 symbols/min [2025-10-02T18:41:56.184339] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:56.203638] [DEBUG] [LOCAL ] EME: No existing data file found in primary storage. [2025-10-02T18:41:56.205046] [WARN ] [MAIN ] EME: No existing data found, performing full refresh instead. [2025-10-02T18:41:56.205222] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-02T18:41:56.205294] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-02T18:41:56.204969] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:41:56.205459] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-10-02T18:41:56.205624] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-02T18:41:56.205570] [DEBUG] [LOCAL ] EMD: No existing data file found in primary storage. [2025-10-02T18:41:56.240848] [WARN ] [MAIN ] EMD: No existing data found, performing full refresh instead. [2025-10-02T18:41:56.266310] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-02T18:41:56.276032] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-02T18:41:56.277132] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-02T18:41:56.290059] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-02T18:41:56.317081] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-02T18:41:57.019468] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:57.065783] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:41:57.072996] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-10-02T18:41:57.872990] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-10-02T18:41:58.517547] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-02T18:41:58.551453] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T18:41:58.673025] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-02T18:41:59.344686] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T18:41:59.473060] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-02T18:42:00.273020] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-02T18:42:00.669613] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T18:42:01.072978] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-02T18:42:01.216607] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T18:42:01.873022] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-02T18:42:01.932146] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T18:42:02.673032] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-02T18:42:02.892335] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T18:42:03.063589] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-02T18:42:03.473014] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-02T18:42:03.853141] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T18:42:04.273004] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-02T18:42:04.847336] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T18:42:04.849635] [INFO ] [REMOTE ] ELV: Full fetch complete (73182 records). [2025-10-02T18:42:04.849975] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-02T18:42:05.096556] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-02T18:42:05.344453] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-02T18:42:05.344547] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-02T18:42:05.345491] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-02T18:42:05.345559] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-02T18:42:05.347145] [DEBUG] [LOCAL ] ELV: Trimmed 73182 records to 50927 (keeping 200 days of data) [2025-10-02T18:42:05.653039] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T18:42:05.739667] [DEBUG] [LOCAL ] ELV: Primary data saved (50927 records). [2025-10-02T18:42:05.739826] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-02T18:42:05.739911] [INFO ] [MAIN ] Update Progress: 729/2370 symbols completed. ELV took 30.9s. Estimated remaining: 3h 49m 41s. Rate: 7.1 symbols/min [2025-10-02T18:42:05.878167] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-02T18:42:05.936803] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:42:05.942939] [DEBUG] [LOCAL ] EMF: Loaded 3414 existing records from primary storage. [2025-10-02T18:42:05.943118] [INFO ] [MAIN ] EMF: Loaded 3414 existing records. [2025-10-02T18:42:06.150116] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:42:06.150330] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-02T18:42:06.150387] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-02T18:42:06.150742] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-02T18:42:06.150812] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-02T18:42:06.601998] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:42:06.673083] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-02T18:42:06.754020] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T18:42:06.814969] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T18:42:07.473009] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-10-02T18:42:08.273008] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-02T18:42:08.328114] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T18:42:08.345444] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T18:42:09.072993] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-02T18:42:09.872993] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-02T18:42:10.027513] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T18:42:10.300364] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T18:42:10.672988] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-02T18:42:10.747888] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T18:42:11.305547] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T18:42:11.473033] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-02T18:42:12.273048] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-02T18:42:13.073012] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-02T18:42:13.790714] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T18:42:13.873253] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-02T18:42:14.202662] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T18:42:14.258472] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-10-02T18:42:14.432946] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T18:42:14.673083] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-02T18:42:15.473009] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-02T18:42:16.076284] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T18:42:16.078946] [INFO ] [REMOTE ] ELS: Full fetch complete (70808 records). [2025-10-02T18:42:16.079088] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-02T18:42:16.278594] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-02T18:42:16.553597] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-02T18:42:16.553782] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-02T18:42:16.555030] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-02T18:42:16.555120] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-02T18:42:16.557032] [DEBUG] [LOCAL ] ELS: Trimmed 70808 records to 49822 (keeping 200 days of data) [2025-10-02T18:42:16.931629] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T18:42:16.930526] [DEBUG] [LOCAL ] ELS: Primary data saved (49822 records). [2025-10-02T18:42:16.931926] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-02T18:42:16.932073] [INFO ] [MAIN ] Update Progress: 730/2370 symbols completed. ELS took 48.9s. Estimated remaining: 3h 49m 39s. Rate: 7.1 symbols/min [2025-10-02T18:42:17.078122] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-02T18:42:17.170569] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:42:17.221208] [DEBUG] [LOCAL ] EMN: Loaded 50458 existing records from primary storage. [2025-10-02T18:42:17.221564] [INFO ] [MAIN ] EMN: Loaded 50458 existing records. [2025-10-02T18:42:17.423426] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:42:17.423843] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-02T18:42:17.423958] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-02T18:42:17.425549] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-02T18:42:17.425680] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-02T18:42:17.569262] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T18:42:17.847110] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:42:17.873040] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-10-02T18:42:18.517122] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T18:42:18.673009] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-02T18:42:19.473001] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-02T18:42:19.665635] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T18:42:19.711777] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-02T18:42:20.152752] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-02T18:42:20.273017] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-02T18:42:21.080134] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-02T18:42:21.082834] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T18:42:21.627934] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-02T18:42:21.873019] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-02T18:42:22.673071] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-02T18:42:23.313890] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:42:23.473001] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-02T18:42:23.541498] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T18:42:24.273045] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-02T18:42:25.073075] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-02T18:42:25.195877] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T18:42:25.508398] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T18:42:25.873024] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-02T18:42:26.217873] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T18:42:26.673048] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-02T18:42:27.473016] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-02T18:42:27.508757] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T18:42:27.780601] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T18:42:28.095521] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T18:42:28.273016] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-02T18:42:28.749103] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T18:42:29.073004] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-02T18:42:29.873034] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-02T18:42:30.582060] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-02T18:42:30.672970] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-02T18:42:30.944579] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T18:42:31.472119] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T18:42:31.473586] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-02T18:42:31.474855] [INFO ] [REMOTE ] EMD: Full fetch complete (32476 records). [2025-10-02T18:42:31.474933] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-02T18:42:31.945963] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-02T18:42:31.946051] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-02T18:42:31.946759] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-02T18:42:31.946831] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-02T18:42:31.948008] [DEBUG] [LOCAL ] EMD: Trimmed 32476 records to 21348 (keeping 200 days of data) [2025-10-02T18:42:32.085979] [DEBUG] [LOCAL ] EMD: Primary data saved (21348 records). [2025-10-02T18:42:32.086160] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-02T18:42:32.086284] [INFO ] [MAIN ] Update Progress: 731/2370 symbols completed. EMD took 36.3s. Estimated remaining: 3h 49m 45s. Rate: 7.1 symbols/min [2025-10-02T18:42:32.268803] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:42:32.272990] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-02T18:42:32.282941] [DEBUG] [LOCAL ] EMO: Loaded 12527 existing records from primary storage. [2025-10-02T18:42:32.283190] [INFO ] [MAIN ] EMO: Loaded 12527 existing records. [2025-10-02T18:42:32.474284] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:42:32.474518] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-02T18:42:32.474588] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-02T18:42:32.475111] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-10-02T18:42:32.475173] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-02T18:42:32.872879] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:42:33.073027] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-02T18:42:33.315224] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T18:42:33.477183] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-02T18:42:33.477961] [INFO ] [REMOTE ] EMF: Full fetch complete (7105 records). [2025-10-02T18:42:33.478085] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-02T18:42:33.591149] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T18:42:33.636096] [INFO ] [REMOTE ] EME: Full fetch complete (46868 records). [2025-10-02T18:42:33.636395] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-02T18:42:33.876992] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-02T18:42:34.225145] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-02T18:42:34.237194] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-02T18:42:34.253221] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-02T18:42:34.267872] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-02T18:42:34.285784] [DEBUG] [LOCAL ] EMF: Trimmed 7105 records to 3431 (keeping 200 days of data) [2025-10-02T18:42:34.414785] [DEBUG] [LOCAL ] EMF: Primary data saved (3431 records). [2025-10-02T18:42:34.417780] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-02T18:42:34.417923] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-02T18:42:34.418057] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-02T18:42:34.418931] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-02T18:42:34.419038] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-02T18:42:34.418225] [INFO ] [MAIN ] Update Progress: 732/2370 symbols completed. EMF took 28.7s. Estimated remaining: 3h 49m 23s. Rate: 7.1 symbols/min [2025-10-02T18:42:34.512268] [DEBUG] [LOCAL ] EME: Trimmed 46868 records to 31497 (keeping 200 days of data) [2025-10-02T18:42:34.684109] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-10-02T18:42:34.722570] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:42:34.754177] [DEBUG] [LOCAL ] EMP: Loaded 3063 existing records from primary storage. [2025-10-02T18:42:34.754929] [INFO ] [MAIN ] EMP: Loaded 3063 existing records. [2025-10-02T18:42:35.042404] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:42:35.052064] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-02T18:42:35.060777] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-02T18:42:35.065375] [DEBUG] [LOCAL ] EME: Primary data saved (31497 records). [2025-10-02T18:42:35.065489] [INFO ] [MAIN ] EME: Full history saved. [2025-10-02T18:42:35.065551] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-02T18:42:35.065678] [INFO ] [MAIN ] Update Progress: 733/2370 symbols completed. EME took 39.2s. Estimated remaining: 3h 48m 58s. Rate: 7.1 symbols/min [2025-10-02T18:42:35.065792] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-02T18:42:35.517180] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:42:35.678819] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:42:35.679718] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-10-02T18:42:35.730960] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T18:42:35.764054] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T18:42:35.787058] [DEBUG] [LOCAL ] EMR: Loaded 53250 existing records from primary storage. [2025-10-02T18:42:35.787561] [INFO ] [MAIN ] EMR: Loaded 53250 existing records. [2025-10-02T18:42:35.986019] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:42:35.986352] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-02T18:42:35.986413] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-02T18:42:35.989237] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-02T18:42:35.989320] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-02T18:42:36.274288] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-02T18:42:36.390396] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T18:42:36.416175] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:42:37.073023] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-02T18:42:37.769779] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-02T18:42:37.873023] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-02T18:42:38.080610] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-02T18:42:38.612986] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T18:42:38.673030] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-02T18:42:39.473006] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-02T18:42:40.273024] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-10-02T18:42:40.291381] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T18:42:41.073014] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-02T18:42:41.429279] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T18:42:41.873017] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-02T18:42:41.891117] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T18:42:42.086949] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T18:42:42.673041] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-02T18:42:43.472985] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-02T18:42:43.569266] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T18:42:43.650407] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T18:42:43.926768] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T18:42:44.273047] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-02T18:42:45.073014] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-02T18:42:45.873030] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-02T18:42:46.093091] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T18:42:46.508268] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T18:42:46.673048] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-02T18:42:47.473037] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-02T18:42:48.120447] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-10-02T18:42:48.272997] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-02T18:42:48.404845] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T18:42:49.040741] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-02T18:42:49.073014] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-02T18:42:49.262927] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T18:42:49.630352] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T18:42:49.872997] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-02T18:42:50.242400] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-02T18:42:50.673009] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-02T18:42:51.473011] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-02T18:42:51.999107] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T18:42:52.001255] [INFO ] [REMOTE ] EMN: Full fetch complete (72087 records). [2025-10-02T18:42:52.001380] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-02T18:42:52.279279] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-02T18:42:52.438356] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-02T18:42:52.438490] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-02T18:42:52.439412] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-02T18:42:52.439479] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-02T18:42:52.441021] [DEBUG] [LOCAL ] EMN: Trimmed 72087 records to 50840 (keeping 200 days of data) [2025-10-02T18:42:52.774292] [DEBUG] [LOCAL ] EMN: Primary data saved (50840 records). [2025-10-02T18:42:52.774429] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-02T18:42:52.774527] [INFO ] [MAIN ] Update Progress: 734/2370 symbols completed. EMN took 35.8s. Estimated remaining: 3h 49m 10s. Rate: 7.1 symbols/min [2025-10-02T18:42:52.957084] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:42:53.011787] [DEBUG] [LOCAL ] ENB: Loaded 53512 existing records from primary storage. [2025-10-02T18:42:53.012134] [INFO ] [MAIN ] ENB: Loaded 53512 existing records. [2025-10-02T18:42:53.079111] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-02T18:42:53.210100] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:42:53.210622] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-02T18:42:53.210902] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-02T18:42:53.214118] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-02T18:42:53.214184] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-02T18:42:53.350278] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T18:42:53.529294] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T18:42:53.651412] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:42:53.683844] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-02T18:42:53.873021] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-10-02T18:42:54.673014] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-02T18:42:55.255151] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T18:42:55.472999] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-02T18:42:55.847051] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-02T18:42:56.272996] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-02T18:42:56.959607] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T18:42:57.072998] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-02T18:42:57.356804] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T18:42:57.525759] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-02T18:42:57.873775] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-02T18:42:58.673005] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-02T18:42:59.314961] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T18:42:59.473007] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-02T18:42:59.709912] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:43:00.273000] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-02T18:43:00.848976] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-02T18:43:00.988286] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T18:43:01.073198] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-02T18:43:01.604327] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T18:43:01.605797] [INFO ] [REMOTE ] EMP: Full fetch complete (4293 records). [2025-10-02T18:43:01.605963] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-02T18:43:01.606865] [FATAL] [VALIDATOR ] EMP: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:43:01.606976] [FATAL] [MAIN ] EMP: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:43:01.607039] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:43:01.607134] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-02T18:43:01.607244] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-10-02T18:43:01.607347] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-10-02T18:43:01.608018] [DEBUG] [LOCAL ] EMP: Deleted derivative data file. [2025-10-02T18:43:01.608212] [INFO ] [MAIN ] Update Progress: 735/2370 symbols completed. EMP took 27.2s. Estimated remaining: 3h 49m 2s. Rate: 7.1 symbols/min [2025-10-02T18:43:01.825487] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:01.831312] [DEBUG] [LOCAL ] ENFY: Loaded 3099 existing records from primary storage. [2025-10-02T18:43:01.831512] [INFO ] [MAIN ] ENFY: Loaded 3099 existing records. [2025-10-02T18:43:01.878188] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-02T18:43:02.033417] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:43:02.033627] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-10-02T18:43:02.033714] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-02T18:43:02.033976] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-10-02T18:43:02.034040] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-10-02T18:43:02.483710] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:02.672992] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-02T18:43:02.853742] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T18:43:02.854926] [INFO ] [REMOTE ] EMO: Full fetch complete (17222 records). [2025-10-02T18:43:02.855003] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-02T18:43:03.257806] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-02T18:43:03.257892] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-02T18:43:03.258330] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-02T18:43:03.258393] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-02T18:43:03.259088] [DEBUG] [LOCAL ] EMO: Trimmed 17222 records to 12644 (keeping 200 days of data) [2025-10-02T18:43:03.343375] [DEBUG] [LOCAL ] EMO: Primary data saved (12644 records). [2025-10-02T18:43:03.343515] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-02T18:43:03.343626] [INFO ] [MAIN ] Update Progress: 736/2370 symbols completed. EMO took 31.3s. Estimated remaining: 3h 48m 39s. Rate: 7.1 symbols/min [2025-10-02T18:43:03.478165] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-10-02T18:43:03.546912] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:03.547187] [DEBUG] [LOCAL ] ENIC: No existing data file found in primary storage. [2025-10-02T18:43:03.547239] [WARN ] [MAIN ] ENIC: No existing data found, performing full refresh instead. [2025-10-02T18:43:03.547354] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-02T18:43:03.547397] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-02T18:43:03.547442] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-02T18:43:03.547475] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-02T18:43:03.976731] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:04.273000] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-02T18:43:04.360381] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-10-02T18:43:04.423077] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T18:43:05.072991] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-10-02T18:43:05.845985] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T18:43:05.872990] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-10-02T18:43:06.093954] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T18:43:06.458895] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T18:43:06.673067] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-10-02T18:43:07.051265] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-02T18:43:07.473096] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-10-02T18:43:08.273053] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-02T18:43:09.040876] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T18:43:09.073034] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-02T18:43:09.873035] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-02T18:43:10.063738] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:43:10.113006] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T18:43:10.673003] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-02T18:43:11.473004] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-02T18:43:11.712832] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T18:43:11.889944] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-02T18:43:12.273013] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-10-02T18:43:12.617048] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-02T18:43:12.911247] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:43:13.072997] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-02T18:43:13.872997] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-02T18:43:14.529245] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T18:43:14.673045] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-10-02T18:43:15.287936] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T18:43:15.473019] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-10-02T18:43:16.128349] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T18:43:16.273050] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-02T18:43:16.785613] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-10-02T18:43:17.073012] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-02T18:43:17.873036] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-10-02T18:43:18.172900] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T18:43:18.488905] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T18:43:18.663701] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T18:43:18.672956] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-10-02T18:43:19.184442] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T18:43:19.473041] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-10-02T18:43:20.066255] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T18:43:20.272981] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-10. [2025-10-02T18:43:20.938475] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-02T18:43:20.939190] [INFO ] [REMOTE ] ENFY: Full fetch complete (5602 records). [2025-10-02T18:43:20.939260] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-10-02T18:43:20.939629] [FATAL] [VALIDATOR ] ENFY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:43:20.939746] [FATAL] [MAIN ] ENFY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:43:20.939790] [WARN ] [MAIN ] ENFY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:43:20.939829] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-10-02T18:43:20.939884] [DEBUG] [LOCAL ] ENFY: No primary data file found to delete. [2025-10-02T18:43:20.939919] [INFO ] [LOCAL ] ENFY: Starting deletion of derivative data. [2025-10-02T18:43:20.940288] [DEBUG] [LOCAL ] ENFY: Deleted derivative data file. [2025-10-02T18:43:20.940377] [INFO ] [MAIN ] Update Progress: 737/2370 symbols completed. ENFY took 19.3s. Estimated remaining: 3h 48m 51s. Rate: 7.1 symbols/min [2025-10-02T18:43:21.078121] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-02T18:43:21.134775] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:21.138990] [DEBUG] [LOCAL ] ENO: Loaded 1915 existing records from primary storage. [2025-10-02T18:43:21.139232] [INFO ] [MAIN ] ENO: Loaded 1915 existing records. [2025-10-02T18:43:21.356708] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:43:21.357043] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-02T18:43:21.357113] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-02T18:43:21.357401] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-10-02T18:43:21.357463] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-02T18:43:21.756098] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:21.872998] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-10-02T18:43:22.261175] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-10-02T18:43:22.672998] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-02T18:43:22.734246] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T18:43:23.473006] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-02T18:43:24.106044] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T18:43:24.273029] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-02T18:43:24.756197] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-02T18:43:25.072987] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-02T18:43:25.850270] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T18:43:25.853050] [INFO ] [REMOTE ] EMR: Full fetch complete (77103 records). [2025-10-02T18:43:25.853190] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-02T18:43:25.878176] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-02T18:43:26.316935] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-10-02T18:43:26.317032] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-10-02T18:43:26.318160] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-10-02T18:43:26.318229] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-10-02T18:43:26.323023] [DEBUG] [LOCAL ] EMR: Trimmed 77103 records to 53633 (keeping 200 days of data) [2025-10-02T18:43:26.597810] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T18:43:26.692119] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-02T18:43:26.754945] [DEBUG] [LOCAL ] EMR: Primary data saved (53633 records). [2025-10-02T18:43:26.755156] [INFO ] [MAIN ] EMR: Full history saved. [2025-10-02T18:43:26.756266] [INFO ] [MAIN ] Update Progress: 738/2370 symbols completed. EMR took 51.7s. Estimated remaining: 3h 48m 37s. Rate: 7.1 symbols/min [2025-10-02T18:43:26.953075] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:27.006505] [DEBUG] [LOCAL ] ENOV: Loaded 44921 existing records from primary storage. [2025-10-02T18:43:27.006896] [INFO ] [MAIN ] ENOV: Loaded 44921 existing records. [2025-10-02T18:43:27.218331] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:43:27.218539] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-02T18:43:27.218589] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-02T18:43:27.220518] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-10-02T18:43:27.220591] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-02T18:43:27.483707] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-02T18:43:27.612468] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:27.697489] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T18:43:27.861068] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-02T18:43:28.004382] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-02T18:43:28.273009] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-02T18:43:29.073022] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-02T18:43:29.556350] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-02T18:43:29.873037] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-10-02T18:43:30.184089] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T18:43:30.673045] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-02T18:43:31.473017] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-02T18:43:31.601982] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T18:43:32.026627] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T18:43:32.118741] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T18:43:32.273050] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-02T18:43:32.861663] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T18:43:33.073017] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-02T18:43:33.873001] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-02T18:43:34.462588] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T18:43:34.673013] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-02T18:43:35.404458] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T18:43:35.473057] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-02T18:43:35.908678] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T18:43:36.107770] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T18:43:36.273030] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-02T18:43:37.073039] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-02T18:43:37.873000] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-02T18:43:38.118867] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T18:43:38.329191] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-02T18:43:38.546624] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T18:43:38.673049] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-02T18:43:39.473018] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-02T18:43:40.189347] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T18:43:40.191730] [INFO ] [REMOTE ] ENB: Full fetch complete (77488 records). [2025-10-02T18:43:40.191890] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-02T18:43:40.278162] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-02T18:43:40.643824] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-10-02T18:43:40.644003] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-10-02T18:43:40.648900] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-02T18:43:40.648755] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-10-02T18:43:40.650738] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-10-02T18:43:40.652192] [DEBUG] [LOCAL ] ENB: Trimmed 77488 records to 53900 (keeping 200 days of data) [2025-10-02T18:43:41.005559] [DEBUG] [LOCAL ] ENB: Primary data saved (53900 records). [2025-10-02T18:43:41.005751] [INFO ] [MAIN ] ENB: Full history saved. [2025-10-02T18:43:41.005844] [INFO ] [MAIN ] Update Progress: 739/2370 symbols completed. ENB took 48.2s. Estimated remaining: 3h 48m 42s. Rate: 7.1 symbols/min [2025-10-02T18:43:41.078144] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-02T18:43:41.208007] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:41.238379] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:43:41.286930] [DEBUG] [LOCAL ] ENR: Loaded 42858 existing records from primary storage. [2025-10-02T18:43:41.287271] [INFO ] [MAIN ] ENR: Loaded 42858 existing records. [2025-10-02T18:43:41.543825] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:43:41.544084] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-02T18:43:41.544138] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-02T18:43:41.545972] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-02T18:43:41.546037] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-02T18:43:41.877067] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-02T18:43:41.967745] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:42.196155] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T18:43:42.197809] [INFO ] [REMOTE ] ENIC: Full fetch complete (51447 records). [2025-10-02T18:43:42.197929] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-02T18:43:42.605980] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-02T18:43:42.606101] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-02T18:43:42.606886] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-02T18:43:42.606964] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-02T18:43:42.608487] [DEBUG] [LOCAL ] ENIC: Trimmed 51447 records to 36637 (keeping 200 days of data) [2025-10-02T18:43:42.676327] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-10-02T18:43:42.835555] [DEBUG] [LOCAL ] ENIC: Primary data saved (36637 records). [2025-10-02T18:43:42.835756] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-02T18:43:42.835845] [INFO ] [MAIN ] Update Progress: 740/2370 symbols completed. ENIC took 39.5s. Estimated remaining: 3h 48m 19s. Rate: 7.1 symbols/min [2025-10-02T18:43:43.023086] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:43.023285] [DEBUG] [LOCAL ] ENS: No existing data file found in primary storage. [2025-10-02T18:43:43.023325] [WARN ] [MAIN ] ENS: No existing data found, performing full refresh instead. [2025-10-02T18:43:43.023445] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-02T18:43:43.023489] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-02T18:43:43.023534] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-02T18:43:43.023569] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-02T18:43:43.443945] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:43.471765] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:43:43.481304] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-02T18:43:43.868255] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-02T18:43:44.103989] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T18:43:44.273007] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-02T18:43:45.073043] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-10-02T18:43:45.872974] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-02T18:43:45.914737] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T18:43:46.374072] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T18:43:46.673007] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-02T18:43:47.149258] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T18:43:47.171505] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T18:43:47.172224] [INFO ] [REMOTE ] ENO: Full fetch complete (3113 records). [2025-10-02T18:43:47.172295] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-02T18:43:47.478244] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-02T18:43:47.576996] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-02T18:43:47.577099] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-02T18:43:47.577251] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-02T18:43:47.577312] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-02T18:43:47.577840] [DEBUG] [LOCAL ] ENO: Trimmed 3113 records to 1926 (keeping 200 days of data) [2025-10-02T18:43:47.599158] [DEBUG] [LOCAL ] ENO: Primary data saved (1926 records). [2025-10-02T18:43:47.599308] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-02T18:43:47.599406] [INFO ] [MAIN ] Update Progress: 741/2370 symbols completed. ENO took 26.7s. Estimated remaining: 3h 48m 2s. Rate: 7.1 symbols/min [2025-10-02T18:43:47.813366] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:43:47.844896] [DEBUG] [LOCAL ] ENVA: Loaded 25283 existing records from primary storage. [2025-10-02T18:43:47.845160] [INFO ] [MAIN ] ENVA: Loaded 25283 existing records. [2025-10-02T18:43:48.031881] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:43:48.032092] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-02T18:43:48.032154] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-02T18:43:48.033063] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-02T18:43:48.033126] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-02T18:43:48.284438] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-02T18:43:48.460491] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:43:48.906024] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:43:49.073003] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-02T18:43:49.613523] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T18:43:49.873026] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-02T18:43:50.240135] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T18:43:50.672995] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-02T18:43:51.426222] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:43:51.473018] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-02T18:43:52.080461] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T18:43:52.273019] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-02T18:43:53.072978] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-02T18:43:53.149508] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T18:43:53.307028] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T18:43:53.873010] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-02T18:43:54.673000] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-02T18:43:54.746620] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T18:43:55.301928] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T18:43:55.473007] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-02T18:43:56.273003] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-02T18:43:56.363855] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:43:57.072974] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-02T18:43:57.111429] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T18:43:57.420677] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T18:43:57.873001] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-10-02T18:43:58.619014] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T18:43:58.673011] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-02T18:43:59.040112] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T18:43:59.473010] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-02T18:43:59.773307] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T18:43:59.775905] [INFO ] [REMOTE ] ENOV: Full fetch complete (63222 records). [2025-10-02T18:43:59.776037] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-02T18:44:00.201011] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-10-02T18:44:00.201093] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-10-02T18:44:00.201961] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-10-02T18:44:00.202025] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-10-02T18:44:00.203350] [DEBUG] [LOCAL ] ENOV: Trimmed 63222 records to 45207 (keeping 200 days of data) [2025-10-02T18:44:00.290956] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-02T18:44:00.487728] [DEBUG] [LOCAL ] ENOV: Primary data saved (45207 records). [2025-10-02T18:44:00.487863] [INFO ] [MAIN ] ENOV: Full history saved. [2025-10-02T18:44:00.488413] [INFO ] [MAIN ] Update Progress: 742/2370 symbols completed. ENOV took 33.7s. Estimated remaining: 3h 48m 4s. Rate: 7.1 symbols/min [2025-10-02T18:44:00.669736] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:00.685941] [DEBUG] [LOCAL ] EOD: Loaded 14412 existing records from primary storage. [2025-10-02T18:44:00.686192] [INFO ] [MAIN ] EOD: Loaded 14412 existing records. [2025-10-02T18:44:00.876314] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:00.876523] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-02T18:44:00.876573] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-02T18:44:00.877415] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-02T18:44:00.877482] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-02T18:44:01.078397] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-02T18:44:01.278457] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:01.312859] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T18:44:01.838389] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:44:01.872987] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-10-02T18:44:02.265342] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T18:44:02.571569] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-02T18:44:02.672994] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-10-02T18:44:03.473037] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-02T18:44:04.122017] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T18:44:04.272999] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-10-02T18:44:04.743541] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T18:44:05.073013] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-02T18:44:05.692168] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T18:44:05.873035] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-02T18:44:06.045600] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T18:44:06.673056] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-02T18:44:06.783237] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T18:44:07.473002] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-02T18:44:08.037931] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-02T18:44:08.068506] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:44:08.273013] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-02T18:44:09.073049] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-02T18:44:09.635602] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T18:44:09.700146] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-02T18:44:09.873003] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-10-02T18:44:10.673012] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-02T18:44:11.215156] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T18:44:11.473037] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-02T18:44:11.933939] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T18:44:12.273022] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-02T18:44:12.295252] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T18:44:13.072996] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-02T18:44:13.237018] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:44:13.238480] [INFO ] [REMOTE ] ENS: Full fetch complete (42016 records). [2025-10-02T18:44:13.238582] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-02T18:44:13.239185] [FATAL] [VALIDATOR ] ENS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:44:13.239280] [FATAL] [MAIN ] ENS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:44:13.239362] [WARN ] [MAIN ] ENS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:44:13.239440] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-02T18:44:13.239552] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-10-02T18:44:13.239597] [INFO ] [LOCAL ] ENS: Starting deletion of derivative data. [2025-10-02T18:44:13.239669] [DEBUG] [LOCAL ] ENS: No derivative data file found to delete. [2025-10-02T18:44:13.239752] [INFO ] [MAIN ] Update Progress: 743/2370 symbols completed. ENS took 30.4s. Estimated remaining: 3h 48m 5s. Rate: 7.1 symbols/min [2025-10-02T18:44:13.451435] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:13.514300] [DEBUG] [LOCAL ] EOG: Loaded 53344 existing records from primary storage. [2025-10-02T18:44:13.514841] [INFO ] [MAIN ] EOG: Loaded 53344 existing records. [2025-10-02T18:44:13.717118] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:13.717369] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-02T18:44:13.717420] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-02T18:44:13.719994] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-02T18:44:13.720078] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-02T18:44:13.880053] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-10-02T18:44:14.130888] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:14.369917] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T18:44:14.673003] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-02T18:44:15.472948] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-02T18:44:15.480392] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T18:44:15.483122] [INFO ] [REMOTE ] ENR: Full fetch complete (58677 records). [2025-10-02T18:44:15.483310] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-10-02T18:44:16.069563] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-10-02T18:44:16.069763] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-10-02T18:44:16.070840] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-10-02T18:44:16.070985] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-10-02T18:44:16.098447] [DEBUG] [LOCAL ] ENR: Trimmed 58677 records to 43162 (keeping 200 days of data) [2025-10-02T18:44:16.101922] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T18:44:16.279717] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-02T18:44:16.443361] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T18:44:16.509292] [DEBUG] [LOCAL ] ENR: Primary data saved (43162 records). [2025-10-02T18:44:16.509490] [INFO ] [MAIN ] ENR: Full history saved. [2025-10-02T18:44:16.509619] [INFO ] [MAIN ] Update Progress: 744/2370 symbols completed. ENR took 35.5s. Estimated remaining: 3h 47m 45s. Rate: 7.1 symbols/min [2025-10-02T18:44:16.716620] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:16.730739] [DEBUG] [LOCAL ] EOI: Loaded 10683 existing records from primary storage. [2025-10-02T18:44:16.731018] [INFO ] [MAIN ] EOI: Loaded 10683 existing records. [2025-10-02T18:44:16.932028] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:16.932231] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-02T18:44:16.932281] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-02T18:44:16.932858] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-02T18:44:16.932919] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-02T18:44:17.089019] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-02T18:44:17.334429] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:17.351114] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T18:44:17.873011] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-02T18:44:18.062083] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-02T18:44:18.673356] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-10-02T18:44:19.143969] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T18:44:19.472983] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-02T18:44:20.233706] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T18:44:20.273003] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-10-02T18:44:20.542469] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T18:44:21.073038] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-02T18:44:21.241846] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T18:44:21.873019] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-02T18:44:22.672972] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-02T18:44:22.927860] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T18:44:22.955485] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T18:44:23.473012] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-02T18:44:23.593858] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T18:44:24.273018] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-02T18:44:24.618334] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T18:44:24.863196] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T18:44:25.073014] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-02T18:44:25.712825] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T18:44:25.713998] [INFO ] [REMOTE ] EOD: Full fetch complete (20232 records). [2025-10-02T18:44:25.714077] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-02T18:44:25.714518] [FATAL] [VALIDATOR ] EOD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:44:25.714714] [FATAL] [MAIN ] EOD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:44:25.714793] [WARN ] [MAIN ] EOD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:44:25.714881] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-02T18:44:25.714971] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-02T18:44:25.715011] [INFO ] [LOCAL ] EOD: Starting deletion of derivative data. [2025-10-02T18:44:25.715391] [DEBUG] [LOCAL ] EOD: Deleted derivative data file. [2025-10-02T18:44:25.715482] [INFO ] [MAIN ] Update Progress: 745/2370 symbols completed. EOD took 25.2s. Estimated remaining: 3h 47m 39s. Rate: 7.1 symbols/min [2025-10-02T18:44:25.878130] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-02T18:44:25.913392] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:25.930282] [DEBUG] [LOCAL ] EOS: Loaded 15225 existing records from primary storage. [2025-10-02T18:44:25.930542] [INFO ] [MAIN ] EOS: Loaded 15225 existing records. [2025-10-02T18:44:26.135404] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:26.135625] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-02T18:44:26.135709] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-02T18:44:26.136519] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-02T18:44:26.136610] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-02T18:44:26.535051] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:26.673053] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-02T18:44:27.273631] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:44:27.473034] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-02T18:44:27.690761] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T18:44:27.692259] [INFO ] [REMOTE ] ENVA: Full fetch complete (36785 records). [2025-10-02T18:44:27.692343] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-02T18:44:28.114322] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-10-02T18:44:28.114417] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-10-02T18:44:28.115086] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-10-02T18:44:28.115153] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-10-02T18:44:28.116193] [DEBUG] [LOCAL ] ENVA: Trimmed 36785 records to 25450 (keeping 200 days of data) [2025-10-02T18:44:28.276166] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-02T18:44:28.276797] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:44:28.303831] [DEBUG] [LOCAL ] ENVA: Primary data saved (25450 records). [2025-10-02T18:44:28.303995] [INFO ] [MAIN ] ENVA: Full history saved. [2025-10-02T18:44:28.304103] [INFO ] [MAIN ] Update Progress: 746/2370 symbols completed. ENVA took 40.7s. Estimated remaining: 3h 47m 17s. Rate: 7.1 symbols/min [2025-10-02T18:44:28.490228] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:28.499340] [DEBUG] [LOCAL ] EOT: Loaded 6873 existing records from primary storage. [2025-10-02T18:44:28.499572] [INFO ] [MAIN ] EOT: Loaded 6873 existing records. [2025-10-02T18:44:28.695314] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:28.695568] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-02T18:44:28.695619] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-02T18:44:28.696278] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-10-02T18:44:28.696345] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-02T18:44:29.078224] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-10-02T18:44:29.110975] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:29.813902] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T18:44:29.873008] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-10-02T18:44:30.229330] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T18:44:30.673012] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-02T18:44:30.775249] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T18:44:31.473004] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-02T18:44:32.235224] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T18:44:32.272991] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-02T18:44:32.672536] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-02T18:44:33.040460] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T18:44:33.073054] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-02T18:44:33.869103] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:44:33.873725] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-02T18:44:34.673011] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-02T18:44:34.802346] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T18:44:35.473042] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-02T18:44:35.497056] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T18:44:36.273006] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-02T18:44:36.641628] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T18:44:37.013692] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T18:44:37.073021] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-02T18:44:37.872995] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-02T18:44:38.213411] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T18:44:38.672983] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-02T18:44:38.742089] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T18:44:39.473012] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-02T18:44:39.621959] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T18:44:40.160755] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-02T18:44:40.273008] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-02T18:44:41.073052] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-02T18:44:41.274784] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T18:44:41.873036] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-02T18:44:42.673015] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-02T18:44:42.689351] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T18:44:43.473012] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-02T18:44:43.535461] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T18:44:43.890303] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T18:44:44.087999] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T18:44:44.272993] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-02T18:44:44.937989] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T18:44:45.073005] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-02T18:44:45.616665] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-02T18:44:45.872998] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-02T18:44:46.613362] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T18:44:46.673005] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-02T18:44:47.445959] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T18:44:47.472967] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-02T18:44:48.273037] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-02T18:44:48.996853] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T18:44:49.041916] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T18:44:49.072975] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-02T18:44:49.870420] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T18:44:49.872942] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-02T18:44:50.458071] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T18:44:50.458961] [INFO ] [REMOTE ] EOT: Full fetch complete (10768 records). [2025-10-02T18:44:50.459034] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-02T18:44:50.678192] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-02T18:44:50.872021] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-02T18:44:50.872120] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-02T18:44:50.872555] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-02T18:44:50.872635] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-02T18:44:50.873420] [DEBUG] [LOCAL ] EOT: Trimmed 10768 records to 6929 (keeping 200 days of data) [2025-10-02T18:44:50.925430] [DEBUG] [LOCAL ] EOT: Primary data saved (6929 records). [2025-10-02T18:44:50.925575] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-02T18:44:50.925683] [INFO ] [MAIN ] Update Progress: 747/2370 symbols completed. EOT took 22.6s. Estimated remaining: 3h 47m 40s. Rate: 7.1 symbols/min [2025-10-02T18:44:51.130242] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:51.158743] [DEBUG] [LOCAL ] EPAC: Loaded 26946 existing records from primary storage. [2025-10-02T18:44:51.159063] [INFO ] [MAIN ] EPAC: Loaded 26946 existing records. [2025-10-02T18:44:51.361662] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:51.361898] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-02T18:44:51.361948] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-02T18:44:51.362947] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-02T18:44:51.363011] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-02T18:44:51.474891] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-02T18:44:51.750355] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:52.119547] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:44:52.272997] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-10-02T18:44:53.072992] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-02T18:44:53.453318] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T18:44:53.652878] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T18:44:53.872975] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-02T18:44:53.903873] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T18:44:54.673007] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-02T18:44:54.759542] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-02T18:44:55.473015] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-02T18:44:55.708171] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T18:44:56.273005] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-02T18:44:56.362900] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T18:44:57.072986] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-02T18:44:57.428535] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T18:44:57.873040] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-02T18:44:57.944477] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T18:44:57.945703] [INFO ] [REMOTE ] EOI: Full fetch complete (16216 records). [2025-10-02T18:44:57.945786] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-02T18:44:58.344897] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-02T18:44:58.344981] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-02T18:44:58.345448] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-02T18:44:58.345508] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-02T18:44:58.346571] [DEBUG] [LOCAL ] EOI: Trimmed 16216 records to 10789 (keeping 200 days of data) [2025-10-02T18:44:58.422030] [DEBUG] [LOCAL ] EOI: Primary data saved (10789 records). [2025-10-02T18:44:58.422179] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-02T18:44:58.422264] [INFO ] [MAIN ] Update Progress: 748/2370 symbols completed. EOI took 41.9s. Estimated remaining: 3h 47m 30s. Rate: 7.1 symbols/min [2025-10-02T18:44:58.648409] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:44:58.673004] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-02T18:44:58.693292] [DEBUG] [LOCAL ] EPAM: Loaded 39752 existing records from primary storage. [2025-10-02T18:44:58.693809] [INFO ] [MAIN ] EPAM: Loaded 39752 existing records. [2025-10-02T18:44:58.909275] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:44:58.909512] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-02T18:44:58.909562] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-02T18:44:58.910727] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-10-02T18:44:58.910790] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-02T18:44:59.321429] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:44:59.473005] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-02T18:44:59.652446] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T18:44:59.777824] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T18:45:00.273069] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-02T18:45:00.852281] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T18:45:01.013445] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-02T18:45:01.014498] [INFO ] [REMOTE ] EOS: Full fetch complete (23193 records). [2025-10-02T18:45:01.014576] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-02T18:45:01.015106] [FATAL] [VALIDATOR ] EOS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:45:01.015194] [FATAL] [MAIN ] EOS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:45:01.015239] [WARN ] [MAIN ] EOS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:45:01.015321] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-02T18:45:01.015387] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-10-02T18:45:01.015422] [INFO ] [LOCAL ] EOS: Starting deletion of derivative data. [2025-10-02T18:45:01.015962] [DEBUG] [LOCAL ] EOS: Deleted derivative data file. [2025-10-02T18:45:01.016064] [INFO ] [MAIN ] Update Progress: 749/2370 symbols completed. EOS took 35.3s. Estimated remaining: 3h 47m 9s. Rate: 7.1 symbols/min [2025-10-02T18:45:01.081455] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-10-02T18:45:01.231688] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:01.277691] [DEBUG] [LOCAL ] EPC: Loaded 39811 existing records from primary storage. [2025-10-02T18:45:01.278004] [INFO ] [MAIN ] EPC: Loaded 39811 existing records. [2025-10-02T18:45:01.551621] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:45:01.551967] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-02T18:45:01.552090] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-02T18:45:01.553692] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-10-02T18:45:01.553768] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-02T18:45:01.882630] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-02T18:45:02.045770] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:02.673002] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-02T18:45:02.911394] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T18:45:02.942789] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T18:45:03.473043] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-10-02T18:45:04.272983] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-02T18:45:04.611041] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T18:45:05.072975] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-02T18:45:05.216560] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:45:05.726324] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:45:05.873007] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-02T18:45:06.672861] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-02T18:45:06.672925] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-02T18:45:06.677176] [INFO ] [REMOTE ] EOG: Full fetch complete (77276 records). [2025-10-02T18:45:06.677356] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-02T18:45:07.153219] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-02T18:45:07.153334] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-02T18:45:07.154354] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-02T18:45:07.154425] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-02T18:45:07.156286] [DEBUG] [LOCAL ] EOG: Trimmed 77276 records to 53734 (keeping 200 days of data) [2025-10-02T18:45:07.408130] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T18:45:07.493539] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-02T18:45:07.558182] [DEBUG] [LOCAL ] EOG: Primary data saved (53734 records). [2025-10-02T18:45:07.558382] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-02T18:45:07.558522] [INFO ] [MAIN ] Update Progress: 750/2370 symbols completed. EOG took 54.3s. Estimated remaining: 3h 46m 56s. Rate: 7.1 symbols/min [2025-10-02T18:45:07.785060] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:07.866786] [DEBUG] [LOCAL ] EPD: Loaded 53610 existing records from primary storage. [2025-10-02T18:45:07.867324] [INFO ] [MAIN ] EPD: Loaded 53610 existing records. [2025-10-02T18:45:08.208965] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T18:45:08.206411] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:45:08.217673] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-02T18:45:08.218680] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-02T18:45:08.220758] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-02T18:45:08.220834] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-02T18:45:08.278193] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-02T18:45:08.825507] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:08.847636] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T18:45:09.073000] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-10-02T18:45:09.580748] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T18:45:09.873036] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-02T18:45:10.673005] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-02T18:45:11.212966] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-10-02T18:45:11.477438] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-02T18:45:11.480283] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T18:45:11.969711] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T18:45:12.273022] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-02T18:45:13.072971] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-02T18:45:13.418685] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T18:45:13.774885] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T18:45:13.872978] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-02T18:45:14.429671] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T18:45:14.673082] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-02T18:45:15.472991] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-02T18:45:15.568177] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T18:45:16.273020] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-02T18:45:16.553380] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T18:45:16.781959] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T18:45:17.073045] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-02T18:45:17.527144] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T18:45:17.873027] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-02T18:45:18.676084] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-02T18:45:18.682460] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T18:45:19.473000] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-02T18:45:19.696565] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T18:45:19.738004] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T18:45:20.272998] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-02T18:45:21.073041] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-02T18:45:21.609250] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T18:45:21.873042] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-02T18:45:21.916243] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-10-02T18:45:22.595783] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T18:45:22.673010] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-02T18:45:23.378787] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T18:45:23.473054] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-02T18:45:24.265507] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T18:45:24.276763] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-02T18:45:24.981608] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T18:45:25.073017] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-02T18:45:25.229568] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T18:45:25.231176] [INFO ] [REMOTE ] EPAC: Full fetch complete (39102 records). [2025-10-02T18:45:25.231254] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-02T18:45:25.637292] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-02T18:45:25.637376] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-02T18:45:25.637989] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-02T18:45:25.638083] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-02T18:45:25.639114] [DEBUG] [LOCAL ] EPAC: Trimmed 39102 records to 27163 (keeping 200 days of data) [2025-10-02T18:45:25.803789] [DEBUG] [LOCAL ] EPAC: Primary data saved (27163 records). [2025-10-02T18:45:25.803931] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-02T18:45:25.804019] [INFO ] [MAIN ] Update Progress: 751/2370 symbols completed. EPAC took 34.9s. Estimated remaining: 3h 47m 9s. Rate: 7.1 symbols/min [2025-10-02T18:45:25.878186] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-02T18:45:26.000831] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:26.050136] [DEBUG] [LOCAL ] EPR: Loaded 43923 existing records from primary storage. [2025-10-02T18:45:26.050465] [INFO ] [MAIN ] EPR: Loaded 43923 existing records. [2025-10-02T18:45:26.261298] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:45:26.261547] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-02T18:45:26.261621] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-02T18:45:26.263102] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-10-02T18:45:26.263204] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-02T18:45:26.692314] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-02T18:45:26.696272] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:26.751107] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T18:45:27.473038] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-02T18:45:27.761468] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T18:45:28.278140] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-02T18:45:28.295504] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T18:45:28.867172] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T18:45:29.073026] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-10-02T18:45:29.872983] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-02T18:45:30.212193] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-02T18:45:30.683706] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-02T18:45:30.692989] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T18:45:31.473034] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-02T18:45:31.528836] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T18:45:31.884743] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T18:45:32.273017] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-02T18:45:33.073036] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-02T18:45:33.422773] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-02T18:45:33.424279] [INFO ] [REMOTE ] EPC: Full fetch complete (56645 records). [2025-10-02T18:45:33.424407] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-02T18:45:33.425259] [FATAL] [VALIDATOR ] EPC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T18:45:33.425355] [FATAL] [MAIN ] EPC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:45:33.425401] [WARN ] [MAIN ] EPC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:45:33.425444] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-02T18:45:33.425503] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-02T18:45:33.425540] [INFO ] [LOCAL ] EPC: Starting deletion of derivative data. [2025-10-02T18:45:33.425999] [DEBUG] [LOCAL ] EPC: Deleted derivative data file. [2025-10-02T18:45:33.426418] [INFO ] [MAIN ] Update Progress: 752/2370 symbols completed. EPC took 32.4s. Estimated remaining: 3h 46m 59s. Rate: 7.1 symbols/min [2025-10-02T18:45:33.620099] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:33.653853] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-10-02T18:45:33.709074] [DEBUG] [LOCAL ] EPRT: Loaded 48479 existing records from primary storage. [2025-10-02T18:45:33.709432] [INFO ] [MAIN ] EPRT: Loaded 48479 existing records. [2025-10-02T18:45:33.879204] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-02T18:45:33.915686] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:45:33.915906] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-02T18:45:33.915956] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-02T18:45:33.917379] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-02T18:45:33.917449] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-02T18:45:34.329280] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:34.377364] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T18:45:34.379268] [INFO ] [REMOTE ] EPAM: Full fetch complete (56132 records). [2025-10-02T18:45:34.379391] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-02T18:45:34.682633] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-10-02T18:45:34.829462] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-02T18:45:34.829555] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-02T18:45:34.830401] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-02T18:45:34.830473] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-02T18:45:34.831860] [DEBUG] [LOCAL ] EPAM: Trimmed 56132 records to 40032 (keeping 200 days of data) [2025-10-02T18:45:35.093172] [DEBUG] [LOCAL ] EPAM: Primary data saved (40032 records). [2025-10-02T18:45:35.093340] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-02T18:45:35.093467] [INFO ] [MAIN ] Update Progress: 753/2370 symbols completed. EPAM took 36.7s. Estimated remaining: 3h 46m 36s. Rate: 7.1 symbols/min [2025-10-02T18:45:35.274775] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:35.274983] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-10-02T18:45:35.275025] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-10-02T18:45:35.275169] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-02T18:45:35.275262] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-02T18:45:35.275334] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-02T18:45:35.275383] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-02T18:45:35.481504] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-02T18:45:35.691186] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:35.725676] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T18:45:36.074184] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T18:45:36.272998] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-10-02T18:45:37.073095] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-02T18:45:37.073013] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T18:45:37.122617] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T18:45:37.873007] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-02T18:45:38.349510] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T18:45:38.673000] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-02T18:45:39.450698] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T18:45:39.467298] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-02T18:45:39.472952] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-02T18:45:40.041491] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T18:45:40.272997] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-02T18:45:41.072990] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-02T18:45:41.781236] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T18:45:41.873006] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-02T18:45:42.645580] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T18:45:42.672984] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-02T18:45:43.472981] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-02T18:45:43.591726] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T18:45:43.940830] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-02T18:45:44.218509] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T18:45:44.272979] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-02T18:45:45.072995] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-02T18:45:45.848625] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T18:45:45.873014] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-02T18:45:46.607607] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T18:45:46.672970] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-02T18:45:47.472973] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-02T18:45:47.549929] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T18:45:47.552789] [INFO ] [REMOTE ] EPD: Full fetch complete (77641 records). [2025-10-02T18:45:47.552968] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-02T18:45:48.035487] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-02T18:45:48.035578] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-02T18:45:48.036494] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-02T18:45:48.036617] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-02T18:45:48.038279] [DEBUG] [LOCAL ] EPD: Trimmed 77641 records to 53999 (keeping 200 days of data) [2025-10-02T18:45:48.273025] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-02T18:45:48.380290] [DEBUG] [LOCAL ] EPD: Primary data saved (53999 records). [2025-10-02T18:45:48.380537] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-02T18:45:48.380682] [INFO ] [MAIN ] Update Progress: 754/2370 symbols completed. EPD took 40.8s. Estimated remaining: 3h 46m 38s. Rate: 7.1 symbols/min [2025-10-02T18:45:48.529068] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T18:45:48.616022] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:48.667884] [DEBUG] [LOCAL ] EQH: Loaded 52653 existing records from primary storage. [2025-10-02T18:45:48.668255] [INFO ] [MAIN ] EQH: Loaded 52653 existing records. [2025-10-02T18:45:48.867104] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:45:48.867337] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-02T18:45:48.867387] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-02T18:45:48.868976] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-02T18:45:48.869040] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-02T18:45:49.081034] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-02T18:45:49.276218] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:49.287338] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T18:45:49.318558] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T18:45:49.872994] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-02T18:45:50.672956] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-02T18:45:50.871943] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T18:45:51.392289] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T18:45:51.453618] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T18:45:51.472960] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-02T18:45:52.272993] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-02T18:45:53.072982] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-10-02T18:45:53.248588] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T18:45:53.606122] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T18:45:53.872993] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-02T18:45:54.672993] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-02T18:45:54.808336] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:45:55.430309] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T18:45:55.464997] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-02T18:45:55.472976] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-02T18:45:56.273002] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-02T18:45:56.472792] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T18:45:57.073019] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-02T18:45:57.878176] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-02T18:45:57.902619] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T18:45:57.923080] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T18:45:58.673011] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-02T18:45:58.786408] [DEBUG] [REMOTE ] EQBK: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-10-02T18:45:58.786804] [WARN ] [REMOTE ] EQBK: No data returned for month 2025-09 [2025-10-02T18:45:58.786924] [FATAL] [REMOTE ] EQBK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:45:58.787008] [FATAL] [MAIN ] EQBK: Failed to fetch primary data. [2025-10-02T18:45:58.787070] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:45:58.787144] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-02T18:45:58.787211] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-02T18:45:58.787259] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-10-02T18:45:58.787308] [DEBUG] [LOCAL ] EQBK: No derivative data file found to delete. [2025-10-02T18:45:58.787356] [INFO ] [MAIN ] Update Progress: 755/2370 symbols completed. EQBK took 23.7s. Estimated remaining: 3h 46m 34s. Rate: 7.1 symbols/min [2025-10-02T18:45:58.973176] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:45:59.026878] [DEBUG] [LOCAL ] EQNR: Loaded 53033 existing records from primary storage. [2025-10-02T18:45:59.027223] [INFO ] [MAIN ] EQNR: Loaded 53033 existing records. [2025-10-02T18:45:59.215597] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:45:59.215825] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-02T18:45:59.215873] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-02T18:45:59.217404] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-02T18:45:59.217468] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-02T18:45:59.473717] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-02T18:45:59.612576] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:45:59.726320] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T18:46:00.273004] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-02T18:46:01.073080] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-02T18:46:01.260065] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T18:46:01.399761] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T18:46:01.402473] [INFO ] [REMOTE ] EPR: Full fetch complete (62982 records). [2025-10-02T18:46:01.402787] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-02T18:46:01.879220] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-02T18:46:01.930121] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-02T18:46:01.930214] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-02T18:46:01.931130] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-02T18:46:01.931195] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-02T18:46:01.932626] [DEBUG] [LOCAL ] EPR: Trimmed 62982 records to 44243 (keeping 200 days of data) [2025-10-02T18:46:02.219246] [DEBUG] [LOCAL ] EPR: Primary data saved (44243 records). [2025-10-02T18:46:02.219388] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-02T18:46:02.219507] [INFO ] [MAIN ] Update Progress: 756/2370 symbols completed. EPR took 36.4s. Estimated remaining: 3h 46m 15s. Rate: 7.1 symbols/min [2025-10-02T18:46:02.422393] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T18:46:02.429398] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:02.432720] [INFO ] [REMOTE ] EPRT: Full fetch complete (68785 records). [2025-10-02T18:46:02.433042] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-02T18:46:02.709851] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-10-02T18:46:02.873746] [DEBUG] [LOCAL ] EQR: Loaded 51509 existing records from primary storage. [2025-10-02T18:46:02.874392] [INFO ] [MAIN ] EQR: Loaded 51509 existing records. [2025-10-02T18:46:03.092587] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-02T18:46:03.103034] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-02T18:46:03.114395] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-02T18:46:03.129997] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-02T18:46:03.174699] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:46:03.175297] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-02T18:46:03.175415] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-02T18:46:03.175554] [DEBUG] [LOCAL ] EPRT: Trimmed 68785 records to 48821 (keeping 200 days of data) [2025-10-02T18:46:03.176847] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-02T18:46:03.176927] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-02T18:46:03.815696] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:03.816889] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-10-02T18:46:03.867108] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-02T18:46:03.952283] [DEBUG] [LOCAL ] EPRT: Primary data saved (48821 records). [2025-10-02T18:46:03.952436] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-02T18:46:03.952997] [INFO ] [MAIN ] Update Progress: 757/2370 symbols completed. EPRT took 30.5s. Estimated remaining: 3h 45m 52s. Rate: 7.1 symbols/min [2025-10-02T18:46:04.273013] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-02T18:46:04.655942] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-02T18:46:05.073016] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-02T18:46:05.183935] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T18:46:05.873007] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-02T18:46:06.003590] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:46:06.672972] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-02T18:46:07.001815] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T18:46:07.102736] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T18:46:07.472994] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-02T18:46:08.273030] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-02T18:46:08.551621] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T18:46:09.073013] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-02T18:46:09.119553] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T18:46:09.872970] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-02T18:46:09.961313] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T18:46:10.475902] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T18:46:10.673029] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-02T18:46:11.473056] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-02T18:46:11.721803] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-02T18:46:12.273000] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-02T18:46:12.344110] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T18:46:13.079152] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-02T18:46:13.099780] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T18:46:13.872989] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-02T18:46:14.065318] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T18:46:14.673075] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-02T18:46:15.049044] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T18:46:15.473023] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-02T18:46:15.671333] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T18:46:15.976688] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T18:46:16.273003] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-02T18:46:17.073043] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-02T18:46:17.450694] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T18:46:17.608364] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:46:17.873000] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-02T18:46:18.672986] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-02T18:46:18.765682] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:46:19.473000] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-02T18:46:19.607689] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T18:46:20.272995] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-02T18:46:20.489522] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T18:46:20.879773] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-02T18:46:21.073071] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-02T18:46:21.872975] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-02T18:46:22.050689] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T18:46:22.673028] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-02T18:46:22.831665] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T18:46:23.133764] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T18:46:23.136093] [INFO ] [REMOTE ] EQH: Full fetch complete (76370 records). [2025-10-02T18:46:23.136212] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-02T18:46:23.477740] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-02T18:46:23.599669] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-02T18:46:23.599786] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-02T18:46:23.601250] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-02T18:46:23.601332] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-02T18:46:23.603473] [DEBUG] [LOCAL ] EQH: Trimmed 76370 records to 53042 (keeping 200 days of data) [2025-10-02T18:46:23.954348] [DEBUG] [LOCAL ] EQH: Primary data saved (53042 records). [2025-10-02T18:46:23.954520] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-02T18:46:23.954697] [INFO ] [MAIN ] Update Progress: 758/2370 symbols completed. EQH took 35.6s. Estimated remaining: 3h 46m 8s. Rate: 7.1 symbols/min [2025-10-02T18:46:24.661238] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-02T18:46:24.673102] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-02T18:46:25.109306] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T18:46:25.121434] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-02T18:46:26.377775] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T18:46:26.389891] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-02T18:46:26.484873] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T18:46:26.487085] [INFO ] [REMOTE ] EQR: Full fetch complete (73993 records). [2025-10-02T18:46:26.487193] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-02T18:46:26.914352] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-10-02T18:46:26.914440] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-10-02T18:46:26.915318] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-10-02T18:46:26.915390] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-10-02T18:46:26.916864] [DEBUG] [LOCAL ] EQR: Trimmed 73993 records to 51894 (keeping 200 days of data) [2025-10-02T18:46:27.254339] [DEBUG] [LOCAL ] EQR: Primary data saved (51894 records). [2025-10-02T18:46:27.254538] [INFO ] [MAIN ] EQR: Full history saved. [2025-10-02T18:46:27.254701] [INFO ] [MAIN ] Update Progress: 759/2370 symbols completed. EQR took 25.0s. Estimated remaining: 3h 45m 49s. Rate: 7.1 symbols/min [2025-10-02T18:46:27.815048] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T18:46:27.817760] [INFO ] [REMOTE ] EQNR: Full fetch complete (76811 records). [2025-10-02T18:46:27.817915] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-02T18:46:28.248007] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-02T18:46:28.248227] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-02T18:46:28.249163] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-02T18:46:28.249229] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-02T18:46:28.250989] [DEBUG] [LOCAL ] EQNR: Trimmed 76811 records to 53416 (keeping 200 days of data) [2025-10-02T18:46:28.593582] [DEBUG] [LOCAL ] EQNR: Primary data saved (53416 records). [2025-10-02T18:46:28.593772] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-02T18:46:28.593904] [INFO ] [MAIN ] Update Progress: 760/2370 symbols completed. EQNR took 29.8s. Estimated remaining: 3h 45m 26s. Rate: 7.1 symbols/min [2025-10-02T18:46:29.226484] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:29.344710] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:29.345612] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:29.345801] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-02T18:46:29.355632] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-02T18:46:29.373636] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-02T18:46:29.373801] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-02T18:46:29.374033] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-02T18:46:29.374097] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-02T18:46:29.383397] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:29.459927] [DEBUG] [LOCAL ] EQV: Loaded 2736 existing records from primary storage. [2025-10-02T18:46:29.482960] [INFO ] [MAIN ] EQV: Loaded 2736 existing records. [2025-10-02T18:46:29.839480] [DEBUG] [LOCAL ] ERJ: Loaded 50627 existing records from primary storage. [2025-10-02T18:46:29.939302] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:46:29.934958] [INFO ] [MAIN ] ERJ: Loaded 50627 existing records. [2025-10-02T18:46:29.990797] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-02T18:46:30.023917] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-02T18:46:30.030103] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-10-02T18:46:30.081782] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-02T18:46:30.091257] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-10-02T18:46:30.141360] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-02T18:46:30.369532] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:30.395610] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-10-02T18:46:30.574089] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:46:30.606441] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-02T18:46:30.642304] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-02T18:46:30.691811] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-02T18:46:30.692064] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-02T18:46:30.691735] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:46:30.725104] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-02T18:46:30.800025] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-02T18:46:30.891534] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-02T18:46:30.952591] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-02T18:46:31.293022] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:31.330011] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T18:46:31.309590] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-10-02T18:46:31.367848] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-02T18:46:31.722543] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:31.736828] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-10-02T18:46:31.828264] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:31.828634] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-10-02T18:46:31.885328] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T18:46:31.886492] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-02T18:46:32.205835] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T18:46:32.207952] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-02T18:46:32.214967] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T18:46:32.273008] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-02T18:46:32.535738] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-02T18:46:32.970261] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T18:46:33.072960] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-02T18:46:33.272691] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T18:46:33.502682] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T18:46:33.569994] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-02T18:46:33.872995] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-02T18:46:34.673026] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-02T18:46:35.472989] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-02T18:46:35.820947] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-02T18:46:35.845212] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-02T18:46:35.949171] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T18:46:36.273006] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-02T18:46:36.775798] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-02T18:46:37.073003] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-02T18:46:37.873025] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-02T18:46:38.672989] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-02T18:46:39.015611] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-02T18:46:39.098414] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-02T18:46:39.214961] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T18:46:39.473015] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-02T18:46:40.273001] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-02T18:46:40.621700] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-02T18:46:41.030140] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T18:46:41.073011] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-02T18:46:41.631516] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T18:46:41.873011] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-02T18:46:42.384219] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T18:46:42.673011] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-02T18:46:43.473009] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-02T18:46:43.911290] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T18:46:44.273012] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-02T18:46:44.644894] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-10-02T18:46:44.952398] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-02T18:46:45.073032] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-02T18:46:45.872996] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-02T18:46:46.443928] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T18:46:46.672998] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-02T18:46:47.079984] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-02T18:46:47.198662] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T18:46:47.472976] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-02T18:46:48.273013] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-02T18:46:48.934543] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-02T18:46:49.072993] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-02T18:46:49.292493] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T18:46:49.547499] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T18:46:49.548343] [INFO ] [REMOTE ] EQS: Full fetch complete (2531 records). [2025-10-02T18:46:49.548461] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-02T18:46:49.755486] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-02T18:46:49.755806] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:46:49.755905] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:46:49.756015] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-02T18:46:49.756100] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-02T18:46:49.756149] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-02T18:46:49.756231] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-02T18:46:49.756344] [INFO ] [MAIN ] Update Progress: 761/2370 symbols completed. EQS took 21.2s. Estimated remaining: 3h 45m 44s. Rate: 7.1 symbols/min [2025-10-02T18:46:49.878099] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-02T18:46:49.949053] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:50.004779] [DEBUG] [LOCAL ] ERO: Loaded 41247 existing records from primary storage. [2025-10-02T18:46:50.005098] [INFO ] [MAIN ] ERO: Loaded 41247 existing records. [2025-10-02T18:46:50.201994] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:46:50.202239] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-02T18:46:50.202289] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-02T18:46:50.203305] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-02T18:46:50.203368] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-02T18:46:50.527324] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T18:46:50.618117] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:50.672994] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-02T18:46:50.995484] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-02T18:46:51.472989] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-02T18:46:52.273057] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-02T18:46:53.073075] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-02T18:46:53.443978] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T18:46:53.526970] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T18:46:53.527880] [INFO ] [REMOTE ] EQV: Full fetch complete (5783 records). [2025-10-02T18:46:53.527968] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-02T18:46:53.876799] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-02T18:46:54.107293] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-02T18:46:54.107550] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-02T18:46:54.107956] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-02T18:46:54.108200] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-02T18:46:54.109035] [DEBUG] [LOCAL ] EQV: Trimmed 5783 records to 2747 (keeping 200 days of data) [2025-10-02T18:46:54.174019] [DEBUG] [LOCAL ] EQV: Primary data saved (2747 records). [2025-10-02T18:46:54.173147] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T18:46:54.185370] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-02T18:46:54.185774] [INFO ] [MAIN ] Update Progress: 762/2370 symbols completed. EQV took 25.6s. Estimated remaining: 3h 45m 27s. Rate: 7.1 symbols/min [2025-10-02T18:46:54.395776] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:46:54.465596] [DEBUG] [LOCAL ] ES: Loaded 52572 existing records from primary storage. [2025-10-02T18:46:54.465995] [INFO ] [MAIN ] ES: Loaded 52572 existing records. [2025-10-02T18:46:54.654740] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:46:54.654997] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-02T18:46:54.655053] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-02T18:46:54.656637] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-02T18:46:54.656739] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-02T18:46:54.679799] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-10-02T18:46:55.056745] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:46:55.472986] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-02T18:46:55.909677] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-10-02T18:46:56.186605] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T18:46:56.273040] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-10-02T18:46:56.825873] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T18:46:57.073058] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-02T18:46:57.872977] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-02T18:46:58.074129] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T18:46:58.538359] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T18:46:58.673018] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-02T18:46:59.472999] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-02T18:46:59.826603] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T18:47:00.272974] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-02T18:47:00.681465] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T18:47:00.900032] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:47:01.073044] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-02T18:47:01.873001] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-02T18:47:02.672994] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-02T18:47:02.764916] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-10-02T18:47:02.981303] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T18:47:03.275038] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T18:47:03.473060] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-02T18:47:04.247072] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T18:47:04.272969] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-02T18:47:04.592409] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T18:47:05.073054] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-02T18:47:05.872978] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-02T18:47:06.012664] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T18:47:06.570781] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T18:47:06.673000] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-02T18:47:07.472968] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-02T18:47:08.017339] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T18:47:08.019721] [INFO ] [REMOTE ] ERJ: Full fetch complete (72387 records). [2025-10-02T18:47:08.019855] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-02T18:47:08.277791] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-02T18:47:08.276112] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-02T18:47:08.533996] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-02T18:47:08.534175] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-02T18:47:08.535464] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-02T18:47:08.535554] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-02T18:47:08.537690] [DEBUG] [LOCAL ] ERJ: Trimmed 72387 records to 51007 (keeping 200 days of data) [2025-10-02T18:47:08.864038] [DEBUG] [LOCAL ] ERJ: Primary data saved (51007 records). [2025-10-02T18:47:08.864330] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-02T18:47:08.864562] [INFO ] [MAIN ] Update Progress: 763/2370 symbols completed. ERJ took 40.2s. Estimated remaining: 3h 45m 32s. Rate: 7.1 symbols/min [2025-10-02T18:47:09.059114] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:47:09.074252] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-02T18:47:09.089117] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T18:47:09.122389] [DEBUG] [LOCAL ] ESAB: Loaded 26110 existing records from primary storage. [2025-10-02T18:47:09.122707] [INFO ] [MAIN ] ESAB: Loaded 26110 existing records. [2025-10-02T18:47:09.318104] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:47:09.318341] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-02T18:47:09.318392] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-02T18:47:09.319228] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-02T18:47:09.319289] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-02T18:47:09.706913] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:47:09.873010] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-02T18:47:10.022406] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-02T18:47:10.025516] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-10-02T18:47:10.025728] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-02T18:47:10.470252] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-10-02T18:47:10.470442] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-10-02T18:47:10.471804] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-10-02T18:47:10.471899] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-10-02T18:47:10.474508] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 54072 (keeping 200 days of data) [2025-10-02T18:47:10.668757] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T18:47:10.683809] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-10-02T18:47:10.923586] [DEBUG] [LOCAL ] EQT: Primary data saved (54072 records). [2025-10-02T18:47:10.923787] [INFO ] [MAIN ] EQT: Full history saved. [2025-10-02T18:47:10.923876] [INFO ] [MAIN ] Update Progress: 764/2370 symbols completed. EQT took 42.3s. Estimated remaining: 3h 45m 10s. Rate: 7.1 symbols/min [2025-10-02T18:47:11.112700] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:47:11.137815] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T18:47:11.161311] [DEBUG] [LOCAL ] ESE: Loaded 16706 existing records from primary storage. [2025-10-02T18:47:11.161582] [INFO ] [MAIN ] ESE: Loaded 16706 existing records. [2025-10-02T18:47:11.361277] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:47:11.361527] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-02T18:47:11.361586] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-02T18:47:11.362255] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-02T18:47:11.362317] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-02T18:47:11.480946] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-02T18:47:11.785372] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:47:11.800542] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T18:47:12.272946] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-02T18:47:13.011612] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T18:47:13.073062] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-10-02T18:47:13.872996] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-02T18:47:13.896304] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T18:47:14.113831] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T18:47:14.673052] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-02T18:47:15.309072] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:47:15.473044] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-02T18:47:15.607766] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T18:47:16.272996] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-02T18:47:16.497251] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T18:47:17.073008] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-02T18:47:17.775238] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T18:47:17.873054] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-02T18:47:18.041227] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T18:47:18.673003] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-02T18:47:19.024881] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T18:47:19.472994] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-02T18:47:20.278560] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-02T18:47:20.297721] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T18:47:21.073019] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-02T18:47:21.183016] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T18:47:21.522269] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-02T18:47:21.873044] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-02T18:47:22.561310] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T18:47:22.563173] [INFO ] [REMOTE ] ERO: Full fetch complete (59573 records). [2025-10-02T18:47:22.563268] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-02T18:47:22.676674] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-02T18:47:23.010499] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-02T18:47:23.011836] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-02T18:47:23.011182] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-02T18:47:23.012829] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-02T18:47:23.017606] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-02T18:47:23.019000] [DEBUG] [LOCAL ] ERO: Trimmed 59573 records to 41598 (keeping 200 days of data) [2025-10-02T18:47:23.287669] [DEBUG] [LOCAL ] ERO: Primary data saved (41598 records). [2025-10-02T18:47:23.287848] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-02T18:47:23.288683] [INFO ] [MAIN ] Update Progress: 765/2370 symbols completed. ERO took 33.5s. Estimated remaining: 3h 45m 10s. Rate: 7.1 symbols/min [2025-10-02T18:47:23.479579] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-02T18:47:23.484315] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:47:23.543819] [DEBUG] [LOCAL ] ESI: Loaded 50725 existing records from primary storage. [2025-10-02T18:47:23.544158] [INFO ] [MAIN ] ESI: Loaded 50725 existing records. [2025-10-02T18:47:23.750959] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:47:23.751252] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-02T18:47:23.751343] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-02T18:47:23.770404] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T18:47:23.776128] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-02T18:47:23.776462] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-02T18:47:24.168873] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:47:24.273066] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-10-02T18:47:25.033921] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T18:47:25.072986] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-02T18:47:25.877612] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-02T18:47:25.889796] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T18:47:26.445877] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:47:26.672998] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-02T18:47:27.101188] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T18:47:27.473007] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-02T18:47:28.272984] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-02T18:47:28.436448] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T18:47:28.467146] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-02T18:47:29.072997] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-02T18:47:29.345332] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T18:47:29.873012] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-02T18:47:30.577811] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:47:30.582482] [INFO ] [REMOTE ] ES: Full fetch complete (76198 records). [2025-10-02T18:47:30.582711] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-02T18:47:30.678204] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-02T18:47:31.054824] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T18:47:31.055108] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-02T18:47:31.059298] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-02T18:47:31.060465] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-02T18:47:31.060555] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-02T18:47:31.062127] [DEBUG] [LOCAL ] ES: Trimmed 76198 records to 52959 (keeping 200 days of data) [2025-10-02T18:47:31.415764] [DEBUG] [LOCAL ] ES: Primary data saved (52959 records). [2025-10-02T18:47:31.415908] [INFO ] [MAIN ] ES: Full history saved. [2025-10-02T18:47:31.415990] [INFO ] [MAIN ] Update Progress: 766/2370 symbols completed. ES took 37.2s. Estimated remaining: 3h 45m 1s. Rate: 7.1 symbols/min [2025-10-02T18:47:31.485437] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-02T18:47:31.609125] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:47:31.646864] [DEBUG] [LOCAL ] ESNT: Loaded 38358 existing records from primary storage. [2025-10-02T18:47:31.647205] [INFO ] [MAIN ] ESNT: Loaded 38358 existing records. [2025-10-02T18:47:31.847563] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:47:31.848129] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-02T18:47:31.848188] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-02T18:47:31.849526] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-02T18:47:31.849589] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-02T18:47:32.244293] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:47:32.276530] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-10-02T18:47:32.284450] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T18:47:32.617031] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T18:47:33.072994] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-02T18:47:33.440386] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T18:47:33.873050] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-02T18:47:34.620891] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T18:47:34.672989] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-02T18:47:34.769419] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-02T18:47:35.473045] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-02T18:47:35.652875] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T18:47:36.273015] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-02T18:47:37.072992] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-02T18:47:37.189935] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T18:47:37.625357] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:47:37.873008] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-02T18:47:38.445353] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T18:47:38.673013] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-02T18:47:39.340924] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T18:47:39.473014] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-02T18:47:39.736138] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T18:47:40.273048] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-02T18:47:40.511771] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T18:47:41.072995] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-02T18:47:41.664151] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:47:41.872994] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-02T18:47:42.148760] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T18:47:42.150582] [INFO ] [REMOTE ] ESAB: Full fetch complete (35792 records). [2025-10-02T18:47:42.150777] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-02T18:47:42.562158] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-02T18:47:42.562267] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-02T18:47:42.562975] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-02T18:47:42.563039] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-02T18:47:42.563955] [DEBUG] [LOCAL ] ESAB: Trimmed 35792 records to 26272 (keeping 200 days of data) [2025-10-02T18:47:42.673246] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-02T18:47:42.735059] [DEBUG] [LOCAL ] ESAB: Primary data saved (26272 records). [2025-10-02T18:47:42.735324] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-02T18:47:42.735479] [INFO ] [MAIN ] Update Progress: 767/2370 symbols completed. ESAB took 33.9s. Estimated remaining: 3h 44m 59s. Rate: 7.1 symbols/min [2025-10-02T18:47:42.929203] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:47:42.943882] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T18:47:42.990882] [DEBUG] [LOCAL ] ESRT: Loaded 46454 existing records from primary storage. [2025-10-02T18:47:42.991200] [INFO ] [MAIN ] ESRT: Loaded 46454 existing records. [2025-10-02T18:47:43.185920] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:47:43.186191] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-02T18:47:43.186243] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-02T18:47:43.187566] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-02T18:47:43.187632] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-02T18:47:43.481386] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-02T18:47:43.581001] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:47:44.272995] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-10-02T18:47:44.354687] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T18:47:45.021168] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T18:47:45.072965] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-02T18:47:45.872994] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-02T18:47:46.054138] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T18:47:46.678844] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-02T18:47:46.692872] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T18:47:47.464975] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T18:47:47.475177] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-02T18:47:47.537204] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T18:47:47.538532] [INFO ] [REMOTE ] ESE: Full fetch complete (22397 records). [2025-10-02T18:47:47.538632] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-02T18:47:47.958066] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-02T18:47:47.958157] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-02T18:47:47.958709] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-02T18:47:47.958774] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-02T18:47:47.959448] [DEBUG] [LOCAL ] ESE: Trimmed 22397 records to 16803 (keeping 200 days of data) [2025-10-02T18:47:48.067711] [DEBUG] [LOCAL ] ESE: Primary data saved (16803 records). [2025-10-02T18:47:48.067859] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-02T18:47:48.067948] [INFO ] [MAIN ] Update Progress: 768/2370 symbols completed. ESE took 37.1s. Estimated remaining: 3h 44m 44s. Rate: 7.1 symbols/min [2025-10-02T18:47:48.247447] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:47:48.278144] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-02T18:47:48.280684] [DEBUG] [LOCAL ] ESS: Loaded 29988 existing records from primary storage. [2025-10-02T18:47:48.280972] [INFO ] [MAIN ] ESS: Loaded 29988 existing records. [2025-10-02T18:47:48.482841] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:47:48.483055] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-02T18:47:48.483149] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-02T18:47:48.484210] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-02T18:47:48.484274] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-02T18:47:48.895846] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T18:47:48.902523] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:47:49.073005] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-02T18:47:49.872991] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-02T18:47:50.077294] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-02T18:47:50.418312] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T18:47:50.673000] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-02T18:47:51.083124] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T18:47:51.472994] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-10-02T18:47:52.273861] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T18:47:52.273965] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-02T18:47:52.464125] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-10-02T18:47:53.073012] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-02T18:47:53.793810] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T18:47:53.873002] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-02T18:47:54.673006] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-02T18:47:54.767033] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:47:54.941703] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T18:47:55.473017] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-02T18:47:56.267419] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T18:47:56.276303] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-02T18:47:56.799156] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T18:47:57.073047] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-02T18:47:57.610860] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T18:47:57.873004] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-02T18:47:58.673020] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-02T18:47:58.752449] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T18:47:58.955623] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T18:47:59.473041] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-02T18:47:59.949602] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T18:47:59.951401] [INFO ] [REMOTE ] ESNT: Full fetch complete (57120 records). [2025-10-02T18:47:59.951554] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-02T18:48:00.278122] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-02T18:48:00.386621] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-10-02T18:48:00.386742] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-10-02T18:48:00.387542] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-10-02T18:48:00.387591] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-10-02T18:48:00.388923] [DEBUG] [LOCAL ] ESNT: Trimmed 57120 records to 38632 (keeping 200 days of data) [2025-10-02T18:48:00.631384] [DEBUG] [LOCAL ] ESNT: Primary data saved (38632 records). [2025-10-02T18:48:00.631538] [INFO ] [MAIN ] ESNT: Full history saved. [2025-10-02T18:48:00.631626] [INFO ] [MAIN ] Update Progress: 769/2370 symbols completed. ESNT took 29.2s. Estimated remaining: 3h 44m 44s. Rate: 7.1 symbols/min [2025-10-02T18:48:00.818069] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:00.865577] [DEBUG] [LOCAL ] ESTC: Loaded 49968 existing records from primary storage. [2025-10-02T18:48:00.865941] [INFO ] [MAIN ] ESTC: Loaded 49968 existing records. [2025-10-02T18:48:01.079628] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:01.080318] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-02T18:48:01.080005] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-02T18:48:01.080787] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-02T18:48:01.082259] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-02T18:48:01.082383] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-02T18:48:01.406890] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T18:48:01.531463] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:01.872999] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-02T18:48:02.048239] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T18:48:02.669755] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T18:48:02.680922] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-02T18:48:03.171429] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T18:48:03.473069] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-02T18:48:04.254188] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-02T18:48:04.272974] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-02T18:48:04.658684] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:48:05.073028] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-02T18:48:05.668007] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T18:48:05.670091] [INFO ] [REMOTE ] ESI: Full fetch complete (72659 records). [2025-10-02T18:48:05.670220] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-02T18:48:05.876856] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-10-02T18:48:06.141320] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-02T18:48:06.141423] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-02T18:48:06.142406] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-02T18:48:06.142473] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-02T18:48:06.144138] [DEBUG] [LOCAL ] ESI: Trimmed 72659 records to 51102 (keeping 200 days of data) [2025-10-02T18:48:06.410034] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:48:06.520350] [DEBUG] [LOCAL ] ESI: Primary data saved (51102 records). [2025-10-02T18:48:06.520535] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-02T18:48:06.521519] [INFO ] [MAIN ] Update Progress: 770/2370 symbols completed. ESI took 43.2s. Estimated remaining: 3h 44m 31s. Rate: 7.1 symbols/min [2025-10-02T18:48:06.685172] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-02T18:48:06.725541] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:06.783233] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-02T18:48:06.783623] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-02T18:48:07.005480] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:07.005717] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-02T18:48:07.005779] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-02T18:48:07.007257] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-02T18:48:07.007325] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-02T18:48:07.479623] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:07.475600] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-02T18:48:07.749401] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T18:48:08.273052] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-02T18:48:08.511287] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T18:48:08.863483] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T18:48:09.072976] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-02T18:48:09.635590] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T18:48:09.873001] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-10-02T18:48:10.581551] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T18:48:10.673052] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-02T18:48:11.473046] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-02T18:48:12.211578] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T18:48:12.224047] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-02T18:48:12.273001] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-02T18:48:13.073018] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-02T18:48:13.106449] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T18:48:13.872997] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-02T18:48:14.318794] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T18:48:14.476315] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-10-02T18:48:14.673008] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-02T18:48:14.946754] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:48:14.948878] [INFO ] [REMOTE ] ESRT: Full fetch complete (66558 records). [2025-10-02T18:48:14.948997] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-02T18:48:15.370934] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-02T18:48:15.371047] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-02T18:48:15.371979] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-02T18:48:15.372053] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-02T18:48:15.373678] [DEBUG] [LOCAL ] ESRT: Trimmed 66558 records to 46767 (keeping 200 days of data) [2025-10-02T18:48:15.473685] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-02T18:48:15.660585] [DEBUG] [LOCAL ] ESRT: Primary data saved (46767 records). [2025-10-02T18:48:15.660776] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-02T18:48:15.660881] [INFO ] [MAIN ] Update Progress: 771/2370 symbols completed. ESRT took 32.9s. Estimated remaining: 3h 44m 24s. Rate: 7.1 symbols/min [2025-10-02T18:48:15.854936] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:15.859030] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T18:48:15.860922] [INFO ] [REMOTE ] ESS: Full fetch complete (43462 records). [2025-10-02T18:48:15.861012] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-02T18:48:15.994230] [DEBUG] [LOCAL ] ETB: Loaded 12077 existing records from primary storage. [2025-10-02T18:48:16.010806] [INFO ] [MAIN ] ETB: Loaded 12077 existing records. [2025-10-02T18:48:16.282415] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-02T18:48:16.472775] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:16.504170] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-02T18:48:16.511825] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-02T18:48:16.538094] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-02T18:48:16.549834] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-02T18:48:16.550017] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-02T18:48:16.550253] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-02T18:48:16.556294] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-02T18:48:16.561678] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-02T18:48:16.662186] [DEBUG] [LOCAL ] ESS: Trimmed 43462 records to 30187 (keeping 200 days of data) [2025-10-02T18:48:17.184329] [DEBUG] [LOCAL ] ESS: Primary data saved (30187 records). [2025-10-02T18:48:17.218547] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-02T18:48:17.227500] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:17.228342] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-10-02T18:48:17.228490] [INFO ] [MAIN ] Update Progress: 772/2370 symbols completed. ESS took 29.2s. Estimated remaining: 3h 44m 1s. Rate: 7.1 symbols/min [2025-10-02T18:48:17.451242] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-02T18:48:17.455409] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:17.494880] [DEBUG] [LOCAL ] ETD: Loaded 27426 existing records from primary storage. [2025-10-02T18:48:17.495220] [INFO ] [MAIN ] ETD: Loaded 27426 existing records. [2025-10-02T18:48:17.699382] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:17.699667] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-02T18:48:17.699735] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-02T18:48:17.700556] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-02T18:48:17.700618] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-02T18:48:17.883316] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-02T18:48:17.955575] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:48:18.147589] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:18.179988] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-10-02T18:48:18.673030] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-02T18:48:19.183196] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-02T18:48:19.472969] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-10-02T18:48:19.570602] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T18:48:20.272981] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-02T18:48:20.590092] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T18:48:20.861836] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T18:48:21.073042] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-02T18:48:21.873023] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-02T18:48:22.636530] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T18:48:22.672996] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-02T18:48:22.971475] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T18:48:23.473011] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-02T18:48:23.627807] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-02T18:48:24.273002] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-02T18:48:25.072963] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-02T18:48:25.266326] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T18:48:25.424567] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T18:48:25.872986] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-02T18:48:25.922685] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-02T18:48:26.673053] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-02T18:48:27.472997] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-02T18:48:27.580418] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T18:48:28.272974] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-02T18:48:28.343824] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T18:48:29.073015] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-02T18:48:29.107191] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-02T18:48:29.852505] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T18:48:29.872976] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-02T18:48:30.331024] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T18:48:30.673024] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-02T18:48:31.473014] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-02T18:48:32.068276] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-02T18:48:32.247097] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T18:48:32.272970] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-02T18:48:32.935688] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-10-02T18:48:32.955346] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-02T18:48:33.072995] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-02T18:48:33.872995] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-02T18:48:34.177260] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T18:48:34.673023] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-02T18:48:35.472994] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-02T18:48:36.056306] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-02T18:48:36.087701] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T18:48:36.273007] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-02T18:48:36.989267] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T18:48:37.073004] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-02T18:48:37.751453] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T18:48:37.873057] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-02T18:48:38.673002] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-02T18:48:38.697071] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T18:48:38.805814] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T18:48:39.211361] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-02T18:48:39.473000] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-02T18:48:40.273007] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-02T18:48:41.072972] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-02T18:48:41.416495] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:48:41.813558] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-10-02T18:48:41.873006] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-02T18:48:42.454362] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T18:48:42.456325] [INFO ] [REMOTE ] ESTC: Full fetch complete (72034 records). [2025-10-02T18:48:42.456429] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-02T18:48:42.674472] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-02T18:48:42.885333] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-02T18:48:42.885425] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-02T18:48:42.886295] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-02T18:48:42.886359] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-02T18:48:42.887826] [DEBUG] [LOCAL ] ESTC: Trimmed 72034 records to 50315 (keeping 200 days of data) [2025-10-02T18:48:43.184438] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T18:48:43.228440] [DEBUG] [LOCAL ] ESTC: Primary data saved (50315 records). [2025-10-02T18:48:43.228579] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-02T18:48:43.228695] [INFO ] [MAIN ] Update Progress: 773/2370 symbols completed. ESTC took 42.6s. Estimated remaining: 3h 44m 29s. Rate: 7.1 symbols/min [2025-10-02T18:48:43.415084] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:43.433320] [DEBUG] [LOCAL ] ETG: Loaded 16472 existing records from primary storage. [2025-10-02T18:48:43.433568] [INFO ] [MAIN ] ETG: Loaded 16472 existing records. [2025-10-02T18:48:43.481519] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-02T18:48:43.529042] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T18:48:43.555293] [INFO ] [REMOTE ] ETB: Full fetch complete (18156 records). [2025-10-02T18:48:43.571809] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-02T18:48:43.738385] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:43.764433] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-02T18:48:43.764566] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-02T18:48:43.770629] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-02T18:48:43.775875] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-02T18:48:44.299779] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-02T18:48:44.402491] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-02T18:48:44.407366] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-02T18:48:44.408220] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-02T18:48:44.419102] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-02T18:48:44.456812] [DEBUG] [LOCAL ] ETB: Trimmed 18156 records to 12219 (keeping 200 days of data) [2025-10-02T18:48:44.497638] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:44.579320] [DEBUG] [LOCAL ] ETB: Primary data saved (12219 records). [2025-10-02T18:48:44.579469] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-02T18:48:44.579554] [INFO ] [MAIN ] Update Progress: 774/2370 symbols completed. ETB took 28.9s. Estimated remaining: 3h 44m 6s. Rate: 7.1 symbols/min [2025-10-02T18:48:44.767721] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:44.785681] [DEBUG] [LOCAL ] ETJ: Loaded 16671 existing records from primary storage. [2025-10-02T18:48:44.785972] [INFO ] [MAIN ] ETJ: Loaded 16671 existing records. [2025-10-02T18:48:44.991153] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:44.991431] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-02T18:48:44.991493] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-02T18:48:44.992046] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-02T18:48:44.992109] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-02T18:48:45.082717] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-10-02T18:48:45.386418] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:45.791382] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T18:48:45.840685] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-10-02T18:48:45.863639] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T18:48:45.872962] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-02T18:48:46.672992] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-02T18:48:47.473018] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-02T18:48:48.018292] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:48:48.194025] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-10-02T18:48:48.273007] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-02T18:48:48.539377] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:48:48.540886] [INFO ] [REMOTE ] ETD: Full fetch complete (38493 records). [2025-10-02T18:48:48.541005] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-02T18:48:48.944698] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-02T18:48:48.944788] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-02T18:48:48.945611] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-02T18:48:48.946101] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-02T18:48:48.947135] [DEBUG] [LOCAL ] ETD: Trimmed 38493 records to 27624 (keeping 200 days of data) [2025-10-02T18:48:49.091801] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-10-02T18:48:49.121578] [DEBUG] [LOCAL ] ETD: Primary data saved (27624 records). [2025-10-02T18:48:49.121713] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-02T18:48:49.121806] [INFO ] [MAIN ] Update Progress: 775/2370 symbols completed. ETD took 31.9s. Estimated remaining: 3h 43m 50s. Rate: 7.1 symbols/min [2025-10-02T18:48:49.308616] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:49.330317] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T18:48:49.374453] [DEBUG] [LOCAL ] ETN: Loaded 52758 existing records from primary storage. [2025-10-02T18:48:49.374843] [INFO ] [MAIN ] ETN: Loaded 52758 existing records. [2025-10-02T18:48:49.569227] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:49.569464] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-02T18:48:49.569518] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-02T18:48:49.571010] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-02T18:48:49.571074] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-02T18:48:49.875197] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-02T18:48:49.891236] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T18:48:49.997207] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:50.673002] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-02T18:48:51.472994] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-10-02T18:48:51.675372] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T18:48:51.742103] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-02T18:48:51.744401] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-10-02T18:48:51.744561] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-02T18:48:52.177906] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-02T18:48:52.177999] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-02T18:48:52.179008] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-02T18:48:52.179125] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-02T18:48:52.180691] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 54179 (keeping 200 days of data) [2025-10-02T18:48:52.279560] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-02T18:48:52.543735] [DEBUG] [LOCAL ] ET: Primary data saved (54179 records). [2025-10-02T18:48:52.543924] [INFO ] [MAIN ] ET: Full history saved. [2025-10-02T18:48:52.545069] [INFO ] [MAIN ] Update Progress: 776/2370 symbols completed. ET took 46.0s. Estimated remaining: 3h 43m 31s. Rate: 7.1 symbols/min [2025-10-02T18:48:52.735034] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:48:52.745193] [DEBUG] [LOCAL ] ETO: Loaded 6515 existing records from primary storage. [2025-10-02T18:48:52.745426] [INFO ] [MAIN ] ETO: Loaded 6515 existing records. [2025-10-02T18:48:52.946103] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:48:52.946724] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-02T18:48:52.946789] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-02T18:48:52.947174] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-02T18:48:52.947235] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-02T18:48:53.061811] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T18:48:53.085158] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-02T18:48:53.399354] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:48:53.429849] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T18:48:53.873027] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-02T18:48:54.139109] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T18:48:54.672996] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-10-02T18:48:54.883164] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T18:48:55.319459] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T18:48:55.473065] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-02T18:48:56.273000] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-02T18:48:57.050184] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-02T18:48:57.072953] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-02T18:48:57.247996] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T18:48:57.873019] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-02T18:48:58.154912] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T18:48:58.673005] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-02T18:48:59.473031] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-02T18:48:59.667012] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T18:48:59.843358] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T18:48:59.899908] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T18:49:00.273035] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-02T18:49:00.445207] [DEBUG] [REMOTE ] ETG: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-02T18:49:00.445539] [WARN ] [REMOTE ] ETG: No data returned for month 2025-06 [2025-10-02T18:49:00.445633] [FATAL] [REMOTE ] ETG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:49:00.445809] [FATAL] [MAIN ] ETG: Failed to fetch primary data. [2025-10-02T18:49:00.445881] [WARN ] [MAIN ] ETG: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:49:00.445960] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-02T18:49:00.446034] [DEBUG] [LOCAL ] ETG: No primary data file found to delete. [2025-10-02T18:49:00.446077] [INFO ] [LOCAL ] ETG: Starting deletion of derivative data. [2025-10-02T18:49:00.446419] [DEBUG] [LOCAL ] ETG: Deleted derivative data file. [2025-10-02T18:49:00.446518] [INFO ] [MAIN ] Update Progress: 777/2370 symbols completed. ETG took 17.2s. Estimated remaining: 3h 43m 21s. Rate: 7.1 symbols/min [2025-10-02T18:49:00.623276] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:49:00.674447] [DEBUG] [LOCAL ] ETR: Loaded 53225 existing records from primary storage. [2025-10-02T18:49:00.674854] [INFO ] [MAIN ] ETR: Loaded 53225 existing records. [2025-10-02T18:49:00.870548] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:49:00.870801] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-02T18:49:00.870871] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-02T18:49:00.872661] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-02T18:49:00.872726] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-02T18:49:01.078537] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-02T18:49:01.262725] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:49:01.873054] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-02T18:49:02.673007] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-02T18:49:03.195154] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T18:49:03.242708] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-02T18:49:03.395728] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-02T18:49:03.473050] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-02T18:49:04.275139] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-10-02T18:49:04.279746] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T18:49:05.073062] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-02T18:49:05.761443] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T18:49:05.807681] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-02T18:49:05.873005] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-02T18:49:06.673018] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-02T18:49:07.473037] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-02T18:49:07.613056] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T18:49:07.961698] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T18:49:08.272985] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-02T18:49:08.317828] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T18:49:09.073034] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-02T18:49:09.873009] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-02T18:49:10.144153] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-10-02T18:49:10.673015] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-02T18:49:10.772703] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T18:49:11.089257] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T18:49:11.473005] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-02T18:49:12.273007] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-02T18:49:12.573130] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T18:49:12.987558] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T18:49:13.073019] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-02T18:49:13.648255] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-10-02T18:49:13.873001] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-02T18:49:14.672960] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-02T18:49:14.893772] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T18:49:14.953104] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T18:49:15.473075] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-02T18:49:16.272973] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-02T18:49:16.339506] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T18:49:16.454209] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T18:49:17.073005] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-02T18:49:17.732997] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T18:49:17.872954] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-02T18:49:17.985273] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T18:49:18.673022] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-02T18:49:19.472983] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-02T18:49:19.631960] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T18:49:20.272969] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-02T18:49:20.307384] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T18:49:20.471767] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T18:49:21.073041] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-02T18:49:21.873012] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-02T18:49:21.966901] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T18:49:22.673053] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-02T18:49:22.718048] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T18:49:22.719532] [INFO ] [REMOTE ] ETJ: Full fetch complete (25566 records). [2025-10-02T18:49:22.719629] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-02T18:49:23.221304] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-02T18:49:23.221525] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-02T18:49:23.222239] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-02T18:49:23.222347] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-02T18:49:23.223222] [DEBUG] [LOCAL ] ETJ: Trimmed 25566 records to 16912 (keeping 200 days of data) [2025-10-02T18:49:23.334478] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T18:49:23.372176] [DEBUG] [LOCAL ] ETJ: Primary data saved (16912 records). [2025-10-02T18:49:23.372754] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-02T18:49:23.372854] [INFO ] [MAIN ] Update Progress: 778/2370 symbols completed. ETJ took 38.8s. Estimated remaining: 3h 43m 43s. Rate: 7.1 symbols/min [2025-10-02T18:49:23.478469] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-02T18:49:23.571883] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:49:23.596849] [DEBUG] [LOCAL ] ETV: Loaded 21526 existing records from primary storage. [2025-10-02T18:49:23.597207] [INFO ] [MAIN ] ETV: Loaded 21526 existing records. [2025-10-02T18:49:23.810294] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:49:23.810849] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-02T18:49:23.810914] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-02T18:49:23.811728] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-02T18:49:23.811792] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-02T18:49:24.232454] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:49:24.273013] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-10-02T18:49:24.434266] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T18:49:24.436696] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T18:49:25.072995] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-02T18:49:25.170492] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T18:49:25.872999] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-02T18:49:26.525120] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T18:49:26.673028] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-02T18:49:27.137231] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T18:49:27.138242] [INFO ] [REMOTE ] ETO: Full fetch complete (9413 records). [2025-10-02T18:49:27.138318] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-02T18:49:27.478157] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-02T18:49:27.544397] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-02T18:49:27.544594] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-02T18:49:27.544902] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-02T18:49:27.545022] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-02T18:49:27.545487] [DEBUG] [LOCAL ] ETO: Trimmed 9413 records to 6595 (keeping 200 days of data) [2025-10-02T18:49:27.595086] [DEBUG] [LOCAL ] ETO: Primary data saved (6595 records). [2025-10-02T18:49:27.600681] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-02T18:49:27.601621] [INFO ] [MAIN ] Update Progress: 779/2370 symbols completed. ETO took 35.1s. Estimated remaining: 3h 43m 26s. Rate: 7.1 symbols/min [2025-10-02T18:49:27.601852] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-02T18:49:27.655152] [INFO ] [REMOTE ] ETN: Full fetch complete (76548 records). [2025-10-02T18:49:27.683290] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-02T18:49:27.943671] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:49:28.207865] [DEBUG] [LOCAL ] ETW: Loaded 25087 existing records from primary storage. [2025-10-02T18:49:28.232980] [INFO ] [MAIN ] ETW: Loaded 25087 existing records. [2025-10-02T18:49:28.278252] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-02T18:49:28.278133] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-02T18:49:28.293235] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-02T18:49:28.318364] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-02T18:49:28.354506] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-02T18:49:28.469222] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:49:28.469749] [DEBUG] [LOCAL ] ETN: Trimmed 76548 records to 53136 (keeping 200 days of data) [2025-10-02T18:49:28.470225] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-02T18:49:28.470908] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-02T18:49:28.472341] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-10-02T18:49:28.472412] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-02T18:49:28.885861] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T18:49:29.090335] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-02T18:49:29.226713] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:49:29.317269] [DEBUG] [LOCAL ] ETN: Primary data saved (53136 records). [2025-10-02T18:49:29.317469] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-02T18:49:29.317708] [INFO ] [MAIN ] Update Progress: 780/2370 symbols completed. ETN took 40.2s. Estimated remaining: 3h 43m 4s. Rate: 7.1 symbols/min [2025-10-02T18:49:29.506916] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:49:29.519708] [DEBUG] [LOCAL ] ETX: Loaded 5134 existing records from primary storage. [2025-10-02T18:49:29.519941] [INFO ] [MAIN ] ETX: Loaded 5134 existing records. [2025-10-02T18:49:29.721063] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:49:29.721301] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-02T18:49:29.721374] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-02T18:49:29.721836] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-10-02T18:49:29.721927] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-02T18:49:29.880589] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-10-02T18:49:30.143469] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:49:30.181330] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T18:49:30.232505] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T18:49:30.673022] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-02T18:49:30.986882] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T18:49:31.473045] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-10-02T18:49:31.907087] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T18:49:31.912096] [INFO ] [REMOTE ] ETR: Full fetch complete (77094 records). [2025-10-02T18:49:31.912279] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-02T18:49:32.048260] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-10-02T18:49:32.278161] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-02T18:49:32.375964] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-02T18:49:32.376080] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-02T18:49:32.377584] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-02T18:49:32.377697] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-02T18:49:32.385014] [DEBUG] [LOCAL ] ETR: Trimmed 77094 records to 53613 (keeping 200 days of data) [2025-10-02T18:49:32.755153] [DEBUG] [LOCAL ] ETR: Primary data saved (53613 records). [2025-10-02T18:49:32.755293] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-02T18:49:32.755399] [INFO ] [MAIN ] Update Progress: 781/2370 symbols completed. ETR took 32.3s. Estimated remaining: 3h 42m 45s. Rate: 7.1 symbols/min [2025-10-02T18:49:32.943928] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:49:32.969484] [DEBUG] [LOCAL ] ETY: Loaded 22753 existing records from primary storage. [2025-10-02T18:49:32.969779] [INFO ] [MAIN ] ETY: Loaded 22753 existing records. [2025-10-02T18:49:33.081619] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-02T18:49:33.170371] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:49:33.170707] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-02T18:49:33.170782] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-02T18:49:33.173476] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-10-02T18:49:33.173542] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-02T18:49:33.524837] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-02T18:49:33.606298] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:49:33.608504] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T18:49:33.873017] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-02T18:49:34.672981] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-10-02T18:49:35.068807] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T18:49:35.458766] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T18:49:35.472945] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-02T18:49:36.272993] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-02T18:49:36.460714] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T18:49:37.025143] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T18:49:37.072974] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-02T18:49:37.872996] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-02T18:49:38.219488] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T18:49:38.673001] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-02T18:49:39.035449] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T18:49:39.472969] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-02T18:49:39.539426] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T18:49:40.272988] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-02T18:49:40.294097] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T18:49:40.885488] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-02T18:49:41.072998] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-02T18:49:41.476480] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-02T18:49:41.873017] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-02T18:49:42.672974] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-02T18:49:43.011746] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:49:43.429682] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T18:49:43.472992] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-02T18:49:44.272998] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-02T18:49:44.727448] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T18:49:44.897156] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-02T18:49:45.073040] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-02T18:49:45.872998] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-02T18:49:46.129679] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T18:49:46.673041] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-02T18:49:47.010926] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T18:49:47.473068] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-02T18:49:47.749938] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T18:49:48.273005] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-02T18:49:48.517690] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-02T18:49:48.802210] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-02T18:49:49.073028] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-02T18:49:49.873016] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-02T18:49:50.255993] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T18:49:50.590508] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T18:49:50.673011] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-02T18:49:51.473021] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-02T18:49:51.637222] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:49:51.639207] [INFO ] [REMOTE ] ETV: Full fetch complete (32066 records). [2025-10-02T18:49:51.639289] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-02T18:49:52.071339] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-02T18:49:52.071410] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-02T18:49:52.072084] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-02T18:49:52.072148] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-02T18:49:52.074362] [DEBUG] [LOCAL ] ETV: Trimmed 32066 records to 21812 (keeping 200 days of data) [2025-10-02T18:49:52.222387] [DEBUG] [LOCAL ] ETV: Primary data saved (21812 records). [2025-10-02T18:49:52.222515] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-02T18:49:52.222624] [INFO ] [MAIN ] Update Progress: 782/2370 symbols completed. ETV took 28.8s. Estimated remaining: 3h 42m 59s. Rate: 7.1 symbols/min [2025-10-02T18:49:52.283261] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-02T18:49:52.416731] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:49:52.436383] [DEBUG] [LOCAL ] EVC: Loaded 18618 existing records from primary storage. [2025-10-02T18:49:52.436704] [INFO ] [MAIN ] EVC: Loaded 18618 existing records. [2025-10-02T18:49:52.659275] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:49:52.660701] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:49:52.660889] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-02T18:49:52.666121] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-02T18:49:52.666885] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-02T18:49:52.666962] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-02T18:49:53.007185] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T18:49:53.075764] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-02T18:49:53.100891] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:49:53.872972] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-02T18:49:54.197445] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T18:49:54.673030] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-10-02T18:49:55.151194] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-02T18:49:55.473030] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-02T18:49:56.206192] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T18:49:56.273005] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-02T18:49:56.524269] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T18:49:56.748790] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T18:49:57.073001] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-02T18:49:57.873022] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-10-02T18:49:58.053518] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T18:49:58.609307] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T18:49:58.673002] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-10-02T18:49:59.472976] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-02T18:49:59.816728] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:50:00.273026] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-02T18:50:00.929369] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T18:50:01.072997] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-10-02T18:50:01.159035] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T18:50:01.873060] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-02T18:50:02.168905] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T18:50:02.673053] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-02T18:50:02.832446] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:50:02.835564] [INFO ] [REMOTE ] ETW: Full fetch complete (36491 records). [2025-10-02T18:50:02.835682] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-02T18:50:03.254864] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-02T18:50:03.254965] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-02T18:50:03.255668] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-02T18:50:03.255738] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-02T18:50:03.256816] [DEBUG] [LOCAL ] ETW: Trimmed 36491 records to 25372 (keeping 200 days of data) [2025-10-02T18:50:03.431238] [DEBUG] [LOCAL ] ETW: Primary data saved (25372 records). [2025-10-02T18:50:03.431382] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-02T18:50:03.431470] [INFO ] [MAIN ] Update Progress: 783/2370 symbols completed. ETW took 35.8s. Estimated remaining: 3h 42m 56s. Rate: 7.1 symbols/min [2025-10-02T18:50:03.479488] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-02T18:50:03.660203] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:03.661584] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T18:50:03.703951] [DEBUG] [LOCAL ] EVEX: Loaded 30504 existing records from primary storage. [2025-10-02T18:50:03.704259] [INFO ] [MAIN ] EVEX: Loaded 30504 existing records. [2025-10-02T18:50:03.907425] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:03.907696] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-02T18:50:03.907796] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-02T18:50:03.908756] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-02T18:50:03.908816] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-02T18:50:04.270698] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T18:50:04.279451] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-02T18:50:04.283470] [INFO ] [REMOTE ] ETX: Full fetch complete (7086 records). [2025-10-02T18:50:04.302728] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-02T18:50:04.310715] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:04.726818] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-10-02T18:50:04.726898] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-10-02T18:50:04.727098] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-10-02T18:50:04.727139] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-10-02T18:50:04.727592] [DEBUG] [LOCAL ] ETX: Trimmed 7086 records to 5194 (keeping 200 days of data) [2025-10-02T18:50:04.761796] [DEBUG] [LOCAL ] ETX: Primary data saved (5194 records). [2025-10-02T18:50:04.761997] [INFO ] [MAIN ] ETX: Full history saved. [2025-10-02T18:50:04.762168] [INFO ] [MAIN ] Update Progress: 784/2370 symbols completed. ETX took 35.4s. Estimated remaining: 3h 42m 33s. Rate: 7.1 symbols/min [2025-10-02T18:50:04.953284] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:04.965086] [DEBUG] [LOCAL ] EVF: Loaded 9403 existing records from primary storage. [2025-10-02T18:50:04.965323] [INFO ] [MAIN ] EVF: Loaded 9403 existing records. [2025-10-02T18:50:05.073001] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-10-02T18:50:05.160701] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:05.160907] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-02T18:50:05.160956] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-02T18:50:05.161426] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-02T18:50:05.161489] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-02T18:50:05.561626] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:05.656480] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T18:50:05.873058] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-10-02T18:50:06.505269] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T18:50:06.672973] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-10-02T18:50:06.986050] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T18:50:07.183847] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-02T18:50:07.473031] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-02T18:50:08.153500] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T18:50:08.273057] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-02T18:50:08.990571] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T18:50:09.072999] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-02T18:50:09.872982] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-02T18:50:10.211570] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T18:50:10.673058] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-10-02T18:50:10.796278] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T18:50:11.392407] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T18:50:11.394409] [INFO ] [REMOTE ] ETY: Full fetch complete (34294 records). [2025-10-02T18:50:11.394739] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-10-02T18:50:11.478170] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-02T18:50:11.813028] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-10-02T18:50:11.813112] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-10-02T18:50:11.813773] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-10-02T18:50:11.813843] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-10-02T18:50:11.814821] [DEBUG] [LOCAL ] ETY: Trimmed 34294 records to 23009 (keeping 200 days of data) [2025-10-02T18:50:11.964595] [DEBUG] [LOCAL ] ETY: Primary data saved (23009 records). [2025-10-02T18:50:11.964824] [INFO ] [MAIN ] ETY: Full history saved. [2025-10-02T18:50:11.964926] [INFO ] [MAIN ] Update Progress: 785/2370 symbols completed. ETY took 39.2s. Estimated remaining: 3h 42m 23s. Rate: 7.1 symbols/min [2025-10-02T18:50:12.151380] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:12.159837] [DEBUG] [LOCAL ] EVG: Loaded 5952 existing records from primary storage. [2025-10-02T18:50:12.160070] [INFO ] [MAIN ] EVG: Loaded 5952 existing records. [2025-10-02T18:50:12.275920] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-02T18:50:12.373723] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:12.373996] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-02T18:50:12.374068] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-02T18:50:12.374430] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-02T18:50:12.374494] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-02T18:50:12.798024] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:12.960578] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:50:13.072984] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-02T18:50:13.392501] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T18:50:13.873007] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-10-02T18:50:14.048497] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T18:50:14.319356] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-02T18:50:14.673014] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-02T18:50:15.472976] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-02T18:50:15.567508] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-02T18:50:16.024827] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-02T18:50:16.273018] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-02T18:50:16.901981] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T18:50:17.073007] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-02T18:50:17.873017] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-02T18:50:18.031205] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T18:50:18.445120] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T18:50:18.673015] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-02T18:50:19.272697] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T18:50:19.472986] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-02T18:50:20.273053] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-02T18:50:20.657540] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T18:50:20.923935] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T18:50:21.073064] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-02T18:50:21.873003] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-02T18:50:21.895114] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T18:50:22.294438] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-02T18:50:22.673008] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-02T18:50:23.304451] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T18:50:23.473014] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-02T18:50:24.272974] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-02T18:50:24.364952] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T18:50:25.063536] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-02T18:50:25.072984] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-02T18:50:25.872969] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-02T18:50:26.029798] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-02T18:50:26.673013] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-02T18:50:27.151616] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T18:50:27.341372] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-02T18:50:27.472992] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-02T18:50:28.273056] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-02T18:50:28.912408] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T18:50:29.066725] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T18:50:29.072958] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-02T18:50:29.792379] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-02T18:50:29.872998] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-02T18:50:30.289287] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-02T18:50:30.673042] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-02T18:50:31.413908] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T18:50:31.473004] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-02T18:50:32.077719] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T18:50:32.273000] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-02T18:50:33.073018] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-02T18:50:33.687586] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T18:50:33.688560] [INFO ] [REMOTE ] EVF: Full fetch complete (12206 records). [2025-10-02T18:50:33.688635] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-02T18:50:33.885591] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-02T18:50:34.148465] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-02T18:50:34.162109] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-02T18:50:34.171474] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-02T18:50:34.171862] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-02T18:50:34.173608] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T18:50:34.182590] [DEBUG] [LOCAL ] EVF: Trimmed 12206 records to 9459 (keeping 200 days of data) [2025-10-02T18:50:34.241744] [DEBUG] [LOCAL ] EVF: Primary data saved (9459 records). [2025-10-02T18:50:34.241882] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-02T18:50:34.241968] [INFO ] [MAIN ] Update Progress: 786/2370 symbols completed. EVF took 29.5s. Estimated remaining: 3h 42m 42s. Rate: 7.1 symbols/min [2025-10-02T18:50:34.437388] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:34.494465] [DEBUG] [LOCAL ] EVH: Loaded 49369 existing records from primary storage. [2025-10-02T18:50:34.494816] [INFO ] [MAIN ] EVH: Loaded 49369 existing records. [2025-10-02T18:50:34.686051] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-02T18:50:34.692268] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:34.693233] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-02T18:50:34.693283] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-02T18:50:34.694535] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-10-02T18:50:34.694596] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-02T18:50:34.784726] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T18:50:34.810764] [INFO ] [REMOTE ] EVC: Full fetch complete (30142 records). [2025-10-02T18:50:34.811110] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-02T18:50:35.377732] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:35.481541] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-10-02T18:50:35.541120] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-02T18:50:35.541751] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-02T18:50:35.544572] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-02T18:50:35.545866] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-02T18:50:35.545938] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-02T18:50:35.547095] [DEBUG] [LOCAL ] EVC: Trimmed 30142 records to 18719 (keeping 200 days of data) [2025-10-02T18:50:35.659048] [DEBUG] [LOCAL ] EVC: Primary data saved (18719 records). [2025-10-02T18:50:35.659195] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-02T18:50:35.659308] [INFO ] [MAIN ] Update Progress: 787/2370 symbols completed. EVC took 43.4s. Estimated remaining: 3h 42m 20s. Rate: 7.1 symbols/min [2025-10-02T18:50:35.848574] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:35.863512] [DEBUG] [LOCAL ] EVN: Loaded 11144 existing records from primary storage. [2025-10-02T18:50:35.863852] [INFO ] [MAIN ] EVN: Loaded 11144 existing records. [2025-10-02T18:50:36.094920] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:36.095128] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-02T18:50:36.095181] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-02T18:50:36.095763] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-02T18:50:36.095826] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-02T18:50:36.285023] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-02T18:50:36.505281] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:36.978515] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-02T18:50:37.072981] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-02T18:50:37.252561] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T18:50:37.717854] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T18:50:37.718938] [INFO ] [REMOTE ] EVG: Full fetch complete (8244 records). [2025-10-02T18:50:37.719038] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-02T18:50:37.878130] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-02T18:50:38.131187] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-02T18:50:38.131325] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-02T18:50:38.131605] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-02T18:50:38.131694] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-02T18:50:38.132156] [DEBUG] [LOCAL ] EVG: Trimmed 8244 records to 5992 (keeping 200 days of data) [2025-10-02T18:50:38.170580] [DEBUG] [LOCAL ] EVG: Primary data saved (5992 records). [2025-10-02T18:50:38.170707] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-02T18:50:38.170860] [INFO ] [MAIN ] Update Progress: 788/2370 symbols completed. EVG took 26.2s. Estimated remaining: 3h 41m 59s. Rate: 7.1 symbols/min [2025-10-02T18:50:38.350443] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:38.390241] [DEBUG] [LOCAL ] EVR: Loaded 34906 existing records from primary storage. [2025-10-02T18:50:38.390542] [INFO ] [MAIN ] EVR: Loaded 34906 existing records. [2025-10-02T18:50:38.599556] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:38.599861] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-02T18:50:38.599910] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-02T18:50:38.601086] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-02T18:50:38.601150] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-02T18:50:38.679219] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-02T18:50:38.994072] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:39.472962] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-10-02T18:50:39.588639] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T18:50:40.273001] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-02T18:50:40.431869] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T18:50:40.507735] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T18:50:41.073017] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-02T18:50:41.734092] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T18:50:41.736269] [INFO ] [REMOTE ] EVEX: Full fetch complete (42189 records). [2025-10-02T18:50:41.736400] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-02T18:50:41.878149] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-02T18:50:42.176634] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-02T18:50:42.176827] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-02T18:50:42.177686] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-02T18:50:42.177766] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-02T18:50:42.178990] [DEBUG] [LOCAL ] EVEX: Trimmed 42189 records to 30868 (keeping 200 days of data) [2025-10-02T18:50:42.387835] [DEBUG] [LOCAL ] EVEX: Primary data saved (30868 records). [2025-10-02T18:50:42.387983] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-02T18:50:42.389243] [INFO ] [MAIN ] Update Progress: 789/2370 symbols completed. EVEX took 39.0s. Estimated remaining: 3h 41m 42s. Rate: 7.1 symbols/min [2025-10-02T18:50:42.577685] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:50:42.597769] [DEBUG] [LOCAL ] EVT: Loaded 16951 existing records from primary storage. [2025-10-02T18:50:42.598029] [INFO ] [MAIN ] EVT: Loaded 16951 existing records. [2025-10-02T18:50:42.674098] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-10-02T18:50:42.821999] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:50:42.824053] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T18:50:42.833569] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-02T18:50:42.834015] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-02T18:50:42.834784] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-02T18:50:42.834855] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-02T18:50:43.232561] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:50:43.429502] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T18:50:43.472959] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-02T18:50:43.652452] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T18:50:44.273004] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-02T18:50:44.762318] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T18:50:45.072995] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-02T18:50:45.872984] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-10-02T18:50:45.917563] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T18:50:46.672967] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-02T18:50:46.700041] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T18:50:46.956545] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T18:50:47.473014] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-02T18:50:48.147265] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T18:50:48.273023] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-02T18:50:48.403225] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T18:50:48.924617] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T18:50:49.073002] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-02T18:50:49.873006] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-02T18:50:49.905161] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T18:50:50.673009] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-02T18:50:50.841812] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T18:50:51.473009] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-02T18:50:52.244857] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T18:50:52.272953] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-02T18:50:52.331860] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T18:50:53.073020] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-02T18:50:53.269925] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-02T18:50:53.872975] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-02T18:50:53.955468] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T18:50:54.673006] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-02T18:50:55.472984] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-02T18:50:55.529552] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T18:50:56.272988] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-02T18:50:56.373550] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T18:50:56.519185] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T18:50:57.073009] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-02T18:50:57.821939] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T18:50:57.872972] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-02T18:50:58.497204] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T18:50:58.672997] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-02T18:50:59.472976] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-02T18:50:59.564130] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T18:50:59.729454] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T18:51:00.129692] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-02T18:51:00.273000] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-02T18:51:01.072975] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-02T18:51:01.077723] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T18:51:01.873047] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-02T18:51:02.530546] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T18:51:02.673020] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-02T18:51:02.814254] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T18:51:03.472975] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-02T18:51:03.700322] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T18:51:04.273043] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-02T18:51:04.968879] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T18:51:04.971679] [INFO ] [REMOTE ] EVH: Full fetch complete (71784 records). [2025-10-02T18:51:04.971832] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-02T18:51:05.078823] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-02T18:51:05.450830] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-02T18:51:05.451035] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-02T18:51:05.452166] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-02T18:51:05.462865] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-02T18:51:05.464303] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-02T18:51:05.470214] [DEBUG] [LOCAL ] EVH: Trimmed 71784 records to 49734 (keeping 200 days of data) [2025-10-02T18:51:05.771932] [DEBUG] [LOCAL ] EVH: Primary data saved (49734 records). [2025-10-02T18:51:05.772083] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-02T18:51:05.772235] [INFO ] [MAIN ] Update Progress: 790/2370 symbols completed. EVH took 31.5s. Estimated remaining: 3h 42m 4s. Rate: 7.1 symbols/min [2025-10-02T18:51:05.878123] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-02T18:51:05.961000] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:05.989632] [DEBUG] [LOCAL ] EVTC: Loaded 26228 existing records from primary storage. [2025-10-02T18:51:05.989937] [INFO ] [MAIN ] EVTC: Loaded 26228 existing records. [2025-10-02T18:51:06.193195] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:06.193447] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-02T18:51:06.193502] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-02T18:51:06.194579] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-02T18:51:06.194675] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-02T18:51:06.597826] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:06.639776] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T18:51:06.659089] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T18:51:06.672950] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-02T18:51:07.472994] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-10-02T18:51:07.647381] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T18:51:08.273017] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-02T18:51:08.591617] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T18:51:08.847881] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T18:51:08.849394] [INFO ] [REMOTE ] EVT: Full fetch complete (25316 records). [2025-10-02T18:51:08.849495] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-02T18:51:09.078151] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-02T18:51:09.283946] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-02T18:51:09.284041] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-02T18:51:09.284619] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-02T18:51:09.284703] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-02T18:51:09.285525] [DEBUG] [LOCAL ] EVT: Trimmed 25316 records to 17068 (keeping 200 days of data) [2025-10-02T18:51:09.391700] [DEBUG] [LOCAL ] EVT: Primary data saved (17068 records). [2025-10-02T18:51:09.391885] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-02T18:51:09.391993] [INFO ] [MAIN ] Update Progress: 791/2370 symbols completed. EVT took 27.0s. Estimated remaining: 3h 41m 46s. Rate: 7.1 symbols/min [2025-10-02T18:51:09.567679] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:09.604849] [DEBUG] [LOCAL ] EVTL: Loaded 38254 existing records from primary storage. [2025-10-02T18:51:09.605141] [INFO ] [MAIN ] EVTL: Loaded 38254 existing records. [2025-10-02T18:51:09.808135] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:09.808355] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-02T18:51:09.808408] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-02T18:51:09.809984] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-02T18:51:09.810060] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-02T18:51:09.880259] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-02T18:51:10.021246] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T18:51:10.221576] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:10.673029] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-02T18:51:11.232504] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T18:51:11.474136] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-10-02T18:51:11.478928] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T18:51:12.273049] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-02T18:51:12.591245] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T18:51:13.073024] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-02T18:51:13.189393] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T18:51:13.872984] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-02T18:51:14.074331] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T18:51:14.672998] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-02T18:51:15.031281] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T18:51:15.473028] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-02T18:51:15.883362] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T18:51:16.273007] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-02T18:51:16.372861] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T18:51:17.073014] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-02T18:51:17.753111] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T18:51:17.873005] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-02T18:51:18.274418] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T18:51:18.276025] [INFO ] [REMOTE ] EVR: Full fetch complete (50817 records). [2025-10-02T18:51:18.276155] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-02T18:51:18.474123] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T18:51:18.498736] [INFO ] [REMOTE ] EVN: Full fetch complete (17812 records). [2025-10-02T18:51:18.568509] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-02T18:51:18.677999] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-02T18:51:18.909088] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-02T18:51:18.920452] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-02T18:51:18.932503] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-02T18:51:18.960489] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-02T18:51:19.073923] [DEBUG] [LOCAL ] EVR: Trimmed 50817 records to 35117 (keeping 200 days of data) [2025-10-02T18:51:19.226797] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-02T18:51:19.227189] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-02T18:51:19.255574] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-02T18:51:19.255998] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-02T18:51:19.259458] [DEBUG] [LOCAL ] EVN: Trimmed 17812 records to 11253 (keeping 200 days of data) [2025-10-02T18:51:19.454238] [DEBUG] [LOCAL ] EVN: Primary data saved (11253 records). [2025-10-02T18:51:19.456797] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-02T18:51:19.458253] [INFO ] [MAIN ] Update Progress: 792/2370 symbols completed. EVN took 43.8s. Estimated remaining: 3h 41m 41s. Rate: 7.1 symbols/min [2025-10-02T18:51:19.478088] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-02T18:51:19.558836] [DEBUG] [LOCAL ] EVR: Primary data saved (35117 records). [2025-10-02T18:51:19.579623] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-02T18:51:19.582530] [INFO ] [MAIN ] Update Progress: 793/2370 symbols completed. EVR took 41.4s. Estimated remaining: 3h 41m 16s. Rate: 7.1 symbols/min [2025-10-02T18:51:19.733733] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:19.855443] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:19.873438] [DEBUG] [LOCAL ] EVTR: Loaded 23681 existing records from primary storage. [2025-10-02T18:51:19.873714] [INFO ] [MAIN ] EVTR: Loaded 23681 existing records. [2025-10-02T18:51:20.104074] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:20.117488] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-02T18:51:20.117336] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T18:51:20.117703] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-02T18:51:20.140946] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-02T18:51:20.141082] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-02T18:51:20.147572] [DEBUG] [LOCAL ] EW: Loaded 53402 existing records from primary storage. [2025-10-02T18:51:20.204498] [INFO ] [MAIN ] EW: Loaded 53402 existing records. [2025-10-02T18:51:20.312677] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-02T18:51:20.631515] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:20.657622] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-02T18:51:20.663225] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-02T18:51:20.689163] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-02T18:51:20.689528] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-02T18:51:20.870807] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:20.885528] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T18:51:21.078151] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-02T18:51:21.249794] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:21.363267] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T18:51:21.872975] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-10-02T18:51:22.272950] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T18:51:22.673030] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-02T18:51:23.467230] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T18:51:23.477589] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-02T18:51:23.949202] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T18:51:24.262197] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T18:51:24.273004] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-02T18:51:25.073000] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-10-02T18:51:25.873812] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-02T18:51:25.877002] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T18:51:25.916616] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T18:51:26.673006] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-02T18:51:27.472977] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-02T18:51:27.536809] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T18:51:28.089822] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T18:51:28.120212] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T18:51:28.272999] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-02T18:51:29.072979] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-02T18:51:29.202521] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T18:51:29.873008] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-02T18:51:30.672999] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-02T18:51:30.969497] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T18:51:31.133346] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T18:51:31.374787] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T18:51:31.472981] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-02T18:51:32.272972] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-02T18:51:32.408294] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T18:51:33.073021] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-02T18:51:33.873013] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-02T18:51:34.085027] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T18:51:34.123550] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T18:51:34.673000] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-02T18:51:35.473000] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-02T18:51:35.663177] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T18:51:36.152812] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T18:51:36.273018] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-02T18:51:36.519140] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T18:51:37.072992] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-02T18:51:37.123192] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T18:51:37.873000] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-02T18:51:38.672982] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-02T18:51:38.857101] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T18:51:39.472963] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-02T18:51:39.652526] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T18:51:39.819242] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T18:51:40.272992] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-02T18:51:41.072997] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-02T18:51:41.094816] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-02T18:51:41.096785] [INFO ] [REMOTE ] EVTL: Full fetch complete (52188 records). [2025-10-02T18:51:41.096895] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-02T18:51:41.398835] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T18:51:41.430041] [INFO ] [REMOTE ] EVTC: Full fetch complete (38002 records). [2025-10-02T18:51:41.435973] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-02T18:51:41.677218] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-10-02T18:51:41.682451] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-10-02T18:51:41.683327] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-10-02T18:51:41.704864] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-10-02T18:51:41.741140] [DEBUG] [LOCAL ] EVTL: Trimmed 52188 records to 38644 (keeping 200 days of data) [2025-10-02T18:51:41.880147] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-02T18:51:42.063893] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-02T18:51:42.064606] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-02T18:51:42.066126] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-02T18:51:42.066214] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-02T18:51:42.071062] [DEBUG] [LOCAL ] EVTC: Trimmed 38002 records to 26492 (keeping 200 days of data) [2025-10-02T18:51:42.198780] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T18:51:42.361213] [DEBUG] [LOCAL ] EVTC: Primary data saved (26492 records). [2025-10-02T18:51:42.362207] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-02T18:51:42.363418] [INFO ] [MAIN ] Update Progress: 794/2370 symbols completed. EVTC took 36.6s. Estimated remaining: 3h 41m 36s. Rate: 7.1 symbols/min [2025-10-02T18:51:42.559179] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:42.570748] [DEBUG] [LOCAL ] EVTL: Primary data saved (38644 records). [2025-10-02T18:51:42.570889] [INFO ] [MAIN ] EVTL: Full history saved. [2025-10-02T18:51:42.571456] [INFO ] [MAIN ] Update Progress: 795/2370 symbols completed. EVTL took 33.2s. Estimated remaining: 3h 41m 11s. Rate: 7.1 symbols/min [2025-10-02T18:51:42.682439] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-02T18:51:42.766955] [DEBUG] [LOCAL ] EXG: Loaded 34113 existing records from primary storage. [2025-10-02T18:51:42.786985] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:42.787401] [INFO ] [MAIN ] EXG: Loaded 34113 existing records. [2025-10-02T18:51:43.006267] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:43.006532] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-02T18:51:43.006585] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-02T18:51:43.007829] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-02T18:51:43.007897] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-02T18:51:43.165856] [DEBUG] [LOCAL ] EXK: Loaded 53136 existing records from primary storage. [2025-10-02T18:51:43.200217] [INFO ] [MAIN ] EXK: Loaded 53136 existing records. [2025-10-02T18:51:43.644266] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:43.645107] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-10-02T18:51:43.640183] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:43.645480] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-02T18:51:43.646497] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-02T18:51:43.647992] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-02T18:51:43.648060] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-02T18:51:44.091148] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T18:51:44.097021] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:44.125350] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-10-02T18:51:44.272984] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-02T18:51:45.000991] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T18:51:45.073025] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-02T18:51:45.438742] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T18:51:45.873039] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-02T18:51:46.078206] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T18:51:46.673027] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-10-02T18:51:47.217407] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T18:51:47.473006] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-02T18:51:48.273110] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-02T18:51:48.444735] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T18:51:48.838290] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T18:51:49.073037] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-02T18:51:49.724420] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T18:51:49.873062] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-02T18:51:50.081283] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T18:51:50.083440] [INFO ] [REMOTE ] EVTR: Full fetch complete (32535 records). [2025-10-02T18:51:50.083594] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-02T18:51:50.629401] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-02T18:51:50.629511] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-02T18:51:50.630397] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-02T18:51:50.630468] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-02T18:51:50.631600] [DEBUG] [LOCAL ] EVTR: Trimmed 32535 records to 23911 (keeping 200 days of data) [2025-10-02T18:51:50.691637] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-02T18:51:50.805289] [DEBUG] [LOCAL ] EVTR: Primary data saved (23911 records). [2025-10-02T18:51:50.805449] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-02T18:51:50.805612] [INFO ] [MAIN ] Update Progress: 796/2370 symbols completed. EVTR took 31.3s. Estimated remaining: 3h 41m 2s. Rate: 7.1 symbols/min [2025-10-02T18:51:51.017627] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:51:51.054500] [DEBUG] [LOCAL ] EXP: Loaded 29652 existing records from primary storage. [2025-10-02T18:51:51.054808] [INFO ] [MAIN ] EXP: Loaded 29652 existing records. [2025-10-02T18:51:51.259943] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:51:51.260227] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-02T18:51:51.260301] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-02T18:51:51.271582] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-10-02T18:51:51.290761] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-02T18:51:51.298153] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T18:51:51.499406] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-02T18:51:51.710983] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:51:52.272967] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-02T18:51:52.478023] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T18:51:53.072972] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-02T18:51:53.138800] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T18:51:53.703274] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T18:51:53.873049] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-02T18:51:54.673033] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-10-02T18:51:54.717928] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T18:51:54.813834] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T18:51:55.473027] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-02T18:51:55.996301] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T18:51:56.273026] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-02T18:51:57.073042] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-02T18:51:57.453384] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T18:51:57.699216] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T18:51:57.873037] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-02T18:51:58.673010] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-02T18:51:59.023603] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T18:51:59.163797] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T18:51:59.473024] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-02T18:52:00.105511] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T18:52:00.273053] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-02T18:52:00.723449] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T18:52:01.073000] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-02T18:52:01.852809] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T18:52:01.872964] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-02T18:52:02.473588] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T18:52:02.673045] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-02T18:52:03.473060] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-02T18:52:03.695602] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T18:52:04.016001] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T18:52:04.273046] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-02T18:52:05.032507] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T18:52:05.034867] [INFO ] [REMOTE ] EW: Full fetch complete (77350 records). [2025-10-02T18:52:05.035003] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-02T18:52:05.078197] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-02T18:52:05.515554] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-02T18:52:05.516513] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T18:52:05.516773] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-02T18:52:05.524847] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-02T18:52:05.525420] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-02T18:52:05.527352] [DEBUG] [LOCAL ] EW: Trimmed 77350 records to 53791 (keeping 200 days of data) [2025-10-02T18:52:05.870064] [DEBUG] [LOCAL ] EW: Primary data saved (53791 records). [2025-10-02T18:52:05.870241] [INFO ] [MAIN ] EW: Full history saved. [2025-10-02T18:52:05.870345] [INFO ] [MAIN ] Update Progress: 797/2370 symbols completed. EW took 46.3s. Estimated remaining: 3h 41m 7s. Rate: 7.1 symbols/min [2025-10-02T18:52:05.872971] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-02T18:52:06.223813] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T18:52:06.673014] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-02T18:52:07.134991] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:52:07.473041] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-02T18:52:08.063739] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T18:52:08.273009] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-02T18:52:08.578099] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T18:52:08.579684] [INFO ] [REMOTE ] EXG: Full fetch complete (49955 records). [2025-10-02T18:52:08.579771] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-02T18:52:09.007810] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-02T18:52:09.007902] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-02T18:52:09.008698] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-02T18:52:09.008765] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-02T18:52:09.009950] [DEBUG] [LOCAL ] EXG: Trimmed 49955 records to 34342 (keeping 200 days of data) [2025-10-02T18:52:09.096322] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-02T18:52:09.227174] [DEBUG] [LOCAL ] EXG: Primary data saved (34342 records). [2025-10-02T18:52:09.227331] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-02T18:52:09.227441] [INFO ] [MAIN ] Update Progress: 798/2370 symbols completed. EXG took 26.9s. Estimated remaining: 3h 40m 49s. Rate: 7.1 symbols/min [2025-10-02T18:52:10.173780] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T18:52:10.185728] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-02T18:52:10.462807] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T18:52:10.673050] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-02T18:52:12.021788] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T18:52:12.030408] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-02T18:52:12.172673] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T18:52:12.273078] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-02T18:52:13.217932] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T18:52:13.227513] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-02T18:52:14.032875] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T18:52:14.045182] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-02T18:52:14.204738] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T18:52:14.206213] [INFO ] [REMOTE ] EXP: Full fetch complete (42884 records). [2025-10-02T18:52:14.206309] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-02T18:52:14.622749] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-02T18:52:14.622889] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-02T18:52:14.623602] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-02T18:52:14.623676] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-02T18:52:14.624886] [DEBUG] [LOCAL ] EXP: Trimmed 42884 records to 29797 (keeping 200 days of data) [2025-10-02T18:52:14.824435] [DEBUG] [LOCAL ] EXP: Primary data saved (29797 records). [2025-10-02T18:52:14.824577] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-02T18:52:14.824679] [INFO ] [MAIN ] Update Progress: 799/2370 symbols completed. EXP took 24.0s. Estimated remaining: 3h 40m 35s. Rate: 7.1 symbols/min [2025-10-02T18:52:15.958815] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T18:52:15.975089] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-02T18:52:17.558765] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T18:52:17.560847] [INFO ] [REMOTE ] EXK: Full fetch complete (76542 records). [2025-10-02T18:52:17.560959] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-02T18:52:17.981558] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-02T18:52:17.981664] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-02T18:52:17.982557] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-02T18:52:17.982606] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-02T18:52:17.984075] [DEBUG] [LOCAL ] EXK: Trimmed 76542 records to 53526 (keeping 200 days of data) [2025-10-02T18:52:18.306137] [DEBUG] [LOCAL ] EXK: Primary data saved (53526 records). [2025-10-02T18:52:18.306333] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-02T18:52:18.306555] [INFO ] [MAIN ] Update Progress: 800/2370 symbols completed. EXK took 35.7s. Estimated remaining: 3h 40m 16s. Rate: 7.1 symbols/min [2025-10-02T18:52:18.907209] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:19.050619] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:19.056585] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:19.094170] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:19.188853] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-02T18:52:19.216098] [DEBUG] [LOCAL ] EXR: Loaded 45268 existing records from primary storage. [2025-10-02T18:52:19.214760] [DEBUG] [LOCAL ] FAF: Loaded 41688 existing records from primary storage. [2025-10-02T18:52:19.214960] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-02T18:52:19.216470] [INFO ] [MAIN ] EXR: Loaded 45268 existing records. [2025-10-02T18:52:19.217319] [INFO ] [MAIN ] FAF: Loaded 41688 existing records. [2025-10-02T18:52:19.370098] [DEBUG] [LOCAL ] EXPD: Loaded 47959 existing records from primary storage. [2025-10-02T18:52:19.444701] [INFO ] [MAIN ] EXPD: Loaded 47959 existing records. [2025-10-02T18:52:19.866001] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:19.974483] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:19.982108] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-02T18:52:19.981740] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:19.992826] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-02T18:52:19.992743] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-02T18:52:20.013832] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-10-02T18:52:20.013912] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-02T18:52:20.013713] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-02T18:52:20.026536] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-02T18:52:20.031914] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-02T18:52:20.032021] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-02T18:52:20.026673] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-02T18:52:20.051348] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-02T18:52:20.105795] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:20.194709] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-02T18:52:20.200886] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-02T18:52:20.153793] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-02T18:52:20.331438] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-10-02T18:52:20.367537] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-02T18:52:21.376145] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:21.493885] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-10-02T18:52:21.554290] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:21.607069] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-10-02T18:52:21.634664] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:21.668242] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-10-02T18:52:21.756926] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:21.757251] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-10-02T18:52:23.018937] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T18:52:23.026805] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-02T18:52:23.068298] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T18:52:23.078617] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-02T18:52:23.143551] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T18:52:23.153115] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-02T18:52:23.932303] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T18:52:23.939976] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-02T18:52:23.985695] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-10-02T18:52:23.997459] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-02T18:52:24.609585] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T18:52:24.620136] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-02T18:52:24.804131] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T18:52:24.814945] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-02T18:52:24.906927] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T18:52:24.914289] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-02T18:52:25.909710] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T18:52:25.920098] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-02T18:52:26.295269] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T18:52:26.304548] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-02T18:52:26.379547] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T18:52:26.450028] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.45 seconds). [2025-10-02T18:52:26.673017] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-02T18:52:27.386400] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T18:52:27.472990] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-02T18:52:27.955069] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T18:52:28.034379] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T18:52:28.273042] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-02T18:52:29.073028] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-02T18:52:29.175716] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T18:52:29.507911] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T18:52:29.872995] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-02T18:52:30.673006] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-02T18:52:31.351295] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T18:52:31.486228] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-02T18:52:31.494196] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-02T18:52:32.272973] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-02T18:52:32.364199] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T18:52:33.072996] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-02T18:52:33.314829] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T18:52:33.873004] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-02T18:52:34.676082] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-02T18:52:34.681383] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T18:52:34.796753] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-10-02T18:52:35.243973] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T18:52:35.473001] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-02T18:52:35.882268] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T18:52:36.273012] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-02T18:52:37.072992] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-02T18:52:37.635081] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T18:52:37.873003] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-02T18:52:37.984434] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-02T18:52:38.673087] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-02T18:52:38.741504] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T18:52:39.423544] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:52:39.473001] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-02T18:52:40.273043] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-02T18:52:41.072975] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-02T18:52:41.155685] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T18:52:41.209104] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-02T18:52:41.795336] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T18:52:41.873003] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-02T18:52:42.601838] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T18:52:42.673037] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-02T18:52:43.478134] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-02T18:52:43.496696] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T18:52:43.872273] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T18:52:43.873870] [INFO ] [REMOTE ] FAF: Full fetch complete (57628 records). [2025-10-02T18:52:43.873986] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-02T18:52:44.282300] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-02T18:52:44.305223] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-02T18:52:44.305292] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-02T18:52:44.306054] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-02T18:52:44.306237] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-02T18:52:44.307960] [DEBUG] [LOCAL ] FAF: Trimmed 57628 records to 41936 (keeping 200 days of data) [2025-10-02T18:52:44.579058] [DEBUG] [LOCAL ] FAF: Primary data saved (41936 records). [2025-10-02T18:52:44.579212] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-02T18:52:44.580916] [INFO ] [MAIN ] Update Progress: 801/2370 symbols completed. FAF took 26.2s. Estimated remaining: 3h 40m 43s. Rate: 7.1 symbols/min [2025-10-02T18:52:44.822966] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:44.878870] [DEBUG] [LOCAL ] FBIN: Loaded 50327 existing records from primary storage. [2025-10-02T18:52:44.879195] [INFO ] [MAIN ] FBIN: Loaded 50327 existing records. [2025-10-02T18:52:45.067746] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:45.067974] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-02T18:52:45.068024] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-02T18:52:45.070768] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-02T18:52:45.070841] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-02T18:52:45.104836] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-02T18:52:45.463265] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:45.866265] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-10-02T18:52:45.877429] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-10-02T18:52:45.930193] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T18:52:46.365911] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:52:46.673010] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-02T18:52:47.442337] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T18:52:47.472992] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-02T18:52:48.273040] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-02T18:52:49.031979] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T18:52:49.072999] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-02T18:52:49.138802] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-10-02T18:52:49.351560] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T18:52:49.354381] [INFO ] [REMOTE ] EXPD: Full fetch complete (69316 records). [2025-10-02T18:52:49.354608] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-02T18:52:49.801873] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-02T18:52:49.801966] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-02T18:52:49.802947] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-02T18:52:49.803017] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-02T18:52:49.804478] [DEBUG] [LOCAL ] EXPD: Trimmed 69316 records to 48284 (keeping 200 days of data) [2025-10-02T18:52:49.877633] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-02T18:52:50.134917] [DEBUG] [LOCAL ] EXPD: Primary data saved (48284 records). [2025-10-02T18:52:50.135070] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-02T18:52:50.135157] [INFO ] [MAIN ] Update Progress: 802/2370 symbols completed. EXPD took 31.8s. Estimated remaining: 3h 40m 29s. Rate: 7.1 symbols/min [2025-10-02T18:52:50.336480] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:50.367200] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T18:52:50.401100] [DEBUG] [LOCAL ] FBK: Loaded 26076 existing records from primary storage. [2025-10-02T18:52:50.401544] [INFO ] [MAIN ] FBK: Loaded 26076 existing records. [2025-10-02T18:52:50.597672] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:50.597919] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-02T18:52:50.597980] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-02T18:52:50.598965] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-02T18:52:50.599036] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-02T18:52:50.678199] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-02T18:52:51.017541] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:51.473067] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-10-02T18:52:52.034179] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-02T18:52:52.089871] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:52:52.092827] [INFO ] [REMOTE ] EXR: Full fetch complete (65898 records). [2025-10-02T18:52:52.092991] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-02T18:52:52.218586] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T18:52:52.280999] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-02T18:52:52.532142] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-02T18:52:52.532230] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-02T18:52:52.533048] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-02T18:52:52.533114] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-02T18:52:52.534525] [DEBUG] [LOCAL ] EXR: Trimmed 65898 records to 45592 (keeping 200 days of data) [2025-10-02T18:52:52.843500] [DEBUG] [LOCAL ] EXR: Primary data saved (45592 records). [2025-10-02T18:52:52.843636] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-02T18:52:52.843761] [INFO ] [MAIN ] Update Progress: 803/2370 symbols completed. EXR took 34.5s. Estimated remaining: 3h 40m 9s. Rate: 7.1 symbols/min [2025-10-02T18:52:53.019205] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:53.069304] [DEBUG] [LOCAL ] FBP: Loaded 45961 existing records from primary storage. [2025-10-02T18:52:53.069610] [INFO ] [MAIN ] FBP: Loaded 45961 existing records. [2025-10-02T18:52:53.080933] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-02T18:52:53.265526] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:53.265793] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-02T18:52:53.265853] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-02T18:52:53.267396] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-02T18:52:53.267464] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-02T18:52:53.642532] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:53.873001] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-02T18:52:54.212269] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T18:52:54.673034] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-10-02T18:52:54.803836] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-02T18:52:55.472977] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-02T18:52:55.603826] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T18:52:56.130503] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:52:56.273041] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-02T18:52:57.073047] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-02T18:52:57.782164] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-02T18:52:57.799209] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-10-02T18:52:57.817188] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-02T18:52:57.829115] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T18:52:57.830418] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T18:52:57.878105] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-02T18:52:58.269533] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-02T18:52:58.269620] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-02T18:52:58.270598] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-02T18:52:58.270688] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-02T18:52:58.272185] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 54210 (keeping 200 days of data) [2025-10-02T18:52:58.629703] [DEBUG] [LOCAL ] F: Primary data saved (54210 records). [2025-10-02T18:52:58.629848] [INFO ] [MAIN ] F: Full history saved. [2025-10-02T18:52:58.629937] [INFO ] [MAIN ] Update Progress: 804/2370 symbols completed. F took 40.3s. Estimated remaining: 3h 39m 56s. Rate: 7.1 symbols/min [2025-10-02T18:52:58.678187] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-02T18:52:58.820424] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:52:58.859681] [DEBUG] [LOCAL ] FBRT: Loaded 34730 existing records from primary storage. [2025-10-02T18:52:58.860039] [INFO ] [MAIN ] FBRT: Loaded 34730 existing records. [2025-10-02T18:52:59.002574] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T18:52:59.070361] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:52:59.070563] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-02T18:52:59.070633] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-02T18:52:59.072103] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-02T18:52:59.072165] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-02T18:52:59.453327] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:52:59.472971] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-02T18:53:00.264864] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:53:00.276087] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-10-02T18:53:01.031877] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T18:53:01.072992] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-02T18:53:01.703213] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T18:53:01.873039] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-02T18:53:02.432461] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T18:53:02.673032] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-02T18:53:03.312097] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T18:53:03.473007] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-02T18:53:03.702529] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T18:53:04.273058] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-02T18:53:05.072980] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-02T18:53:05.190724] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T18:53:05.240462] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T18:53:05.872992] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-02T18:53:06.673006] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-02T18:53:06.958592] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T18:53:07.448137] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T18:53:07.472982] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-02T18:53:07.629106] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T18:53:08.273036] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-02T18:53:08.999585] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T18:53:09.073028] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-02T18:53:09.639111] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-02T18:53:09.873008] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-02T18:53:10.673025] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-02T18:53:10.788386] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T18:53:11.051292] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T18:53:11.472980] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-02T18:53:12.259400] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T18:53:12.272965] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-02T18:53:12.601039] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T18:53:13.072996] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-02T18:53:13.750982] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T18:53:13.872998] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-02T18:53:14.031582] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:53:14.033104] [INFO ] [REMOTE ] FBK: Full fetch complete (33663 records). [2025-10-02T18:53:14.033186] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-02T18:53:14.437028] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-02T18:53:14.437110] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-02T18:53:14.437748] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-02T18:53:14.437816] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-02T18:53:14.438881] [DEBUG] [LOCAL ] FBK: Trimmed 33663 records to 26281 (keeping 200 days of data) [2025-10-02T18:53:14.611476] [DEBUG] [LOCAL ] FBK: Primary data saved (26281 records). [2025-10-02T18:53:14.611625] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-02T18:53:14.611760] [INFO ] [MAIN ] Update Progress: 805/2370 symbols completed. FBK took 24.5s. Estimated remaining: 3h 40m 2s. Rate: 7.1 symbols/min [2025-10-02T18:53:14.680259] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-02T18:53:14.801835] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:14.819087] [DEBUG] [LOCAL ] FC: Loaded 15437 existing records from primary storage. [2025-10-02T18:53:14.819353] [INFO ] [MAIN ] FC: Loaded 15437 existing records. [2025-10-02T18:53:15.020142] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:53:15.020403] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-02T18:53:15.020459] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-02T18:53:15.021004] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-02T18:53:15.021067] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-02T18:53:15.430903] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:15.472984] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-10-02T18:53:15.569817] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T18:53:16.273037] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-02T18:53:16.316031] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T18:53:16.335556] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T18:53:17.073042] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-02T18:53:17.873026] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-02T18:53:17.908264] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T18:53:18.459239] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T18:53:18.461254] [INFO ] [REMOTE ] FBIN: Full fetch complete (72588 records). [2025-10-02T18:53:18.461361] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-02T18:53:18.683009] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-02T18:53:18.889471] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-02T18:53:18.889698] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-02T18:53:18.890707] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-02T18:53:18.890855] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-02T18:53:18.909299] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T18:53:18.916291] [DEBUG] [LOCAL ] FBIN: Trimmed 72588 records to 50693 (keeping 200 days of data) [2025-10-02T18:53:19.268165] [DEBUG] [LOCAL ] FBIN: Primary data saved (50693 records). [2025-10-02T18:53:19.268316] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-02T18:53:19.269384] [INFO ] [MAIN ] Update Progress: 806/2370 symbols completed. FBIN took 34.7s. Estimated remaining: 3h 39m 46s. Rate: 7.1 symbols/min [2025-10-02T18:53:19.452258] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:19.478912] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-02T18:53:19.500134] [DEBUG] [LOCAL ] FCF: Loaded 39411 existing records from primary storage. [2025-10-02T18:53:19.500487] [INFO ] [MAIN ] FCF: Loaded 39411 existing records. [2025-10-02T18:53:19.696093] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:53:19.696305] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-02T18:53:19.696353] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-02T18:53:19.698044] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-02T18:53:19.698127] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-02T18:53:20.100580] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:20.200373] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T18:53:20.273021] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-02T18:53:20.472958] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T18:53:21.073001] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-10-02T18:53:21.575310] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T18:53:21.577451] [INFO ] [REMOTE ] FBP: Full fetch complete (66364 records). [2025-10-02T18:53:21.577637] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-02T18:53:21.878206] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-02T18:53:22.022847] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-02T18:53:22.022929] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-02T18:53:22.023812] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-02T18:53:22.023880] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-02T18:53:22.025336] [DEBUG] [LOCAL ] FBP: Trimmed 66364 records to 46270 (keeping 200 days of data) [2025-10-02T18:53:22.321752] [DEBUG] [LOCAL ] FBP: Primary data saved (46270 records). [2025-10-02T18:53:22.322055] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-02T18:53:22.322235] [INFO ] [MAIN ] Update Progress: 807/2370 symbols completed. FBP took 29.5s. Estimated remaining: 3h 39m 27s. Rate: 7.1 symbols/min [2025-10-02T18:53:22.533378] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T18:53:22.531465] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:22.571593] [DEBUG] [LOCAL ] FCN: Loaded 25935 existing records from primary storage. [2025-10-02T18:53:22.571929] [INFO ] [MAIN ] FCN: Loaded 25935 existing records. [2025-10-02T18:53:22.682037] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-02T18:53:22.771967] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:53:22.772242] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-02T18:53:22.772290] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-02T18:53:22.773872] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-02T18:53:22.773935] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-02T18:53:23.175584] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T18:53:23.179865] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:23.472995] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-02T18:53:23.916837] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T18:53:24.273001] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-02T18:53:24.838474] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T18:53:25.073034] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-02T18:53:25.616952] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T18:53:25.872965] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-02T18:53:25.992685] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T18:53:26.673026] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-02T18:53:27.424781] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T18:53:27.473009] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-02T18:53:27.725599] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T18:53:28.273006] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-02T18:53:29.073043] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-10-02T18:53:29.155684] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-02T18:53:29.657141] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T18:53:29.804588] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:53:29.873000] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-02T18:53:30.673001] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-02T18:53:31.336509] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T18:53:31.472970] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-02T18:53:31.704299] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T18:53:32.273013] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-02T18:53:32.577401] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T18:53:33.072991] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-02T18:53:33.574161] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T18:53:33.846883] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T18:53:33.872980] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-02T18:53:34.459532] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T18:53:34.673015] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-02T18:53:35.473024] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-02T18:53:35.776597] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T18:53:36.273031] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-02T18:53:36.659789] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:53:37.073010] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-02T18:53:37.761762] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T18:53:37.873012] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-02T18:53:38.672993] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-02T18:53:38.780938] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T18:53:39.112414] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-02T18:53:39.473019] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-02T18:53:40.049996] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T18:53:40.273037] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-02T18:53:40.881787] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T18:53:41.073008] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-02T18:53:41.304253] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T18:53:41.873034] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-02T18:53:42.183838] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T18:53:42.673043] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-02T18:53:43.295236] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T18:53:43.473005] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-02T18:53:43.984462] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T18:53:44.273051] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-02T18:53:44.594262] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T18:53:44.596278] [INFO ] [REMOTE ] FCF: Full fetch complete (58039 records). [2025-10-02T18:53:44.596408] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-02T18:53:45.007248] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-02T18:53:45.007341] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-02T18:53:45.008162] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-02T18:53:45.008231] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-02T18:53:45.009495] [DEBUG] [LOCAL ] FCF: Trimmed 58039 records to 39650 (keeping 200 days of data) [2025-10-02T18:53:45.074964] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-02T18:53:45.257919] [DEBUG] [LOCAL ] FCF: Primary data saved (39650 records). [2025-10-02T18:53:45.261507] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-02T18:53:45.262150] [INFO ] [MAIN ] Update Progress: 808/2370 symbols completed. FCF took 26.0s. Estimated remaining: 3h 39m 47s. Rate: 7.1 symbols/min [2025-10-02T18:53:45.447799] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:45.486169] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T18:53:45.505423] [DEBUG] [LOCAL ] FCPT: Loaded 37301 existing records from primary storage. [2025-10-02T18:53:45.505791] [INFO ] [MAIN ] FCPT: Loaded 37301 existing records. [2025-10-02T18:53:45.698706] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:53:45.698931] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-02T18:53:45.698979] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-02T18:53:45.700572] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-02T18:53:45.700634] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-02T18:53:45.887061] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-02T18:53:46.098662] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:46.399865] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T18:53:46.673011] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-02T18:53:47.265068] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-02T18:53:47.472972] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-02T18:53:47.632016] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-02T18:53:48.273034] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-02T18:53:48.640056] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:53:48.641765] [INFO ] [REMOTE ] FBRT: Full fetch complete (48950 records). [2025-10-02T18:53:48.641859] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-02T18:53:49.073998] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-02T18:53:49.074509] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-02T18:53:49.074750] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-02T18:53:49.076565] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-02T18:53:49.076666] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-02T18:53:49.077938] [DEBUG] [LOCAL ] FBRT: Trimmed 48950 records to 34942 (keeping 200 days of data) [2025-10-02T18:53:49.208948] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-02T18:53:49.326639] [DEBUG] [LOCAL ] FBRT: Primary data saved (34942 records). [2025-10-02T18:53:49.326823] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-02T18:53:49.326911] [INFO ] [MAIN ] Update Progress: 809/2370 symbols completed. FBRT took 50.7s. Estimated remaining: 3h 39m 30s. Rate: 7.1 symbols/min [2025-10-02T18:53:49.515027] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:49.515223] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-02T18:53:49.515267] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-02T18:53:49.515380] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-02T18:53:49.515423] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-02T18:53:49.515480] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-02T18:53:49.515560] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-02T18:53:49.879060] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-02T18:53:49.925961] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:49.942599] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-02T18:53:50.673060] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-10-02T18:53:50.704123] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T18:53:50.705300] [INFO ] [REMOTE ] FC: Full fetch complete (21810 records). [2025-10-02T18:53:50.705375] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-02T18:53:50.989819] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-02T18:53:51.119359] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-02T18:53:51.119439] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-02T18:53:51.119963] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-02T18:53:51.120030] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-02T18:53:51.120861] [DEBUG] [LOCAL ] FC: Trimmed 21810 records to 15565 (keeping 200 days of data) [2025-10-02T18:53:51.214857] [DEBUG] [LOCAL ] FC: Primary data saved (15565 records). [2025-10-02T18:53:51.214997] [INFO ] [MAIN ] FC: Full history saved. [2025-10-02T18:53:51.215083] [INFO ] [MAIN ] Update Progress: 810/2370 symbols completed. FC took 36.6s. Estimated remaining: 3h 39m 9s. Rate: 7.1 symbols/min [2025-10-02T18:53:51.396800] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:51.413174] [DEBUG] [LOCAL ] FCT: Loaded 14609 existing records from primary storage. [2025-10-02T18:53:51.413418] [INFO ] [MAIN ] FCT: Loaded 14609 existing records. [2025-10-02T18:53:51.478783] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-10-02T18:53:51.603786] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:53:51.603991] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-02T18:53:51.604041] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-02T18:53:51.604984] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-10-02T18:53:51.605047] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-02T18:53:51.978119] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:52.273042] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-02T18:53:52.920046] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T18:53:53.073024] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-10-02T18:53:53.251349] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T18:53:53.872984] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-02T18:53:54.034412] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T18:53:54.292373] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-02T18:53:54.673043] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-02T18:53:55.112621] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-02T18:53:55.473001] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-02T18:53:55.820264] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-02T18:53:56.273007] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-02T18:53:56.752098] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T18:53:57.072996] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-02T18:53:57.873031] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-02T18:53:57.969720] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-02T18:53:57.971020] [INFO ] [REMOTE ] FCN: Full fetch complete (35653 records). [2025-10-02T18:53:57.971104] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-02T18:53:58.252781] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-02T18:53:58.379471] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-02T18:53:58.379562] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-02T18:53:58.380206] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-02T18:53:58.380274] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-02T18:53:58.381290] [DEBUG] [LOCAL ] FCN: Trimmed 35653 records to 26094 (keeping 200 days of data) [2025-10-02T18:53:58.543728] [DEBUG] [LOCAL ] FCN: Primary data saved (26094 records). [2025-10-02T18:53:58.543862] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-02T18:53:58.543947] [INFO ] [MAIN ] Update Progress: 811/2370 symbols completed. FCN took 36.2s. Estimated remaining: 3h 38m 59s. Rate: 7.1 symbols/min [2025-10-02T18:53:58.678176] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-02T18:53:58.725980] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:53:58.779209] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-10-02T18:53:58.779554] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-10-02T18:53:58.978808] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:53:58.979070] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-02T18:53:58.979129] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-02T18:53:58.981080] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-10-02T18:53:58.981144] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-02T18:53:59.187302] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-02T18:53:59.376762] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:53:59.473019] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-02T18:54:00.273036] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-02T18:54:01.023392] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T18:54:01.073035] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-02T18:54:01.348143] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T18:54:01.434283] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-02T18:54:01.873025] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-02T18:54:02.673025] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-02T18:54:03.020872] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-02T18:54:03.268038] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:54:03.473047] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-02T18:54:04.273040] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-02T18:54:04.293695] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T18:54:04.703023] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-02T18:54:05.072990] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-02T18:54:05.420221] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-02T18:54:05.420956] [INFO ] [REMOTE ] FCRX: Full fetch complete (1687 records). [2025-10-02T18:54:05.421029] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-02T18:54:05.626706] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-02T18:54:05.626986] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:54:05.627061] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:54:05.627142] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-02T18:54:05.627218] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-02T18:54:05.627260] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-02T18:54:05.627303] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-02T18:54:05.627375] [INFO ] [MAIN ] Update Progress: 812/2370 symbols completed. FCRX took 16.3s. Estimated remaining: 3h 38m 48s. Rate: 7.1 symbols/min [2025-10-02T18:54:05.808578] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:54:05.847242] [DEBUG] [LOCAL ] FDP: Loaded 30111 existing records from primary storage. [2025-10-02T18:54:05.847617] [INFO ] [MAIN ] FDP: Loaded 30111 existing records. [2025-10-02T18:54:05.878235] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-02T18:54:06.035707] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:54:06.036005] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-02T18:54:06.036135] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-02T18:54:06.037485] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-02T18:54:06.037550] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-02T18:54:06.397427] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:54:06.673061] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-10-02T18:54:07.056337] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T18:54:07.473070] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-10-02T18:54:08.273001] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-02T18:54:08.759196] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-10-02T18:54:08.761187] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T18:54:09.073028] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-02T18:54:09.841963] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T18:54:09.872982] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-02T18:54:09.911691] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-02T18:54:10.673004] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-02T18:54:11.473047] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-02T18:54:11.671348] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-02T18:54:11.851895] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-02T18:54:12.272979] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-02T18:54:12.766746] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T18:54:13.073033] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-02T18:54:13.873029] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-02T18:54:14.272909] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-02T18:54:14.646520] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T18:54:14.672997] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-02T18:54:14.691325] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T18:54:15.473030] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-02T18:54:16.140615] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T18:54:16.165031] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-02T18:54:16.273044] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-02T18:54:17.073013] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-02T18:54:17.873026] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-02T18:54:18.032940] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T18:54:18.234416] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T18:54:18.673024] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-02T18:54:19.199865] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T18:54:19.216326] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-02T18:54:19.473000] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-02T18:54:20.273009] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-02T18:54:20.451009] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T18:54:21.073008] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-02T18:54:21.651623] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-02T18:54:21.872996] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-02T18:54:22.672992] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-02T18:54:22.820236] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T18:54:22.821474] [INFO ] [REMOTE ] FCT: Full fetch complete (21142 records). [2025-10-02T18:54:22.821593] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-02T18:54:23.265297] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-02T18:54:23.265024] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-02T18:54:23.265517] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-02T18:54:23.281588] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-02T18:54:23.281843] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-02T18:54:23.283319] [DEBUG] [LOCAL ] FCT: Trimmed 21142 records to 14789 (keeping 200 days of data) [2025-10-02T18:54:23.376855] [DEBUG] [LOCAL ] FCT: Primary data saved (14789 records). [2025-10-02T18:54:23.377002] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-02T18:54:23.377083] [INFO ] [MAIN ] Update Progress: 813/2370 symbols completed. FCT took 32.2s. Estimated remaining: 3h 38m 57s. Rate: 7.1 symbols/min [2025-10-02T18:54:23.479007] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-02T18:54:23.557265] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:54:23.585622] [DEBUG] [LOCAL ] FDS: Loaded 26623 existing records from primary storage. [2025-10-02T18:54:23.585949] [INFO ] [MAIN ] FDS: Loaded 26623 existing records. [2025-10-02T18:54:23.785987] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:54:23.786248] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-02T18:54:23.786297] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-02T18:54:23.787373] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-02T18:54:23.787434] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-02T18:54:24.208000] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T18:54:24.212582] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:54:24.273012] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-02T18:54:25.072977] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-10-02T18:54:25.566238] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-02T18:54:25.637323] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T18:54:25.873001] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-02T18:54:26.306040] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T18:54:26.672999] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-02T18:54:27.473030] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-02T18:54:27.880441] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T18:54:27.881906] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T18:54:28.272999] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-02T18:54:28.420470] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T18:54:29.072991] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-02T18:54:29.872995] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-02T18:54:30.223034] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T18:54:30.678105] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-02T18:54:30.695417] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-10-02T18:54:31.121531] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T18:54:31.472965] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-02T18:54:31.961800] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-02T18:54:32.273034] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-02T18:54:32.619631] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T18:54:33.073014] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-02T18:54:33.606202] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T18:54:33.873004] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-02T18:54:34.672993] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-02T18:54:34.726455] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-02T18:54:35.106855] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T18:54:35.473061] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-02T18:54:35.877074] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T18:54:35.878983] [INFO ] [REMOTE ] FCPT: Full fetch complete (53794 records). [2025-10-02T18:54:35.879119] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-02T18:54:36.281477] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-02T18:54:36.315010] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-02T18:54:36.315160] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-02T18:54:36.316020] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-02T18:54:36.316089] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-02T18:54:36.317484] [DEBUG] [LOCAL ] FCPT: Trimmed 53794 records to 37618 (keeping 200 days of data) [2025-10-02T18:54:36.571718] [DEBUG] [LOCAL ] FCPT: Primary data saved (37618 records). [2025-10-02T18:54:36.571907] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-02T18:54:36.572868] [INFO ] [MAIN ] Update Progress: 814/2370 symbols completed. FCPT took 51.3s. Estimated remaining: 3h 38m 58s. Rate: 7.1 symbols/min [2025-10-02T18:54:36.787198] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:54:36.806412] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T18:54:36.866876] [DEBUG] [LOCAL ] FDX: Loaded 51582 existing records from primary storage. [2025-10-02T18:54:36.867288] [INFO ] [MAIN ] FDX: Loaded 51582 existing records. [2025-10-02T18:54:37.058133] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:54:37.058358] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-02T18:54:37.058412] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-02T18:54:37.060590] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-02T18:54:37.060681] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-02T18:54:37.082271] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-02T18:54:37.454825] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:54:37.748987] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T18:54:37.873004] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-02T18:54:38.370355] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T18:54:38.673010] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-02T18:54:39.472968] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-10-02T18:54:39.738694] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T18:54:39.742512] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T18:54:39.746867] [INFO ] [REMOTE ] FDP: Full fetch complete (42871 records). [2025-10-02T18:54:39.754137] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-02T18:54:40.157178] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-02T18:54:40.157281] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-02T18:54:40.157997] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-02T18:54:40.158063] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-02T18:54:40.159200] [DEBUG] [LOCAL ] FDP: Trimmed 42871 records to 30317 (keeping 200 days of data) [2025-10-02T18:54:40.274713] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-02T18:54:40.354310] [DEBUG] [LOCAL ] FDP: Primary data saved (30317 records). [2025-10-02T18:54:40.354461] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-02T18:54:40.354547] [INFO ] [MAIN ] Update Progress: 815/2370 symbols completed. FDP took 34.7s. Estimated remaining: 3h 38m 40s. Rate: 7.1 symbols/min [2025-10-02T18:54:40.544530] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:54:40.601178] [DEBUG] [LOCAL ] FE: Loaded 53430 existing records from primary storage. [2025-10-02T18:54:40.601542] [INFO ] [MAIN ] FE: Loaded 53430 existing records. [2025-10-02T18:54:40.799080] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:54:40.799337] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-02T18:54:40.799401] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-02T18:54:40.801143] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-02T18:54:40.801209] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-02T18:54:41.080169] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-02T18:54:41.215773] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:54:41.278776] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T18:54:41.872971] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-10-02T18:54:41.979624] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T18:54:41.981847] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-10-02T18:54:41.981983] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-02T18:54:42.295831] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T18:54:42.436969] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-02T18:54:42.437060] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-02T18:54:42.438215] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-02T18:54:42.438284] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-02T18:54:42.439872] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 54090 (keeping 200 days of data) [2025-10-02T18:54:42.673213] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-02T18:54:42.788956] [DEBUG] [LOCAL ] FCX: Primary data saved (54090 records). [2025-10-02T18:54:42.789099] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-02T18:54:42.789247] [INFO ] [MAIN ] Update Progress: 816/2370 symbols completed. FCX took 44.2s. Estimated remaining: 3h 38m 20s. Rate: 7.1 symbols/min [2025-10-02T18:54:42.975257] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:54:42.975447] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-02T18:54:42.975489] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-02T18:54:42.975606] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-02T18:54:42.975675] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-02T18:54:42.975742] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-02T18:54:42.975778] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-02T18:54:43.388398] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:54:43.424385] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T18:54:43.473060] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-02T18:54:44.026687] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:54:44.273053] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-10-02T18:54:44.647967] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-10-02T18:54:44.873387] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T18:54:45.072993] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-02T18:54:45.873003] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-02T18:54:46.661952] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T18:54:46.672945] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-02T18:54:47.472982] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-02T18:54:47.594316] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T18:54:48.254388] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T18:54:48.272960] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-02T18:54:48.351422] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T18:54:49.073002] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-02T18:54:49.873027] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-02T18:54:50.045026] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T18:54:50.299598] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T18:54:50.672970] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-02T18:54:50.920207] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T18:54:51.473015] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-02T18:54:51.810426] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:54:52.273018] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-02T18:54:53.072967] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-02T18:54:53.388183] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T18:54:53.500101] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-02T18:54:53.527960] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-02T18:54:53.873011] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-02T18:54:54.672997] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-02T18:54:54.967351] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-02T18:54:55.472975] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-02T18:54:55.798176] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T18:54:55.961866] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-02T18:54:56.273000] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-02T18:54:56.692057] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-02T18:54:57.073030] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-02T18:54:57.872994] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-02T18:54:58.672975] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-02T18:54:58.700666] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T18:54:58.947566] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-10-02T18:54:59.211460] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T18:54:59.473003] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-02T18:54:59.819255] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-02T18:55:00.273019] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-02T18:55:00.642804] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-02T18:55:01.072982] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-02T18:55:01.873061] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-02T18:55:02.673020] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-02T18:55:02.901905] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T18:55:03.472979] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-02T18:55:03.737971] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-10-02T18:55:03.840424] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T18:55:03.842024] [INFO ] [REMOTE ] FDS: Full fetch complete (37687 records). [2025-10-02T18:55:03.842120] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-02T18:55:04.255678] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-02T18:55:04.255789] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-02T18:55:04.256478] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-02T18:55:04.256542] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-02T18:55:04.257712] [DEBUG] [LOCAL ] FDS: Trimmed 37687 records to 26895 (keeping 200 days of data) [2025-10-02T18:55:04.318191] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-02T18:55:04.439879] [DEBUG] [LOCAL ] FDS: Primary data saved (26895 records). [2025-10-02T18:55:04.440025] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-02T18:55:04.440112] [INFO ] [MAIN ] Update Progress: 817/2370 symbols completed. FDS took 41.1s. Estimated remaining: 3h 38m 37s. Rate: 7.1 symbols/min [2025-10-02T18:55:04.634373] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:04.688275] [DEBUG] [LOCAL ] FERG: Loaded 48853 existing records from primary storage. [2025-10-02T18:55:04.688699] [INFO ] [MAIN ] FERG: Loaded 48853 existing records. [2025-10-02T18:55:04.894258] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:04.894547] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-02T18:55:04.894599] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-02T18:55:04.896480] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-02T18:55:04.896542] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-02T18:55:05.086942] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-02T18:55:05.345454] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:05.385984] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T18:55:05.479729] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-02T18:55:05.873015] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-02T18:55:06.356451] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-02T18:55:06.368824] [INFO ] [REMOTE ] FENG: Full fetch complete (2261 records). [2025-10-02T18:55:06.387841] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-02T18:55:06.404034] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-02T18:55:06.631411] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T18:55:06.631559] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T18:55:06.631663] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T18:55:06.631758] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-02T18:55:06.631833] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-02T18:55:06.631892] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-02T18:55:06.631938] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-02T18:55:06.632002] [INFO ] [MAIN ] Update Progress: 818/2370 symbols completed. FENG took 23.8s. Estimated remaining: 3h 38m 17s. Rate: 7.1 symbols/min [2025-10-02T18:55:06.678135] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-02T18:55:06.831524] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:06.847628] [DEBUG] [LOCAL ] FET: Loaded 12872 existing records from primary storage. [2025-10-02T18:55:06.847905] [INFO ] [MAIN ] FET: Loaded 12872 existing records. [2025-10-02T18:55:07.056240] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:07.056486] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-02T18:55:07.056544] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-02T18:55:07.057239] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-02T18:55:07.057306] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-02T18:55:07.475026] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-02T18:55:07.474839] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:08.272997] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-10-02T18:55:08.549793] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T18:55:09.072994] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-02T18:55:09.144822] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T18:55:09.427913] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-02T18:55:09.873056] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-02T18:55:10.672974] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-10-02T18:55:10.837839] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T18:55:11.472978] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-02T18:55:11.927614] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-02T18:55:12.039365] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T18:55:12.281414] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-02T18:55:12.309751] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T18:55:13.072997] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-02T18:55:13.186235] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T18:55:13.873004] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-02T18:55:14.673027] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-02T18:55:14.803210] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-02T18:55:14.805342] [INFO ] [REMOTE ] FDX: Full fetch complete (74454 records). [2025-10-02T18:55:14.805452] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-02T18:55:15.271630] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-10-02T18:55:15.271781] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-10-02T18:55:15.272730] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-10-02T18:55:15.272908] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-10-02T18:55:15.274499] [DEBUG] [LOCAL ] FDX: Trimmed 74454 records to 51922 (keeping 200 days of data) [2025-10-02T18:55:15.476531] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-02T18:55:15.656979] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T18:55:15.682773] [DEBUG] [LOCAL ] FDX: Primary data saved (51922 records). [2025-10-02T18:55:15.682932] [INFO ] [MAIN ] FDX: Full history saved. [2025-10-02T18:55:15.686260] [INFO ] [MAIN ] Update Progress: 819/2370 symbols completed. FDX took 39.1s. Estimated remaining: 3h 38m 10s. Rate: 7.1 symbols/min [2025-10-02T18:55:15.890278] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:15.918036] [DEBUG] [LOCAL ] FF: Loaded 24977 existing records from primary storage. [2025-10-02T18:55:15.918363] [INFO ] [MAIN ] FF: Loaded 24977 existing records. [2025-10-02T18:55:16.050079] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T18:55:16.078929] [INFO ] [REMOTE ] FE: Full fetch complete (77261 records). [2025-10-02T18:55:16.106935] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-02T18:55:16.140803] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:16.141115] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-02T18:55:16.141241] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-02T18:55:16.176130] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-02T18:55:16.212226] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-02T18:55:16.274086] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-02T18:55:16.634800] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T18:55:17.044469] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-02T18:55:17.045200] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-02T18:55:17.046963] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-02T18:55:17.047668] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-02T18:55:17.073697] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-02T18:55:17.073517] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:17.076382] [DEBUG] [LOCAL ] FE: Trimmed 77261 records to 53818 (keeping 200 days of data) [2025-10-02T18:55:17.417392] [DEBUG] [LOCAL ] FE: Primary data saved (53818 records). [2025-10-02T18:55:17.417546] [INFO ] [MAIN ] FE: Full history saved. [2025-10-02T18:55:17.417629] [INFO ] [MAIN ] Update Progress: 820/2370 symbols completed. FE took 37.1s. Estimated remaining: 3h 37m 48s. Rate: 7.1 symbols/min [2025-10-02T18:55:17.602762] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:17.610451] [DEBUG] [LOCAL ] FFA: Loaded 5856 existing records from primary storage. [2025-10-02T18:55:17.610698] [INFO ] [MAIN ] FFA: Loaded 5856 existing records. [2025-10-02T18:55:17.811511] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:17.811971] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-02T18:55:17.812141] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-02T18:55:17.812776] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-02T18:55:17.812884] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-02T18:55:17.881492] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-10-02T18:55:18.040079] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T18:55:18.117100] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-02T18:55:18.265829] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:18.672991] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-02T18:55:19.149898] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T18:55:19.473007] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-10-02T18:55:20.032010] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-02T18:55:20.272971] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-02T18:55:20.466260] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T18:55:21.072982] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-02T18:55:21.458366] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T18:55:21.872998] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-02T18:55:22.611708] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-02T18:55:22.673015] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-02T18:55:22.858826] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T18:55:23.401445] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T18:55:23.473010] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-02T18:55:24.273031] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-02T18:55:24.782230] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-02T18:55:25.072991] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-02T18:55:25.295296] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T18:55:25.672138] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T18:55:25.873017] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-02T18:55:26.673022] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-02T18:55:26.718472] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-02T18:55:27.128550] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-02T18:55:27.472997] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-02T18:55:28.272984] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-02T18:55:28.387262] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T18:55:29.072977] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-02T18:55:29.872985] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-02T18:55:30.075014] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T18:55:30.196875] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-02T18:55:30.457561] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T18:55:30.673022] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-02T18:55:31.472992] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-02T18:55:32.039415] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T18:55:32.273053] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-02T18:55:33.055846] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T18:55:33.072952] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-02T18:55:33.259748] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T18:55:33.435122] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-02T18:55:33.873035] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-02T18:55:34.466525] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T18:55:34.673015] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-02T18:55:35.419977] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T18:55:35.473077] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-02T18:55:36.272975] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-02T18:55:36.599395] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T18:55:37.072992] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-02T18:55:37.256992] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T18:55:37.873040] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-02T18:55:37.996998] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-02T18:55:38.673012] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-02T18:55:39.069205] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T18:55:39.472998] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-02T18:55:39.799776] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T18:55:40.273000] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-02T18:55:40.839318] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-02T18:55:41.072971] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-02T18:55:41.273171] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T18:55:41.842584] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T18:55:41.843774] [INFO ] [REMOTE ] FET: Full fetch complete (18353 records). [2025-10-02T18:55:41.843896] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-02T18:55:41.878202] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-02T18:55:42.276526] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-02T18:55:42.276637] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-02T18:55:42.277205] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-02T18:55:42.277300] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-02T18:55:42.278181] [DEBUG] [LOCAL ] FET: Trimmed 18353 records to 12979 (keeping 200 days of data) [2025-10-02T18:55:42.362867] [DEBUG] [LOCAL ] FET: Primary data saved (12979 records). [2025-10-02T18:55:42.363003] [INFO ] [MAIN ] FET: Full history saved. [2025-10-02T18:55:42.363145] [INFO ] [MAIN ] Update Progress: 821/2370 symbols completed. FET took 35.7s. Estimated remaining: 3h 38m 11s. Rate: 7.1 symbols/min [2025-10-02T18:55:42.545881] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:42.567858] [DEBUG] [LOCAL ] FFC: Loaded 16765 existing records from primary storage. [2025-10-02T18:55:42.568176] [INFO ] [MAIN ] FFC: Loaded 16765 existing records. [2025-10-02T18:55:42.678227] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-02T18:55:42.783620] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:42.783866] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-02T18:55:42.783923] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-02T18:55:42.784545] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-02T18:55:42.784625] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-02T18:55:43.050830] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T18:55:43.207737] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:43.473023] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-02T18:55:44.271331] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-02T18:55:44.273260] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-02T18:55:44.275269] [INFO ] [REMOTE ] FERG: Full fetch complete (70948 records). [2025-10-02T18:55:44.275390] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-02T18:55:44.545718] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T18:55:44.760616] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-02T18:55:44.760743] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-02T18:55:44.761716] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-02T18:55:44.761788] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-02T18:55:44.763366] [DEBUG] [LOCAL ] FERG: Trimmed 70948 records to 49230 (keeping 200 days of data) [2025-10-02T18:55:45.030024] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T18:55:45.093990] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-02T18:55:45.133197] [DEBUG] [LOCAL ] FERG: Primary data saved (49230 records). [2025-10-02T18:55:45.133377] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-02T18:55:45.133504] [INFO ] [MAIN ] Update Progress: 822/2370 symbols completed. FERG took 40.7s. Estimated remaining: 3h 37m 52s. Rate: 7.1 symbols/min [2025-10-02T18:55:45.330540] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:45.368620] [DEBUG] [LOCAL ] FFWM: Loaded 35720 existing records from primary storage. [2025-10-02T18:55:45.368984] [INFO ] [MAIN ] FFWM: Loaded 35720 existing records. [2025-10-02T18:55:45.587410] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:45.587638] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-02T18:55:45.587723] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-02T18:55:45.588745] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-02T18:55:45.588809] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-02T18:55:45.878339] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-02T18:55:45.904945] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-02T18:55:45.932918] [INFO ] [REMOTE ] FF: Full fetch complete (36734 records). [2025-10-02T18:55:45.933526] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-02T18:55:46.134143] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:46.428272] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-02T18:55:46.428364] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-02T18:55:46.428970] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-02T18:55:46.429034] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-02T18:55:46.430110] [DEBUG] [LOCAL ] FF: Trimmed 36734 records to 25097 (keeping 200 days of data) [2025-10-02T18:55:46.504800] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T18:55:46.538925] [INFO ] [REMOTE ] FFA: Full fetch complete (8518 records). [2025-10-02T18:55:46.544991] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-02T18:55:46.675919] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-10-02T18:55:46.947845] [DEBUG] [LOCAL ] FF: Primary data saved (25097 records). [2025-10-02T18:55:46.950922] [INFO ] [MAIN ] FF: Full history saved. [2025-10-02T18:55:46.951093] [INFO ] [MAIN ] Update Progress: 823/2370 symbols completed. FF took 31.3s. Estimated remaining: 3h 37m 31s. Rate: 7.1 symbols/min [2025-10-02T18:55:47.237916] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-02T18:55:47.254503] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-02T18:55:47.273307] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-02T18:55:47.279321] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-02T18:55:47.279083] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:47.280383] [DEBUG] [LOCAL ] FFA: Trimmed 8518 records to 5933 (keeping 200 days of data) [2025-10-02T18:55:47.339066] [DEBUG] [LOCAL ] FG: Loaded 22819 existing records from primary storage. [2025-10-02T18:55:47.339171] [DEBUG] [LOCAL ] FFA: Primary data saved (5933 records). [2025-10-02T18:55:47.339413] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-02T18:55:47.339695] [INFO ] [MAIN ] FG: Loaded 22819 existing records. [2025-10-02T18:55:47.339871] [INFO ] [MAIN ] Update Progress: 824/2370 symbols completed. FFA took 29.9s. Estimated remaining: 3h 37m 8s. Rate: 7.1 symbols/min [2025-10-02T18:55:47.482390] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-10-02T18:55:47.809879] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:55:47.831272] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:47.831772] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-02T18:55:47.831864] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-02T18:55:47.832899] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-02T18:55:47.833057] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-02T18:55:47.929945] [DEBUG] [LOCAL ] FGN: Loaded 3895 existing records from primary storage. [2025-10-02T18:55:47.952268] [INFO ] [MAIN ] FGN: Loaded 3895 existing records. [2025-10-02T18:55:48.393148] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:55:48.426431] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-02T18:55:48.449446] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-02T18:55:48.483089] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-10-02T18:55:48.484478] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T18:55:48.527175] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-02T18:55:48.526578] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:48.512282] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-02T18:55:48.791168] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T18:55:48.955577] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:55:49.072984] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-10-02T18:55:49.403972] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-02T18:55:49.873069] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-02T18:55:49.928400] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T18:55:50.372181] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-02T18:55:50.673028] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-10-02T18:55:51.405924] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-10-02T18:55:51.473004] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-02T18:55:52.273005] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-02T18:55:52.875031] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T18:55:53.072983] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-02T18:55:53.616023] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T18:55:53.873052] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-02T18:55:54.493275] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T18:55:54.642931] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T18:55:54.673041] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-02T18:55:55.044425] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-02T18:55:55.473007] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-02T18:55:56.273013] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-02T18:55:56.465109] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T18:55:57.073006] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-02T18:55:57.861980] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T18:55:57.872946] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-02T18:55:58.009370] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T18:55:58.673044] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-02T18:55:59.273172] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T18:55:59.351426] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T18:55:59.472991] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-02T18:56:00.273056] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-02T18:56:00.594015] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T18:56:01.072993] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-02T18:56:01.612177] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T18:56:01.873010] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-02T18:56:01.970113] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T18:56:02.623087] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T18:56:02.672996] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-02T18:56:03.473009] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-02T18:56:03.515694] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T18:56:04.272970] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-02T18:56:04.674457] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-02T18:56:05.072996] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-02T18:56:05.258638] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T18:56:05.873020] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-02T18:56:06.240801] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-02T18:56:06.595241] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T18:56:06.673005] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-02T18:56:07.473035] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-02T18:56:08.035407] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T18:56:08.105362] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T18:56:08.273047] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-02T18:56:09.072977] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-02T18:56:09.393612] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T18:56:09.873042] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-02T18:56:10.072609] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T18:56:10.493544] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-02T18:56:10.673021] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-02T18:56:10.991551] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-02T18:56:11.473033] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-02T18:56:12.273059] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-02T18:56:12.730214] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T18:56:13.072989] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-02T18:56:13.471267] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-02T18:56:13.698256] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T18:56:13.872996] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-02T18:56:14.673006] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-02T18:56:15.002394] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T18:56:15.004161] [INFO ] [REMOTE ] FFWM: Full fetch complete (51755 records). [2025-10-02T18:56:15.004289] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-02T18:56:15.435943] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-02T18:56:15.436266] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-02T18:56:15.437100] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-02T18:56:15.437168] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-02T18:56:15.438511] [DEBUG] [LOCAL ] FFWM: Trimmed 51755 records to 36004 (keeping 200 days of data) [2025-10-02T18:56:15.486091] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-02T18:56:15.652920] [DEBUG] [LOCAL ] FFWM: Primary data saved (36004 records). [2025-10-02T18:56:15.653112] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-02T18:56:15.653229] [INFO ] [MAIN ] Update Progress: 825/2370 symbols completed. FFWM took 30.5s. Estimated remaining: 3h 37m 36s. Rate: 7.1 symbols/min [2025-10-02T18:56:15.841380] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:15.841689] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-02T18:56:15.841759] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-02T18:56:15.841989] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-02T18:56:15.842099] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-02T18:56:15.842220] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-02T18:56:15.842263] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-02T18:56:16.174847] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T18:56:16.274873] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-02T18:56:16.275017] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T18:56:16.279915] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:16.282425] [INFO ] [REMOTE ] FFC: Full fetch complete (24737 records). [2025-10-02T18:56:16.282733] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-02T18:56:16.642717] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-02T18:56:16.732849] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-02T18:56:16.732955] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-02T18:56:16.733514] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-02T18:56:16.733562] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-02T18:56:16.734398] [DEBUG] [LOCAL ] FFC: Trimmed 24737 records to 16849 (keeping 200 days of data) [2025-10-02T18:56:16.856400] [DEBUG] [LOCAL ] FFC: Primary data saved (16849 records). [2025-10-02T18:56:16.856550] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-02T18:56:16.856638] [INFO ] [MAIN ] Update Progress: 826/2370 symbols completed. FFC took 34.5s. Estimated remaining: 3h 37m 14s. Rate: 7.1 symbols/min [2025-10-02T18:56:17.055455] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:17.073071] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-02T18:56:17.105195] [DEBUG] [LOCAL ] FHI: Loaded 40247 existing records from primary storage. [2025-10-02T18:56:17.105519] [INFO ] [MAIN ] FHI: Loaded 40247 existing records. [2025-10-02T18:56:17.303923] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:56:17.304140] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-02T18:56:17.304218] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-02T18:56:17.305709] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-02T18:56:17.305772] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-02T18:56:17.639198] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T18:56:17.656345] [INFO ] [REMOTE ] FGN: Full fetch complete (5783 records). [2025-10-02T18:56:17.666771] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-02T18:56:17.818681] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:17.878120] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-10-02T18:56:18.136299] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-10-02T18:56:18.136457] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-10-02T18:56:18.136673] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-10-02T18:56:18.136741] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-10-02T18:56:18.137233] [DEBUG] [LOCAL ] FGN: Trimmed 5783 records to 3909 (keeping 200 days of data) [2025-10-02T18:56:18.152872] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:56:18.161495] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-10-02T18:56:18.168760] [DEBUG] [LOCAL ] FGN: Primary data saved (3909 records). [2025-10-02T18:56:18.169025] [INFO ] [MAIN ] FGN: Full history saved. [2025-10-02T18:56:18.168931] [FATAL] [REMOTE ] FGSN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:56:18.169248] [INFO ] [MAIN ] Update Progress: 827/2370 symbols completed. FGN took 30.8s. Estimated remaining: 3h 36m 53s. Rate: 7.1 symbols/min [2025-10-02T18:56:18.174780] [FATAL] [MAIN ] FGSN: Failed to fetch primary data. [2025-10-02T18:56:18.238025] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:56:18.250307] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-02T18:56:18.278828] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-02T18:56:18.279034] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-02T18:56:18.279409] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-02T18:56:18.285026] [INFO ] [MAIN ] Update Progress: 828/2370 symbols completed. FGSN took 2.6s. Estimated remaining: 3h 36m 29s. Rate: 7.1 symbols/min [2025-10-02T18:56:18.487424] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:18.579682] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:18.642162] [DEBUG] [LOCAL ] FHN: Loaded 53365 existing records from primary storage. [2025-10-02T18:56:18.642502] [INFO ] [MAIN ] FHN: Loaded 53365 existing records. [2025-10-02T18:56:18.677462] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-10-02T18:56:18.882141] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:56:18.882431] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-02T18:56:18.882485] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-02T18:56:18.885353] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-02T18:56:18.885436] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-02T18:56:18.885271] [DEBUG] [LOCAL ] FI: Loaded 53499 existing records from primary storage. [2025-10-02T18:56:18.954914] [INFO ] [MAIN ] FI: Loaded 53499 existing records. [2025-10-02T18:56:19.403956] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:56:19.434764] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-02T18:56:19.450463] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-02T18:56:19.473419] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-02T18:56:19.508330] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-02T18:56:19.514596] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:19.514680] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-02T18:56:19.918235] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:20.203399] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T18:56:20.272998] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-02T18:56:20.644550] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T18:56:21.072994] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-10-02T18:56:21.847767] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T18:56:21.872996] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-10-02T18:56:22.672987] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-02T18:56:22.810013] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:56:23.472987] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-02T18:56:23.675003] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T18:56:23.759532] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T18:56:24.272998] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-02T18:56:24.591739] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T18:56:25.072994] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-02T18:56:25.872985] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-02T18:56:26.025048] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T18:56:26.658830] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T18:56:26.672953] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-02T18:56:26.799036] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-02T18:56:27.473001] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-02T18:56:28.112213] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T18:56:28.273041] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-02T18:56:29.072982] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-02T18:56:29.214629] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T18:56:29.296598] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T18:56:29.873069] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-02T18:56:30.440692] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T18:56:30.673099] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-02T18:56:31.472986] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-02T18:56:31.543191] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T18:56:31.544417] [INFO ] [REMOTE ] FG: Full fetch complete (27709 records). [2025-10-02T18:56:31.544497] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-02T18:56:31.924190] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-02T18:56:32.018807] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-02T18:56:32.018891] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-02T18:56:32.019469] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-02T18:56:32.019510] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-02T18:56:32.020279] [DEBUG] [LOCAL ] FG: Trimmed 27709 records to 22965 (keeping 200 days of data) [2025-10-02T18:56:32.167754] [DEBUG] [LOCAL ] FG: Primary data saved (22965 records). [2025-10-02T18:56:32.167893] [INFO ] [MAIN ] FG: Full history saved. [2025-10-02T18:56:32.167977] [INFO ] [MAIN ] Update Progress: 829/2370 symbols completed. FG took 45.2s. Estimated remaining: 3h 36m 30s. Rate: 7.1 symbols/min [2025-10-02T18:56:32.276594] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-02T18:56:32.357395] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:32.378671] [DEBUG] [LOCAL ] FICO: Loaded 20486 existing records from primary storage. [2025-10-02T18:56:32.378952] [INFO ] [MAIN ] FICO: Loaded 20486 existing records. [2025-10-02T18:56:32.578396] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:56:32.578636] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-02T18:56:32.578724] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-02T18:56:32.579499] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-02T18:56:32.579560] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-02T18:56:32.995522] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:33.073046] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-10-02T18:56:33.113130] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T18:56:33.872991] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-02T18:56:33.956282] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T18:56:34.043463] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T18:56:34.673019] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-02T18:56:35.280186] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T18:56:35.473026] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-02T18:56:36.273011] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-02T18:56:36.470333] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T18:56:36.563174] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T18:56:37.073030] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-02T18:56:37.872984] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-02T18:56:37.951564] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T18:56:37.979858] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T18:56:38.673045] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-02T18:56:39.098664] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T18:56:39.473000] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-02T18:56:40.242272] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-02T18:56:40.272969] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-02T18:56:40.500762] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T18:56:41.073018] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-02T18:56:41.365923] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T18:56:41.872992] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-02T18:56:42.428462] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T18:56:42.673009] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-02T18:56:42.801499] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T18:56:43.473012] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-02T18:56:44.068227] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T18:56:44.070097] [INFO ] [REMOTE ] FHI: Full fetch complete (57756 records). [2025-10-02T18:56:44.070297] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-02T18:56:44.278593] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-02T18:56:44.507622] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-02T18:56:44.507762] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-02T18:56:44.508712] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-02T18:56:44.508782] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-02T18:56:44.510220] [DEBUG] [LOCAL ] FHI: Trimmed 57756 records to 40514 (keeping 200 days of data) [2025-10-02T18:56:44.774424] [DEBUG] [LOCAL ] FHI: Primary data saved (40514 records). [2025-10-02T18:56:44.774556] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-02T18:56:44.774672] [INFO ] [MAIN ] Update Progress: 830/2370 symbols completed. FHI took 27.9s. Estimated remaining: 3h 36m 30s. Rate: 7.1 symbols/min [2025-10-02T18:56:44.968451] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:44.968940] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-02T18:56:44.969182] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-02T18:56:44.969391] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-02T18:56:44.969506] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-02T18:56:44.969624] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-02T18:56:44.969783] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-02T18:56:45.073831] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-02T18:56:45.347260] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-02T18:56:45.449637] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:45.468459] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T18:56:45.873018] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-10-02T18:56:46.200260] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-02T18:56:46.673006] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-02T18:56:47.024290] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-02T18:56:47.473053] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-02T18:56:48.016190] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T18:56:48.273034] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-02T18:56:49.072985] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-02T18:56:49.460811] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T18:56:49.872966] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-02T18:56:49.983901] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T18:56:50.215998] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T18:56:50.673041] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-02T18:56:51.481350] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-02T18:56:51.500169] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T18:56:52.272999] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-02T18:56:52.432967] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T18:56:52.561288] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T18:56:53.073043] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-02T18:56:53.305968] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-02T18:56:53.873008] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-02T18:56:54.168719] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-02T18:56:54.184112] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-02T18:56:54.672995] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-02T18:56:54.910192] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-02T18:56:55.473060] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-02T18:56:55.710137] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-02T18:56:56.273010] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-02T18:56:56.570001] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-02T18:56:57.073029] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-02T18:56:57.873011] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-02T18:56:58.444107] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T18:56:58.445803] [INFO ] [REMOTE ] FICO: Full fetch complete (28702 records). [2025-10-02T18:56:58.445895] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-02T18:56:58.680949] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-02T18:56:58.862735] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-10-02T18:56:58.862826] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-10-02T18:56:58.863447] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-10-02T18:56:58.863521] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-10-02T18:56:58.864298] [DEBUG] [LOCAL ] FICO: Trimmed 28702 records to 20838 (keeping 200 days of data) [2025-10-02T18:56:59.002247] [DEBUG] [LOCAL ] FICO: Primary data saved (20838 records). [2025-10-02T18:56:59.002377] [INFO ] [MAIN ] FICO: Full history saved. [2025-10-02T18:56:59.002460] [INFO ] [MAIN ] Update Progress: 831/2370 symbols completed. FICO took 26.8s. Estimated remaining: 3h 36m 32s. Rate: 7.1 symbols/min [2025-10-02T18:56:59.178744] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:56:59.229400] [DEBUG] [LOCAL ] FIGS: Loaded 48826 existing records from primary storage. [2025-10-02T18:56:59.229742] [INFO ] [MAIN ] FIGS: Loaded 48826 existing records. [2025-10-02T18:56:59.445844] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:56:59.446046] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-02T18:56:59.446093] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-02T18:56:59.447997] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-02T18:56:59.448058] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-02T18:56:59.486957] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-02T18:56:59.758873] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:56:59.763928] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-02T18:56:59.790532] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:56:59.813744] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-02T18:56:59.845980] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:56:59.846116] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-02T18:56:59.853359] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-02T18:56:59.853505] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-02T18:56:59.853154] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:56:59.854053] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-02T18:56:59.854199] [INFO ] [MAIN ] Update Progress: 832/2370 symbols completed. FIG took 15.1s. Estimated remaining: 3h 36m 10s. Rate: 7.1 symbols/min [2025-10-02T18:57:00.077365] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:00.080791] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-02T18:57:00.140984] [DEBUG] [LOCAL ] FIHL: Loaded 39863 existing records from primary storage. [2025-10-02T18:57:00.141307] [INFO ] [MAIN ] FIHL: Loaded 39863 existing records. [2025-10-02T18:57:00.278194] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-02T18:57:00.342001] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:57:00.342386] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-02T18:57:00.342458] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-02T18:57:00.346026] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-02T18:57:00.346093] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-02T18:57:00.681871] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T18:57:00.809164] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:57:01.073023] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-10-02T18:57:01.873045] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-10-02T18:57:02.265774] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-02T18:57:02.672974] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-02T18:57:03.097280] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T18:57:03.136307] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-10-02T18:57:03.473005] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-02T18:57:04.272967] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-02T18:57:04.495693] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T18:57:04.497922] [INFO ] [REMOTE ] FI: Full fetch complete (77175 records). [2025-10-02T18:57:04.498050] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-02T18:57:04.950759] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-02T18:57:04.950953] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-02T18:57:04.951982] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-02T18:57:04.952068] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-02T18:57:04.953927] [DEBUG] [LOCAL ] FI: Trimmed 77175 records to 53888 (keeping 200 days of data) [2025-10-02T18:57:05.078154] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T18:57:05.073726] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-02T18:57:05.339820] [DEBUG] [LOCAL ] FI: Primary data saved (53888 records). [2025-10-02T18:57:05.339967] [INFO ] [MAIN ] FI: Full history saved. [2025-10-02T18:57:05.341217] [INFO ] [MAIN ] Update Progress: 833/2370 symbols completed. FI took 47.0s. Estimated remaining: 3h 35m 56s. Rate: 7.1 symbols/min [2025-10-02T18:57:05.532572] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:05.544592] [DEBUG] [LOCAL ] FINS: Loaded 8293 existing records from primary storage. [2025-10-02T18:57:05.544880] [INFO ] [MAIN ] FINS: Loaded 8293 existing records. [2025-10-02T18:57:05.754321] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:57:05.754618] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-02T18:57:05.754725] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-02T18:57:05.755262] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-02T18:57:05.755324] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-02T18:57:05.875242] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-02T18:57:06.152284] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T18:57:06.195387] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:57:06.424597] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T18:57:06.673014] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-02T18:57:07.239764] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T18:57:07.241910] [INFO ] [REMOTE ] FHN: Full fetch complete (77281 records). [2025-10-02T18:57:07.242020] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-02T18:57:07.478230] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-10-02T18:57:07.689837] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-02T18:57:07.689943] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-02T18:57:07.691144] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-02T18:57:07.691214] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-02T18:57:07.693024] [DEBUG] [LOCAL ] FHN: Trimmed 77281 records to 53755 (keeping 200 days of data) [2025-10-02T18:57:08.057822] [DEBUG] [LOCAL ] FHN: Primary data saved (53755 records). [2025-10-02T18:57:08.057979] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-02T18:57:08.058070] [INFO ] [MAIN ] Update Progress: 834/2370 symbols completed. FHN took 49.9s. Estimated remaining: 3h 35m 37s. Rate: 7.1 symbols/min [2025-10-02T18:57:08.248637] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:08.275725] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-02T18:57:08.277258] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T18:57:08.328681] [DEBUG] [LOCAL ] FINV: Loaded 45304 existing records from primary storage. [2025-10-02T18:57:08.329054] [INFO ] [MAIN ] FINV: Loaded 45304 existing records. [2025-10-02T18:57:08.511069] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T18:57:08.534276] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:57:08.538961] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-02T18:57:08.539025] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-02T18:57:08.540637] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-02T18:57:08.540723] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-02T18:57:08.998740] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:57:09.073003] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-02T18:57:09.574250] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T18:57:09.872999] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-10-02T18:57:10.684802] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-02T18:57:10.688761] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-02T18:57:11.473001] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-02T18:57:11.724911] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T18:57:12.273069] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-02T18:57:13.060570] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-10-02T18:57:13.081925] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-02T18:57:13.105403] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T18:57:13.814707] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T18:57:13.873025] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-02T18:57:14.552932] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T18:57:14.585963] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:57:14.673019] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-02T18:57:15.473013] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-02T18:57:16.282639] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-02T18:57:16.288278] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T18:57:17.006331] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T18:57:17.073011] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-02T18:57:17.673483] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T18:57:17.873009] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-02T18:57:18.673006] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-02T18:57:18.774412] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T18:57:19.289458] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T18:57:19.472995] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-02T18:57:19.734184] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T18:57:20.273004] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-02T18:57:20.783226] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-02T18:57:20.924348] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T18:57:21.072999] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-02T18:57:21.872999] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-02T18:57:22.476283] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T18:57:22.673452] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-02T18:57:22.680509] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T18:57:23.473010] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-02T18:57:24.163779] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T18:57:24.272997] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-02T18:57:24.785751] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T18:57:25.073042] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-02T18:57:25.143912] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T18:57:25.872995] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-02T18:57:26.293448] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T18:57:26.672997] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-02T18:57:27.473043] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-02T18:57:27.640597] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T18:57:27.686582] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-02T18:57:28.273045] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-02T18:57:28.911778] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T18:57:29.079374] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-02T18:57:29.105166] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T18:57:29.873044] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-02T18:57:30.673054] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-02T18:57:30.903302] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T18:57:31.473005] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-02T18:57:31.528301] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T18:57:32.199893] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T18:57:32.273041] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-02T18:57:32.892188] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T18:57:32.921021] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T18:57:33.073020] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-02T18:57:33.666246] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T18:57:33.872993] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-02T18:57:34.500283] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-02T18:57:34.673078] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-02T18:57:35.473002] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-02T18:57:35.910959] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T18:57:35.913018] [INFO ] [REMOTE ] FIHL: Full fetch complete (55807 records). [2025-10-02T18:57:35.913120] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-02T18:57:36.283929] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-02T18:57:36.341704] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-02T18:57:36.341805] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-02T18:57:36.342613] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-02T18:57:36.342700] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-02T18:57:36.343942] [DEBUG] [LOCAL ] FIHL: Trimmed 55807 records to 40141 (keeping 200 days of data) [2025-10-02T18:57:36.616993] [DEBUG] [LOCAL ] FIHL: Primary data saved (40141 records). [2025-10-02T18:57:36.617206] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-02T18:57:36.617321] [INFO ] [MAIN ] Update Progress: 835/2370 symbols completed. FIHL took 36.8s. Estimated remaining: 3h 36m 5s. Rate: 7.1 symbols/min [2025-10-02T18:57:36.806033] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:36.862243] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T18:57:36.864343] [DEBUG] [LOCAL ] FIS: Loaded 53361 existing records from primary storage. [2025-10-02T18:57:36.864609] [INFO ] [REMOTE ] FINS: Full fetch complete (12314 records). [2025-10-02T18:57:36.864829] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-02T18:57:36.865254] [INFO ] [MAIN ] FIS: Loaded 53361 existing records. [2025-10-02T18:57:37.078322] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-02T18:57:37.265419] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:57:37.313903] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-02T18:57:37.371639] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-02T18:57:37.429967] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-02T18:57:37.445591] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-02T18:57:37.594299] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-02T18:57:37.637520] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-02T18:57:37.638683] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-02T18:57:37.643956] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-02T18:57:37.661885] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T18:57:37.696528] [DEBUG] [LOCAL ] FINS: Trimmed 12314 records to 8316 (keeping 200 days of data) [2025-10-02T18:57:37.878207] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-02T18:57:38.009873] [DEBUG] [LOCAL ] FINS: Primary data saved (8316 records). [2025-10-02T18:57:38.029387] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-02T18:57:38.044286] [INFO ] [MAIN ] Update Progress: 836/2370 symbols completed. FINS took 32.7s. Estimated remaining: 3h 35m 44s. Rate: 7.1 symbols/min [2025-10-02T18:57:38.044173] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:57:38.242028] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:38.273400] [DEBUG] [LOCAL ] FIX: Loaded 29792 existing records from primary storage. [2025-10-02T18:57:38.273725] [INFO ] [MAIN ] FIX: Loaded 29792 existing records. [2025-10-02T18:57:38.475689] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:57:38.475917] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-02T18:57:38.475968] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-02T18:57:38.479112] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-02T18:57:38.479221] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-02T18:57:38.609269] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-02T18:57:38.640007] [INFO ] [REMOTE ] FIGS: Full fetch complete (71008 records). [2025-10-02T18:57:38.697608] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-10-02T18:57:38.698001] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-02T18:57:39.193068] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:57:39.287088] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T18:57:39.327379] [INFO ] [REMOTE ] FINV: Full fetch complete (63567 records). [2025-10-02T18:57:39.339569] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-02T18:57:39.378857] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-02T18:57:39.378963] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-02T18:57:39.379923] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-02T18:57:39.380047] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-02T18:57:39.482368] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-10-02T18:57:39.495332] [DEBUG] [LOCAL ] FIGS: Trimmed 71008 records to 49208 (keeping 200 days of data) [2025-10-02T18:57:39.910460] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-02T18:57:39.910924] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-02T18:57:39.912394] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-02T18:57:39.912845] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-02T18:57:39.918261] [DEBUG] [LOCAL ] FINV: Trimmed 63567 records to 45625 (keeping 200 days of data) [2025-10-02T18:57:40.344768] [DEBUG] [LOCAL ] FIGS: Primary data saved (49208 records). [2025-10-02T18:57:40.346429] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-02T18:57:40.348051] [INFO ] [MAIN ] Update Progress: 837/2370 symbols completed. FIGS took 41.3s. Estimated remaining: 3h 35m 24s. Rate: 7.1 symbols/min [2025-10-02T18:57:40.399303] [DEBUG] [LOCAL ] FINV: Primary data saved (45625 records). [2025-10-02T18:57:40.399519] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-02T18:57:40.399691] [INFO ] [MAIN ] Update Progress: 838/2370 symbols completed. FINV took 32.3s. Estimated remaining: 3h 35m 1s. Rate: 7.1 symbols/min [2025-10-02T18:57:40.531837] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T18:57:40.543877] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-02T18:57:40.564226] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T18:57:41.073035] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-02T18:57:42.347877] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T18:57:42.360474] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-02T18:57:42.505078] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T18:57:42.673002] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-02T18:57:44.130569] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-02T18:57:44.141099] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-02T18:57:44.623586] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-10-02T18:57:44.632182] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-02T18:57:45.594514] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-02T18:57:45.607790] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-02T18:57:45.944862] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T18:57:45.954027] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-02T18:57:47.367020] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T18:57:47.378789] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-02T18:57:47.452239] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T18:57:47.472990] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-02T18:57:48.995605] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T18:57:49.002868] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-02T18:57:49.281345] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-02T18:57:49.292900] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-02T18:57:50.226091] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T18:57:50.233500] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-02T18:57:51.043884] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T18:57:51.055983] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-02T18:57:51.597723] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T18:57:51.605035] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-02T18:57:52.871086] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-02T18:57:52.878605] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-02T18:57:52.927786] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T18:57:53.073067] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-02T18:57:53.965137] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T18:57:53.972073] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-02T18:57:54.512585] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T18:57:54.673032] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-02T18:57:55.264089] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T18:57:55.265896] [INFO ] [REMOTE ] FIX: Full fetch complete (45479 records). [2025-10-02T18:57:55.266013] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-02T18:57:55.703876] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-02T18:57:55.703980] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-02T18:57:55.704709] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-02T18:57:55.704776] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-02T18:57:55.706382] [DEBUG] [LOCAL ] FIX: Trimmed 45479 records to 29974 (keeping 200 days of data) [2025-10-02T18:57:55.923884] [DEBUG] [LOCAL ] FIX: Primary data saved (29974 records). [2025-10-02T18:57:55.924027] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-02T18:57:55.924113] [INFO ] [MAIN ] Update Progress: 839/2370 symbols completed. FIX took 17.9s. Estimated remaining: 3h 35m 5s. Rate: 7.1 symbols/min [2025-10-02T18:57:56.554609] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T18:57:56.566985] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-02T18:57:58.019172] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T18:57:58.024729] [INFO ] [REMOTE ] FIS: Full fetch complete (77180 records). [2025-10-02T18:57:58.024915] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-02T18:57:58.468792] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-02T18:57:58.468876] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-02T18:57:58.469794] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-02T18:57:58.469861] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-02T18:57:58.471627] [DEBUG] [LOCAL ] FIS: Trimmed 77180 records to 53751 (keeping 200 days of data) [2025-10-02T18:57:58.828973] [DEBUG] [LOCAL ] FIS: Primary data saved (53751 records). [2025-10-02T18:57:58.829140] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-02T18:57:58.829292] [INFO ] [MAIN ] Update Progress: 840/2370 symbols completed. FIS took 22.2s. Estimated remaining: 3h 34m 47s. Rate: 7.1 symbols/min [2025-10-02T18:57:59.514966] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:59.550588] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:59.611696] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:59.610398] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-02T18:57:59.612795] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-02T18:57:59.639746] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:57:59.640295] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-02T18:57:59.640524] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-02T18:57:59.640996] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-02T18:57:59.641107] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-02T18:57:59.748861] [DEBUG] [LOCAL ] FLC: Loaded 5422 existing records from primary storage. [2025-10-02T18:57:59.779186] [INFO ] [MAIN ] FLC: Loaded 5422 existing records. [2025-10-02T18:58:00.067165] [DEBUG] [LOCAL ] FLNG: Loaded 33707 existing records from primary storage. [2025-10-02T18:58:00.094550] [DEBUG] [LOCAL ] FLG: Loaded 53320 existing records from primary storage. [2025-10-02T18:58:00.137852] [INFO ] [MAIN ] FLNG: Loaded 33707 existing records. [2025-10-02T18:58:00.137712] [INFO ] [MAIN ] FLG: Loaded 53320 existing records. [2025-10-02T18:58:00.553929] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:00.574334] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-02T18:58:00.550710] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:00.574851] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-10-02T18:58:00.575165] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-02T18:58:00.643845] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-02T18:58:00.649630] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-02T18:58:00.822055] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:00.874858] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-02T18:58:00.923184] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-02T18:58:00.922938] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:00.939229] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-02T18:58:00.939323] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-02T18:58:00.965301] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-02T18:58:00.944499] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-02T18:58:00.982029] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-02T18:58:00.988638] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:58:00.988723] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-02T18:58:01.048162] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-10-02T18:58:01.097840] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:58:01.133993] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-02T18:58:01.218525] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:58:01.376786] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-02T18:58:01.428136] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-02T18:58:01.525697] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-02T18:58:01.651302] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-02T18:58:01.665638] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:01.720906] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-10-02T18:58:01.726239] [INFO ] [MAIN ] Update Progress: 841/2370 symbols completed. FIXT took 2.9s. Estimated remaining: 3h 34m 28s. Rate: 7.1 symbols/min [2025-10-02T18:58:02.155059] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:02.227376] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-10-02T18:58:02.227039] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:02.246584] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-10-02T18:58:02.246328] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:58:02.311888] [DEBUG] [LOCAL ] FLO: Loaded 51910 existing records from primary storage. [2025-10-02T18:58:02.312211] [INFO ] [MAIN ] FLO: Loaded 51910 existing records. [2025-10-02T18:58:02.503256] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:02.503580] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-02T18:58:02.503774] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-02T18:58:02.508596] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-02T18:58:02.509203] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-02T18:58:02.509403] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T18:58:02.545934] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-02T18:58:02.900448] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:02.900781] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-10-02T18:58:03.066578] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T18:58:03.068470] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-02T18:58:03.381334] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T18:58:03.389458] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-02T18:58:03.668053] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T18:58:03.669713] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-02T18:58:04.068518] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-10-02T18:58:04.079718] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-02T18:58:04.152298] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-02T18:58:04.272991] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-02T18:58:04.351353] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T18:58:04.782159] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T18:58:04.996234] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T18:58:05.072991] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-02T18:58:05.873051] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-02T18:58:05.931999] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T18:58:06.505626] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T18:58:06.673074] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-02T18:58:07.307073] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:58:07.473009] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-02T18:58:08.102536] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T18:58:08.145523] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-02T18:58:08.273067] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-02T18:58:09.073051] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-02T18:58:09.703423] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-02T18:58:09.873039] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-02T18:58:09.911712] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T18:58:10.673044] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-02T18:58:11.364473] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T18:58:11.473004] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-02T18:58:12.273004] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-02T18:58:12.487181] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T18:58:12.779530] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-02T18:58:13.073021] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-02T18:58:13.762666] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T18:58:13.873003] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-02T18:58:14.036835] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T18:58:14.563347] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T18:58:14.673014] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-02T18:58:15.473036] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-02T18:58:16.273031] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-02T18:58:16.537665] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:58:16.774161] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T18:58:16.868199] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-02T18:58:17.072995] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-02T18:58:17.872999] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-02T18:58:18.400337] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T18:58:18.673006] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-02T18:58:19.135441] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T18:58:19.136283] [INFO ] [REMOTE ] FLC: Full fetch complete (7952 records). [2025-10-02T18:58:19.136377] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-02T18:58:19.483875] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-02T18:58:19.533103] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-02T18:58:19.533295] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-02T18:58:19.533528] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-02T18:58:19.533573] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-02T18:58:19.534072] [DEBUG] [LOCAL ] FLC: Trimmed 7952 records to 5441 (keeping 200 days of data) [2025-10-02T18:58:19.571864] [DEBUG] [LOCAL ] FLC: Primary data saved (5441 records). [2025-10-02T18:58:19.572010] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-02T18:58:19.572131] [INFO ] [MAIN ] Update Progress: 842/2370 symbols completed. FLC took 20.7s. Estimated remaining: 3h 34m 37s. Rate: 7.1 symbols/min [2025-10-02T18:58:19.764532] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:58:19.765046] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-02T18:58:19.765148] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-02T18:58:19.765426] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-02T18:58:19.765603] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-02T18:58:19.765775] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-02T18:58:19.765844] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-02T18:58:19.968473] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-02T18:58:20.216209] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:20.272984] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-10-02T18:58:20.457986] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T18:58:20.458374] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-10-02T18:58:20.458468] [FATAL] [REMOTE ] FLOC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T18:58:20.458549] [FATAL] [MAIN ] FLOC: Failed to fetch primary data. [2025-10-02T18:58:20.458616] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T18:58:20.458710] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-02T18:58:20.458775] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-02T18:58:20.458813] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-02T18:58:20.458853] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-02T18:58:20.458902] [INFO ] [MAIN ] Update Progress: 843/2370 symbols completed. FLOC took 0.9s. Estimated remaining: 3h 34m 15s. Rate: 7.1 symbols/min [2025-10-02T18:58:20.643287] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:58:20.703090] [DEBUG] [LOCAL ] FLR: Loaded 53125 existing records from primary storage. [2025-10-02T18:58:20.703472] [INFO ] [MAIN ] FLR: Loaded 53125 existing records. [2025-10-02T18:58:20.912319] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:20.912536] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-02T18:58:20.912587] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-02T18:58:20.914782] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-02T18:58:20.914854] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-02T18:58:21.080275] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-02T18:58:21.315931] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:21.346521] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T18:58:21.873020] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-02T18:58:22.672984] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-02T18:58:22.675308] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T18:58:23.473020] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-10-02T18:58:23.646597] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T18:58:24.077751] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T18:58:24.273000] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-02T18:58:25.072999] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-02T18:58:25.212282] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T18:58:25.872967] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-02T18:58:26.189730] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T18:58:26.504877] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T18:58:26.673044] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-02T18:58:27.277146] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T18:58:27.473021] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-02T18:58:28.154382] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T18:58:28.272997] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-02T18:58:29.072971] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-02T18:58:29.108706] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T18:58:29.714808] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T18:58:29.872999] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-02T18:58:30.673042] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-02T18:58:30.848625] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T18:58:31.473029] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-02T18:58:31.530991] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T18:58:31.631168] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:58:31.632611] [INFO ] [REMOTE ] FLNG: Full fetch complete (50599 records). [2025-10-02T18:58:31.632758] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-02T18:58:32.066338] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-02T18:58:32.066424] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-02T18:58:32.067217] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-02T18:58:32.067283] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-02T18:58:32.068548] [DEBUG] [LOCAL ] FLNG: Trimmed 50599 records to 33928 (keeping 200 days of data) [2025-10-02T18:58:32.286591] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-02T18:58:32.316956] [DEBUG] [LOCAL ] FLNG: Primary data saved (33928 records). [2025-10-02T18:58:32.317111] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-02T18:58:32.317216] [INFO ] [MAIN ] Update Progress: 844/2370 symbols completed. FLNG took 33.5s. Estimated remaining: 3h 34m 13s. Rate: 7.1 symbols/min [2025-10-02T18:58:32.518170] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:58:32.566257] [DEBUG] [LOCAL ] FLS: Loaded 50175 existing records from primary storage. [2025-10-02T18:58:32.566719] [INFO ] [MAIN ] FLS: Loaded 50175 existing records. [2025-10-02T18:58:32.779372] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:32.779615] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-02T18:58:32.779695] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-02T18:58:32.782434] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-02T18:58:32.782503] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-02T18:58:33.084781] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-02T18:58:33.219758] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:33.254353] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T18:58:33.664932] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T18:58:33.667285] [INFO ] [REMOTE ] FLG: Full fetch complete (77307 records). [2025-10-02T18:58:33.667488] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-02T18:58:33.881583] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-02T18:58:34.101136] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-02T18:58:34.101223] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-02T18:58:34.102234] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-02T18:58:34.102305] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-02T18:58:34.103929] [DEBUG] [LOCAL ] FLG: Trimmed 77307 records to 53710 (keeping 200 days of data) [2025-10-02T18:58:34.468553] [DEBUG] [LOCAL ] FLG: Primary data saved (53710 records). [2025-10-02T18:58:34.468736] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-02T18:58:34.468837] [INFO ] [MAIN ] Update Progress: 845/2370 symbols completed. FLG took 35.6s. Estimated remaining: 3h 33m 53s. Rate: 7.1 symbols/min [2025-10-02T18:58:34.666265] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:58:34.672970] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-10-02T18:58:34.716891] [DEBUG] [LOCAL ] FLUT: Loaded 50788 existing records from primary storage. [2025-10-02T18:58:34.717415] [INFO ] [MAIN ] FLUT: Loaded 50788 existing records. [2025-10-02T18:58:34.926624] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:34.926934] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-02T18:58:34.927040] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-02T18:58:34.939779] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-02T18:58:34.958830] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-02T18:58:35.036219] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T18:58:35.376619] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:35.473005] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-02T18:58:35.703025] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T18:58:35.920785] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T18:58:36.273005] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-10-02T18:58:37.072988] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-02T18:58:37.294811] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T18:58:37.872984] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-02T18:58:37.972274] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:58:38.228463] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T18:58:38.673021] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-02T18:58:39.355015] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T18:58:39.473024] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-02T18:58:40.272981] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-02T18:58:40.530209] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T18:58:40.830868] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T18:58:41.073000] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-02T18:58:41.873009] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-02T18:58:41.985797] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T18:58:42.585226] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T18:58:42.587419] [INFO ] [REMOTE ] FLO: Full fetch complete (75017 records). [2025-10-02T18:58:42.587547] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-02T18:58:42.678908] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-02T18:58:43.025171] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-02T18:58:43.025266] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-02T18:58:43.026214] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-02T18:58:43.026285] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-02T18:58:43.027860] [DEBUG] [LOCAL ] FLO: Trimmed 75017 records to 52293 (keeping 200 days of data) [2025-10-02T18:58:43.304252] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T18:58:43.416393] [DEBUG] [LOCAL ] FLO: Primary data saved (52293 records). [2025-10-02T18:58:43.416552] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-02T18:58:43.416661] [INFO ] [MAIN ] Update Progress: 846/2370 symbols completed. FLO took 41.7s. Estimated remaining: 3h 33m 45s. Rate: 7.1 symbols/min [2025-10-02T18:58:43.482532] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-02T18:58:43.595785] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:58:43.618051] [DEBUG] [LOCAL ] FLXR: Loaded 20437 existing records from primary storage. [2025-10-02T18:58:43.618361] [INFO ] [MAIN ] FLXR: Loaded 20437 existing records. [2025-10-02T18:58:43.807234] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:58:43.807458] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-02T18:58:43.807507] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-02T18:58:43.808219] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-02T18:58:43.808279] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-02T18:58:44.184261] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:58:44.273020] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-10-02T18:58:44.747592] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-02T18:58:44.781783] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-02T18:58:45.072970] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-02T18:58:45.168345] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T18:58:45.872790] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:58:45.873067] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-02T18:58:46.672998] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-02T18:58:47.472993] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-02T18:58:47.517790] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T18:58:47.629307] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T18:58:48.273017] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-02T18:58:49.072985] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-02T18:58:49.153524] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T18:58:49.389618] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-02T18:58:49.873013] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-02T18:58:50.673006] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-02T18:58:50.990793] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T18:58:51.012141] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T18:58:51.473040] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-02T18:58:52.272962] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-02T18:58:52.307751] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T18:58:53.073049] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-02T18:58:53.272017] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T18:58:53.577992] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-02T18:58:53.872998] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-02T18:58:54.632722] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T18:58:54.672989] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-02T18:58:54.813030] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T18:58:55.473027] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-02T18:58:56.272994] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-02T18:58:56.449568] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T18:58:56.939338] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T18:58:57.073007] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-02T18:58:57.873002] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-02T18:58:58.214026] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T18:58:58.673012] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-02T18:58:58.799281] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T18:58:59.289908] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T18:58:59.292051] [INFO ] [REMOTE ] FLR: Full fetch complete (76449 records). [2025-10-02T18:58:59.292176] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-02T18:58:59.474760] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-02T18:58:59.702970] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-02T18:58:59.703062] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-02T18:58:59.704045] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-02T18:58:59.704115] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-02T18:58:59.705613] [DEBUG] [LOCAL ] FLR: Trimmed 76449 records to 53509 (keeping 200 days of data) [2025-10-02T18:59:00.042211] [DEBUG] [LOCAL ] FLR: Primary data saved (53509 records). [2025-10-02T18:59:00.042379] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-02T18:59:00.042483] [INFO ] [MAIN ] Update Progress: 847/2370 symbols completed. FLR took 39.6s. Estimated remaining: 3h 33m 52s. Rate: 7.1 symbols/min [2025-10-02T18:59:00.232167] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:00.282511] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-02T18:59:00.286070] [DEBUG] [LOCAL ] FMC: Loaded 51782 existing records from primary storage. [2025-10-02T18:59:00.286521] [INFO ] [MAIN ] FMC: Loaded 51782 existing records. [2025-10-02T18:59:00.491675] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:00.521540] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-02T18:59:00.521691] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-02T18:59:00.524893] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T18:59:00.524982] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-02T18:59:00.540383] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-02T18:59:00.967844] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:01.072979] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-02T18:59:01.376304] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-02T18:59:01.420358] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T18:59:01.872997] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-02T18:59:02.672988] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-10-02T18:59:02.835793] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-02T18:59:02.882343] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T18:59:03.473001] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-02T18:59:04.273008] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-02T18:59:04.371741] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T18:59:04.947487] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T18:59:05.073010] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-02T18:59:05.780042] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-02T18:59:05.782161] [INFO ] [REMOTE ] FLS: Full fetch complete (71629 records). [2025-10-02T18:59:05.782284] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-02T18:59:05.880821] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-02T18:59:06.219580] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-02T18:59:06.219709] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-02T18:59:06.220637] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-02T18:59:06.220732] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-02T18:59:06.222348] [DEBUG] [LOCAL ] FLS: Trimmed 71629 records to 50554 (keeping 200 days of data) [2025-10-02T18:59:06.548826] [DEBUG] [LOCAL ] FLS: Primary data saved (50554 records). [2025-10-02T18:59:06.548970] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-02T18:59:06.549060] [INFO ] [MAIN ] Update Progress: 848/2370 symbols completed. FLS took 34.2s. Estimated remaining: 3h 33m 40s. Rate: 7.1 symbols/min [2025-10-02T18:59:06.674890] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-02T18:59:06.741705] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:06.749978] [DEBUG] [LOCAL ] FMN: Loaded 5591 existing records from primary storage. [2025-10-02T18:59:06.750546] [INFO ] [MAIN ] FMN: Loaded 5591 existing records. [2025-10-02T18:59:06.945110] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:06.945458] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-02T18:59:06.945604] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-02T18:59:06.946061] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-02T18:59:06.946128] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-02T18:59:07.077067] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T18:59:07.418611] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:07.473019] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-02T18:59:07.554325] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T18:59:07.595001] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T18:59:08.273011] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-02T18:59:09.072978] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-10-02T18:59:09.249070] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T18:59:09.765694] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-02T18:59:09.872969] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-02T18:59:10.016325] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T18:59:10.673585] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T18:59:10.673176] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-02T18:59:11.473011] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-02T18:59:12.272979] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-02T18:59:12.452819] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T18:59:12.454886] [INFO ] [REMOTE ] FLXR: Full fetch complete (25692 records). [2025-10-02T18:59:12.455454] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-02T18:59:12.457689] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T18:59:12.822479] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-02T18:59:12.898265] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-02T18:59:12.898357] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-02T18:59:12.898969] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-02T18:59:12.899033] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-02T18:59:12.899769] [DEBUG] [LOCAL ] FLXR: Trimmed 25692 records to 20621 (keeping 200 days of data) [2025-10-02T18:59:13.033473] [DEBUG] [LOCAL ] FLXR: Primary data saved (20621 records). [2025-10-02T18:59:13.033606] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-02T18:59:13.033712] [INFO ] [MAIN ] Update Progress: 849/2370 symbols completed. FLXR took 29.6s. Estimated remaining: 3h 33m 28s. Rate: 7.1 symbols/min [2025-10-02T18:59:13.078163] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-02T18:59:13.215739] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:13.246504] [DEBUG] [LOCAL ] FMS: Loaded 30083 existing records from primary storage. [2025-10-02T18:59:13.246830] [INFO ] [MAIN ] FMS: Loaded 30083 existing records. [2025-10-02T18:59:13.433564] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:13.433810] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-02T18:59:13.433860] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-02T18:59:13.435319] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-02T18:59:13.435380] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-02T18:59:13.860569] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:13.869631] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T18:59:13.872950] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-02T18:59:14.584469] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-02T18:59:14.672995] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-02T18:59:15.250083] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T18:59:15.473037] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-02T18:59:16.127316] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T18:59:16.273001] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-02T18:59:17.072993] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-10-02T18:59:17.873009] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-02T18:59:17.976472] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-02T18:59:17.978705] [INFO ] [REMOTE ] FLUT: Full fetch complete (72895 records). [2025-10-02T18:59:17.978903] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-02T18:59:18.450691] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-02T18:59:18.451428] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-02T18:59:18.452028] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T18:59:18.453055] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-02T18:59:18.455090] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-02T18:59:18.460680] [DEBUG] [LOCAL ] FLUT: Trimmed 72895 records to 51173 (keeping 200 days of data) [2025-10-02T18:59:18.555846] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-02T18:59:18.683159] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-02T18:59:18.796168] [DEBUG] [LOCAL ] FLUT: Primary data saved (51173 records). [2025-10-02T18:59:18.796381] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-02T18:59:18.796497] [INFO ] [MAIN ] Update Progress: 850/2370 symbols completed. FLUT took 44.3s. Estimated remaining: 3h 33m 15s. Rate: 7.1 symbols/min [2025-10-02T18:59:18.985569] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:19.026359] [DEBUG] [LOCAL ] FMX: Loaded 40731 existing records from primary storage. [2025-10-02T18:59:19.026693] [INFO ] [MAIN ] FMX: Loaded 40731 existing records. [2025-10-02T18:59:19.141696] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T18:59:19.226866] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:19.227144] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-02T18:59:19.227204] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-02T18:59:19.228712] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-02T18:59:19.228778] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-02T18:59:19.478259] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-02T18:59:19.614162] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:20.273003] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-10-02T18:59:20.680128] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T18:59:21.073045] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-02T18:59:21.702832] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T18:59:21.873001] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-02T18:59:22.495539] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T18:59:22.673031] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-02T18:59:22.839148] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T18:59:23.473043] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-02T18:59:24.071242] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T18:59:24.273050] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-02T18:59:24.588951] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T18:59:25.073019] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-02T18:59:25.589866] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T18:59:25.590724] [INFO ] [REMOTE ] FMN: Full fetch complete (9952 records). [2025-10-02T18:59:25.590797] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-02T18:59:25.875768] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-02T18:59:26.022726] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-02T18:59:26.022940] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-02T18:59:26.023363] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-02T18:59:26.023446] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-02T18:59:26.024260] [DEBUG] [LOCAL ] FMN: Trimmed 9952 records to 5624 (keeping 200 days of data) [2025-10-02T18:59:26.085877] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T18:59:26.103789] [DEBUG] [LOCAL ] FMN: Primary data saved (5624 records). [2025-10-02T18:59:26.103935] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-02T18:59:26.104021] [INFO ] [MAIN ] Update Progress: 851/2370 symbols completed. FMN took 19.6s. Estimated remaining: 3h 33m 4s. Rate: 7.1 symbols/min [2025-10-02T18:59:26.288085] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:26.291295] [DEBUG] [LOCAL ] FMY: Loaded 1397 existing records from primary storage. [2025-10-02T18:59:26.291443] [INFO ] [MAIN ] FMY: Loaded 1397 existing records. [2025-10-02T18:59:26.476906] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:26.477135] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-02T18:59:26.477185] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-02T18:59:26.477439] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-02T18:59:26.477501] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-02T18:59:26.683612] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-02T18:59:26.884103] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:27.251073] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T18:59:27.473005] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-10-02T18:59:27.835008] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-10-02T18:59:27.899825] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T18:59:28.272997] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-02T18:59:29.073044] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-02T18:59:29.447684] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-02T18:59:29.845959] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T18:59:29.872964] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-02T18:59:30.673000] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-02T18:59:31.127589] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T18:59:31.473041] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-02T18:59:31.883773] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-02T18:59:32.064170] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T18:59:32.273043] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-02T18:59:32.643302] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-02T18:59:33.073033] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-02T18:59:33.550477] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T18:59:33.873023] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-02T18:59:34.164296] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-02T18:59:34.673047] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-02T18:59:35.472971] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-02T18:59:35.802280] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-02T18:59:35.924595] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T18:59:36.273052] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-02T18:59:37.073047] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-02T18:59:37.345521] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-02T18:59:37.873007] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-02T18:59:37.943385] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T18:59:38.673014] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-02T18:59:39.440068] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T18:59:39.472962] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-02T18:59:39.501500] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T18:59:39.924877] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-02T18:59:40.273013] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-02T18:59:40.571362] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-02T18:59:41.073000] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-02T18:59:41.872972] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-02T18:59:42.267280] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T18:59:42.267975] [INFO ] [REMOTE ] FMY: Full fetch complete (1972 records). [2025-10-02T18:59:42.268182] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-02T18:59:42.622486] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T18:59:42.680434] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-02T18:59:42.704504] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-02T18:59:42.704587] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-02T18:59:42.704730] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-02T18:59:42.704790] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-02T18:59:42.705185] [DEBUG] [LOCAL ] FMY: Trimmed 1972 records to 1399 (keeping 200 days of data) [2025-10-02T18:59:42.715095] [DEBUG] [LOCAL ] FMY: Primary data saved (1399 records). [2025-10-02T18:59:42.715166] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-02T18:59:42.715246] [INFO ] [MAIN ] Update Progress: 852/2370 symbols completed. FMY took 16.6s. Estimated remaining: 3h 33m 11s. Rate: 7.1 symbols/min [2025-10-02T18:59:42.894194] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:42.934349] [DEBUG] [LOCAL ] FN: Loaded 38577 existing records from primary storage. [2025-10-02T18:59:42.934729] [INFO ] [MAIN ] FN: Loaded 38577 existing records. [2025-10-02T18:59:43.129301] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:43.129520] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-02T18:59:43.129570] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-02T18:59:43.131315] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-02T18:59:43.131378] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-02T18:59:43.479524] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-02T18:59:43.525069] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:43.933769] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T18:59:44.273034] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-10-02T18:59:44.948283] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T18:59:45.073044] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-02T18:59:45.590129] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T18:59:45.873014] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-02T18:59:46.673031] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-02T18:59:46.932897] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T18:59:47.320225] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T18:59:47.473073] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-02T18:59:47.771789] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T18:59:48.273041] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-02T18:59:49.072966] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-02T18:59:49.229406] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T18:59:49.497988] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T18:59:49.873019] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-02T18:59:50.574336] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T18:59:50.673011] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-02T18:59:51.125638] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T18:59:51.473033] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-02T18:59:52.236127] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T18:59:52.272981] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-02T18:59:52.858743] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T18:59:53.073008] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-02T18:59:53.625983] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T18:59:53.628377] [INFO ] [REMOTE ] FMC: Full fetch complete (75111 records). [2025-10-02T18:59:53.628514] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-02T18:59:53.880577] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-02T18:59:54.069257] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-02T18:59:54.069379] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-02T18:59:54.070486] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-02T18:59:54.070580] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-02T18:59:54.072323] [DEBUG] [LOCAL ] FMC: Trimmed 75111 records to 52171 (keeping 200 days of data) [2025-10-02T18:59:54.357147] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T18:59:54.465856] [DEBUG] [LOCAL ] FMC: Primary data saved (52171 records). [2025-10-02T18:59:54.466023] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-02T18:59:54.466111] [INFO ] [MAIN ] Update Progress: 853/2370 symbols completed. FMC took 54.4s. Estimated remaining: 3h 33m 8s. Rate: 7.1 symbols/min [2025-10-02T18:59:54.651117] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:54.682370] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-02T18:59:54.708796] [DEBUG] [LOCAL ] FNB: Loaded 52458 existing records from primary storage. [2025-10-02T18:59:54.709188] [INFO ] [MAIN ] FNB: Loaded 52458 existing records. [2025-10-02T18:59:54.909840] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:54.910069] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-02T18:59:54.910123] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-02T18:59:54.913336] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-02T18:59:54.913428] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-02T18:59:55.272172] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T18:59:55.304890] [INFO ] [REMOTE ] FMX: Full fetch complete (57910 records). [2025-10-02T18:59:55.309665] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:55.310000] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-02T18:59:55.482442] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-10-02T18:59:55.745107] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-02T18:59:55.745199] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-02T18:59:55.745965] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-02T18:59:55.746033] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-02T18:59:55.747472] [DEBUG] [LOCAL ] FMX: Trimmed 57910 records to 40981 (keeping 200 days of data) [2025-10-02T18:59:56.004829] [DEBUG] [LOCAL ] FMX: Primary data saved (40981 records). [2025-10-02T18:59:56.004963] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-02T18:59:56.005047] [INFO ] [MAIN ] Update Progress: 854/2370 symbols completed. FMX took 37.2s. Estimated remaining: 3h 32m 47s. Rate: 7.1 symbols/min [2025-10-02T18:59:56.199031] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:56.251688] [DEBUG] [LOCAL ] FND: Loaded 52101 existing records from primary storage. [2025-10-02T18:59:56.252039] [INFO ] [MAIN ] FND: Loaded 52101 existing records. [2025-10-02T18:59:56.278253] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-02T18:59:56.487413] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T18:59:56.490283] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-02T18:59:56.490402] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-02T18:59:56.490156] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T18:59:56.499411] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-02T18:59:56.499712] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-02T18:59:56.897966] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:56.935248] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T18:59:57.072988] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-10-02T18:59:57.237346] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T18:59:57.238879] [INFO ] [REMOTE ] FMS: Full fetch complete (42389 records). [2025-10-02T18:59:57.238981] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-02T18:59:57.699475] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-02T18:59:57.699572] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-02T18:59:57.700221] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-02T18:59:57.700289] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-02T18:59:57.701549] [DEBUG] [LOCAL ] FMS: Trimmed 42389 records to 30247 (keeping 200 days of data) [2025-10-02T18:59:57.880106] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-02T18:59:57.904761] [DEBUG] [LOCAL ] FMS: Primary data saved (30247 records). [2025-10-02T18:59:57.904919] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-02T18:59:57.906691] [INFO ] [MAIN ] Update Progress: 855/2370 symbols completed. FMS took 44.9s. Estimated remaining: 3h 32m 27s. Rate: 7.1 symbols/min [2025-10-02T18:59:58.123775] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T18:59:58.123962] [DEBUG] [LOCAL ] FNF: No existing data file found in primary storage. [2025-10-02T18:59:58.124002] [WARN ] [MAIN ] FNF: No existing data found, performing full refresh instead. [2025-10-02T18:59:58.124115] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-02T18:59:58.124157] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-02T18:59:58.124199] [DEBUG] [LOCAL ] FNF: No primary data file found to delete. [2025-10-02T18:59:58.124232] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-02T18:59:58.591487] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T18:59:58.623761] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T18:59:58.672971] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-02T18:59:59.117838] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T18:59:59.473007] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-02T19:00:00.188911] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:00:00.273043] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-02T19:00:01.034320] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T19:00:01.072999] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-02T19:00:01.873029] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-02T19:00:02.036899] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T19:00:02.586663] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T19:00:02.673005] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-02T19:00:03.476083] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-02T19:00:03.482799] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T19:00:04.228764] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:00:04.272981] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-02T19:00:05.072997] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-10-02T19:00:05.252085] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T19:00:05.382085] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T19:00:05.873021] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-02T19:00:06.612207] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T19:00:06.673041] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-02T19:00:07.472978] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-02T19:00:07.591681] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T19:00:08.014120] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T19:00:08.273003] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-02T19:00:09.072989] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-02T19:00:09.270157] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T19:00:09.844439] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:00:09.872999] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-02T19:00:10.673030] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-02T19:00:10.793853] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T19:00:11.473012] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-02T19:00:11.698087] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T19:00:12.131386] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T19:00:12.272991] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-02T19:00:13.073056] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-02T19:00:13.184732] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T19:00:13.407219] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T19:00:13.413402] [INFO ] [REMOTE ] FN: Full fetch complete (56304 records). [2025-10-02T19:00:13.413569] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-02T19:00:13.851488] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-02T19:00:13.851576] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-02T19:00:13.852402] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-02T19:00:13.852503] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-02T19:00:13.854607] [DEBUG] [LOCAL ] FN: Trimmed 56304 records to 38785 (keeping 200 days of data) [2025-10-02T19:00:13.911377] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-02T19:00:14.100343] [DEBUG] [LOCAL ] FN: Primary data saved (38785 records). [2025-10-02T19:00:14.100532] [INFO ] [MAIN ] FN: Full history saved. [2025-10-02T19:00:14.100737] [INFO ] [MAIN ] Update Progress: 856/2370 symbols completed. FN took 31.4s. Estimated remaining: 3h 32m 33s. Rate: 7.1 symbols/min [2025-10-02T19:00:14.290302] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:00:14.345843] [DEBUG] [LOCAL ] FNV: Loaded 46148 existing records from primary storage. [2025-10-02T19:00:14.346231] [INFO ] [MAIN ] FNV: Loaded 46148 existing records. [2025-10-02T19:00:14.555740] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:00:14.556346] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-02T19:00:14.556492] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-02T19:00:14.558756] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-02T19:00:14.558844] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-02T19:00:14.677794] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-02T19:00:14.729425] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T19:00:15.009698] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:00:15.472995] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-10-02T19:00:16.172622] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-02T19:00:16.273066] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-02T19:00:16.681396] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T19:00:17.078326] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-02T19:00:17.103038] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T19:00:17.872989] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-02T19:00:18.130892] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T19:00:18.673020] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-02T19:00:18.819529] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T19:00:19.473019] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-02T19:00:19.539180] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T19:00:20.100044] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:00:20.273015] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-02T19:00:20.785508] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T19:00:21.073035] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-02T19:00:21.873008] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-02T19:00:22.117033] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T19:00:22.673000] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-02T19:00:22.791538] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T19:00:23.473010] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-02T19:00:23.736863] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T19:00:24.188004] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:00:24.273012] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-02T19:00:24.835533] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T19:00:25.073012] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-02T19:00:25.698776] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T19:00:25.700905] [INFO ] [REMOTE ] FNB: Full fetch complete (75842 records). [2025-10-02T19:00:25.701022] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-02T19:00:25.882247] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-02T19:00:26.151822] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-02T19:00:26.151911] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-02T19:00:26.153072] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-02T19:00:26.153143] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-02T19:00:26.154735] [DEBUG] [LOCAL ] FNB: Trimmed 75842 records to 52848 (keeping 200 days of data) [2025-10-02T19:00:26.511075] [DEBUG] [LOCAL ] FNB: Primary data saved (52848 records). [2025-10-02T19:00:26.511224] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-02T19:00:26.511318] [INFO ] [MAIN ] Update Progress: 857/2370 symbols completed. FNB took 32.0s. Estimated remaining: 3h 32m 31s. Rate: 7.1 symbols/min [2025-10-02T19:00:26.681537] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-02T19:00:26.719725] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:00:26.736096] [DEBUG] [LOCAL ] FOA: Loaded 13079 existing records from primary storage. [2025-10-02T19:00:26.736576] [INFO ] [MAIN ] FOA: Loaded 13079 existing records. [2025-10-02T19:00:26.939033] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:00:26.939615] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-02T19:00:26.939731] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-02T19:00:26.951296] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-02T19:00:26.956527] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-02T19:00:27.044059] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T19:00:27.381537] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:00:27.473022] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-02T19:00:27.704018] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:00:28.273045] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-02T19:00:28.558094] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T19:00:28.819347] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T19:00:29.073041] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-02T19:00:29.873000] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-10-02T19:00:30.285817] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-10-02T19:00:30.673006] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-02T19:00:30.894796] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T19:00:30.897906] [INFO ] [REMOTE ] FND: Full fetch complete (74630 records). [2025-10-02T19:00:30.898054] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-02T19:00:31.134330] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T19:00:31.382746] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-02T19:00:31.382866] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-02T19:00:31.383806] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-02T19:00:31.383872] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-02T19:00:31.386076] [DEBUG] [LOCAL ] FND: Trimmed 74630 records to 52478 (keeping 200 days of data) [2025-10-02T19:00:31.492588] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-02T19:00:31.742890] [DEBUG] [LOCAL ] FND: Primary data saved (52478 records). [2025-10-02T19:00:31.743062] [INFO ] [MAIN ] FND: Full history saved. [2025-10-02T19:00:31.743192] [INFO ] [MAIN ] Update Progress: 858/2370 symbols completed. FND took 35.7s. Estimated remaining: 3h 32m 17s. Rate: 7.1 symbols/min [2025-10-02T19:00:31.967993] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:00:31.981293] [DEBUG] [LOCAL ] FOF: Loaded 8431 existing records from primary storage. [2025-10-02T19:00:31.981574] [INFO ] [MAIN ] FOF: Loaded 8431 existing records. [2025-10-02T19:00:32.216232] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:00:32.216692] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-02T19:00:32.216801] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-02T19:00:32.217155] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-02T19:00:32.217221] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-02T19:00:32.277354] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-02T19:00:32.643320] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:00:32.685844] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-02T19:00:33.072965] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-02T19:00:33.261694] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T19:00:33.313859] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T19:00:33.872999] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-02T19:00:34.484491] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:00:34.486439] [INFO ] [REMOTE ] FNF: Full fetch complete (69599 records). [2025-10-02T19:00:34.486579] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-02T19:00:34.679794] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-02T19:00:34.936632] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-02T19:00:34.936831] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-02T19:00:34.937707] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-02T19:00:34.937772] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-02T19:00:34.939212] [DEBUG] [LOCAL ] FNF: Trimmed 69599 records to 49364 (keeping 200 days of data) [2025-10-02T19:00:35.265317] [DEBUG] [LOCAL ] FNF: Primary data saved (49364 records). [2025-10-02T19:00:35.265452] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-02T19:00:35.265536] [INFO ] [MAIN ] Update Progress: 859/2370 symbols completed. FNF took 37.4s. Estimated remaining: 3h 32m 0s. Rate: 7.1 symbols/min [2025-10-02T19:00:35.439288] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:00:35.459795] [DEBUG] [LOCAL ] FOR: Loaded 19842 existing records from primary storage. [2025-10-02T19:00:35.460703] [INFO ] [MAIN ] FOR: Loaded 19842 existing records. [2025-10-02T19:00:35.482156] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-10-02T19:00:35.656064] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:00:35.656418] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-02T19:00:35.656541] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-02T19:00:35.657461] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-02T19:00:35.657582] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-02T19:00:35.809576] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-02T19:00:36.032239] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T19:00:36.111159] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:00:36.273050] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-02T19:00:36.304539] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T19:00:37.072994] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-02T19:00:37.349342] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T19:00:37.873016] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-02T19:00:38.672990] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-10-02T19:00:38.905795] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T19:00:39.123326] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-02T19:00:39.472976] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-02T19:00:39.572081] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T19:00:40.273060] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-02T19:00:40.771533] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:00:41.012472] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-02T19:00:41.072996] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-02T19:00:41.859182] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-02T19:00:41.872974] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-02T19:00:42.487877] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T19:00:42.673025] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-02T19:00:43.408070] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T19:00:43.473001] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-02T19:00:43.971177] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T19:00:44.273040] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-02T19:00:45.009034] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T19:00:45.073042] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-02T19:00:45.596406] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-02T19:00:45.873004] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-02T19:00:46.673000] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-02T19:00:46.765331] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T19:00:47.473057] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-02T19:00:47.580296] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-02T19:00:48.273019] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-02T19:00:48.551068] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T19:00:48.934482] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T19:00:48.935861] [INFO ] [REMOTE ] FOF: Full fetch complete (11868 records). [2025-10-02T19:00:48.935966] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-02T19:00:49.078149] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-02T19:00:49.377255] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-02T19:00:49.377344] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-02T19:00:49.377665] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-02T19:00:49.377730] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-02T19:00:49.378239] [DEBUG] [LOCAL ] FOF: Trimmed 11868 records to 8487 (keeping 200 days of data) [2025-10-02T19:00:49.433293] [DEBUG] [LOCAL ] FOF: Primary data saved (8487 records). [2025-10-02T19:00:49.433441] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-02T19:00:49.433539] [INFO ] [MAIN ] Update Progress: 860/2370 symbols completed. FOF took 17.7s. Estimated remaining: 3h 32m 2s. Rate: 7.1 symbols/min [2025-10-02T19:00:49.629917] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:00:49.677320] [DEBUG] [LOCAL ] FOUR: Loaded 49533 existing records from primary storage. [2025-10-02T19:00:49.677627] [INFO ] [MAIN ] FOUR: Loaded 49533 existing records. [2025-10-02T19:00:49.863429] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:00:49.863789] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-02T19:00:49.863893] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-02T19:00:49.865608] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-02T19:00:49.865695] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-02T19:00:49.878704] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-02T19:00:50.016055] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T19:00:50.322404] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:00:50.672995] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-02T19:00:51.472980] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-02T19:00:51.735866] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T19:00:51.768464] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T19:00:51.888207] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-02T19:00:52.273014] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-02T19:00:53.007261] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-02T19:00:53.073027] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-10-02T19:00:53.872994] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-02T19:00:54.667585] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T19:00:54.678472] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-02T19:00:54.753843] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T19:00:55.472974] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-02T19:00:55.706486] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T19:00:56.195165] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-02T19:00:56.273001] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-02T19:00:57.073003] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-02T19:00:57.611818] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T19:00:57.614700] [INFO ] [REMOTE ] FNV: Full fetch complete (66333 records). [2025-10-02T19:00:57.614908] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-02T19:00:57.874065] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-02T19:00:57.968185] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T19:00:58.112188] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-02T19:00:58.112275] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-02T19:00:58.113119] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-02T19:00:58.113185] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-02T19:00:58.115460] [DEBUG] [LOCAL ] FNV: Trimmed 66333 records to 46489 (keeping 200 days of data) [2025-10-02T19:00:58.445792] [DEBUG] [LOCAL ] FNV: Primary data saved (46489 records). [2025-10-02T19:00:58.445939] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-02T19:00:58.446031] [INFO ] [MAIN ] Update Progress: 861/2370 symbols completed. FNV took 44.3s. Estimated remaining: 3h 31m 55s. Rate: 7.1 symbols/min [2025-10-02T19:00:58.678170] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-02T19:00:58.680899] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:00:58.702762] [DEBUG] [LOCAL ] FPF: Loaded 18186 existing records from primary storage. [2025-10-02T19:00:58.703071] [INFO ] [MAIN ] FPF: Loaded 18186 existing records. [2025-10-02T19:00:58.901394] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:00:58.901595] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-02T19:00:58.901667] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-02T19:00:58.902361] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-02T19:00:58.902426] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-02T19:00:59.097307] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T19:00:59.319880] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:00:59.324182] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T19:00:59.325322] [INFO ] [REMOTE ] FOA: Full fetch complete (22384 records). [2025-10-02T19:00:59.325444] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-02T19:00:59.489519] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-10-02T19:00:59.754896] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-02T19:00:59.754984] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-02T19:00:59.755515] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-02T19:00:59.755559] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-02T19:00:59.756377] [DEBUG] [LOCAL ] FOA: Trimmed 22384 records to 13189 (keeping 200 days of data) [2025-10-02T19:00:59.841533] [DEBUG] [LOCAL ] FOA: Primary data saved (13189 records). [2025-10-02T19:00:59.841717] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-02T19:00:59.841818] [INFO ] [MAIN ] Update Progress: 862/2370 symbols completed. FOA took 33.3s. Estimated remaining: 3h 31m 34s. Rate: 7.1 symbols/min [2025-10-02T19:01:00.029055] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:00.048185] [DEBUG] [LOCAL ] FPH: Loaded 19419 existing records from primary storage. [2025-10-02T19:01:00.048438] [INFO ] [MAIN ] FPH: Loaded 19419 existing records. [2025-10-02T19:01:00.234091] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:00.234330] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-02T19:01:00.234382] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-02T19:01:00.235013] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-02T19:01:00.235077] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-02T19:01:00.280959] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-02T19:01:00.639591] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:00.853943] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T19:01:01.072984] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-02T19:01:01.412376] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T19:01:01.872995] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-02T19:01:02.115699] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T19:01:02.672976] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-02T19:01:02.748522] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T19:01:03.473033] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-10-02T19:01:03.635453] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T19:01:04.272979] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-02T19:01:04.602277] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T19:01:05.072996] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-02T19:01:05.872994] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-02T19:01:05.999676] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T19:01:06.069801] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T19:01:06.673000] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-02T19:01:06.866492] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T19:01:07.464193] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T19:01:07.472968] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-02T19:01:08.272989] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-02T19:01:08.467553] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-02T19:01:09.073047] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-02T19:01:09.683465] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T19:01:09.685879] [INFO ] [REMOTE ] FOR: Full fetch complete (29899 records). [2025-10-02T19:01:09.686046] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-02T19:01:09.877263] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-02T19:01:10.216197] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-02T19:01:10.216325] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-02T19:01:10.217021] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-02T19:01:10.217176] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-02T19:01:10.218454] [DEBUG] [LOCAL ] FOR: Trimmed 29899 records to 19927 (keeping 200 days of data) [2025-10-02T19:01:10.357817] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-10-02T19:01:10.398782] [DEBUG] [LOCAL ] FOR: Primary data saved (19927 records). [2025-10-02T19:01:10.398929] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-02T19:01:10.399033] [INFO ] [MAIN ] Update Progress: 863/2370 symbols completed. FOR took 35.1s. Estimated remaining: 3h 31m 29s. Rate: 7.1 symbols/min [2025-10-02T19:01:10.587986] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:10.620365] [DEBUG] [LOCAL ] FPI: Loaded 31045 existing records from primary storage. [2025-10-02T19:01:10.620682] [INFO ] [MAIN ] FPI: Loaded 31045 existing records. [2025-10-02T19:01:10.678540] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-02T19:01:10.817561] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:10.817858] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-02T19:01:10.817979] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-02T19:01:10.819209] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-02T19:01:10.819274] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-02T19:01:11.177521] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T19:01:11.226146] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:11.472994] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-02T19:01:12.002534] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T19:01:12.272993] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-02T19:01:12.523806] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T19:01:13.073059] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-02T19:01:13.255910] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T19:01:13.873013] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-02T19:01:14.672994] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-02T19:01:14.961104] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T19:01:15.017453] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-02T19:01:15.473001] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-02T19:01:16.272985] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-10-02T19:01:16.406496] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T19:01:16.500140] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T19:01:17.073044] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-02T19:01:17.826959] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T19:01:17.872994] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-02T19:01:18.103611] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T19:01:18.673011] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-02T19:01:19.000253] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T19:01:19.473077] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-02T19:01:19.631537] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T19:01:20.273045] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-02T19:01:21.072976] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-02T19:01:21.277079] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T19:01:21.483243] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T19:01:21.873034] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-02T19:01:22.106773] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T19:01:22.673008] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-02T19:01:23.015483] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T19:01:23.473044] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-02T19:01:24.272989] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-02T19:01:24.335981] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T19:01:24.454766] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T19:01:25.073012] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-02T19:01:25.212098] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T19:01:25.782737] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T19:01:25.873035] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-02T19:01:26.673040] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-02T19:01:26.901565] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T19:01:27.366907] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T19:01:27.368225] [INFO ] [REMOTE ] FPH: Full fetch complete (31376 records). [2025-10-02T19:01:27.368335] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-02T19:01:27.478339] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-02T19:01:27.803481] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-02T19:01:27.803573] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-02T19:01:27.804193] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-02T19:01:27.804264] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-02T19:01:27.805154] [DEBUG] [LOCAL ] FPH: Trimmed 31376 records to 19546 (keeping 200 days of data) [2025-10-02T19:01:27.930988] [DEBUG] [LOCAL ] FPH: Primary data saved (19546 records). [2025-10-02T19:01:27.931145] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-02T19:01:27.931248] [INFO ] [MAIN ] Update Progress: 864/2370 symbols completed. FPH took 28.1s. Estimated remaining: 3h 31m 37s. Rate: 7.1 symbols/min [2025-10-02T19:01:28.138735] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:28.184631] [DEBUG] [LOCAL ] FR: Loaded 46429 existing records from primary storage. [2025-10-02T19:01:28.185029] [INFO ] [MAIN ] FR: Loaded 46429 existing records. [2025-10-02T19:01:28.278220] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-02T19:01:28.392421] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:28.392710] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-02T19:01:28.392798] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-02T19:01:28.394142] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-10-02T19:01:28.394206] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-02T19:01:28.817727] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:29.073019] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-02T19:01:29.229658] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T19:01:29.286260] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T19:01:29.841487] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T19:01:29.842879] [INFO ] [REMOTE ] FPF: Full fetch complete (26634 records). [2025-10-02T19:01:29.842978] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-02T19:01:29.879141] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-02T19:01:30.277857] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-02T19:01:30.277960] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-02T19:01:30.278677] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-02T19:01:30.278748] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-02T19:01:30.279570] [DEBUG] [LOCAL ] FPF: Trimmed 26634 records to 18405 (keeping 200 days of data) [2025-10-02T19:01:30.400980] [DEBUG] [LOCAL ] FPF: Primary data saved (18405 records). [2025-10-02T19:01:30.401144] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-02T19:01:30.401238] [INFO ] [MAIN ] Update Progress: 865/2370 symbols completed. FPF took 32.0s. Estimated remaining: 3h 31m 18s. Rate: 7.1 symbols/min [2025-10-02T19:01:30.593391] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:30.609665] [DEBUG] [LOCAL ] FRA: Loaded 14571 existing records from primary storage. [2025-10-02T19:01:30.609926] [INFO ] [MAIN ] FRA: Loaded 14571 existing records. [2025-10-02T19:01:30.678202] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-10-02T19:01:30.804786] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:30.805023] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-02T19:01:30.805113] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-02T19:01:30.805727] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-02T19:01:30.805794] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-02T19:01:31.198305] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:31.473046] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-10-02T19:01:31.716636] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T19:01:32.273030] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-02T19:01:32.405464] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T19:01:32.470810] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T19:01:33.072998] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-02T19:01:33.873053] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-02T19:01:34.233313] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T19:01:34.678084] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-02T19:01:34.698870] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-02T19:01:35.366610] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:01:35.473028] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-02T19:01:36.248818] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:01:36.272962] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-02T19:01:37.072998] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-02T19:01:37.362073] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-02T19:01:37.762470] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T19:01:37.873055] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-02T19:01:38.394299] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T19:01:38.673024] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-02T19:01:39.473051] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-02T19:01:39.705251] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-02T19:01:39.708088] [INFO ] [REMOTE ] FOUR: Full fetch complete (72017 records). [2025-10-02T19:01:39.708265] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-02T19:01:40.129250] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-02T19:01:40.129356] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-02T19:01:40.130311] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-02T19:01:40.130381] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-02T19:01:40.131966] [DEBUG] [LOCAL ] FOUR: Trimmed 72017 records to 49921 (keeping 200 days of data) [2025-10-02T19:01:40.305976] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-02T19:01:40.441232] [DEBUG] [LOCAL ] FOUR: Primary data saved (49921 records). [2025-10-02T19:01:40.441389] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-02T19:01:40.441479] [INFO ] [MAIN ] Update Progress: 866/2370 symbols completed. FOUR took 51.0s. Estimated remaining: 3h 31m 12s. Rate: 7.1 symbols/min [2025-10-02T19:01:40.627144] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:40.646401] [DEBUG] [LOCAL ] FRGE: Loaded 17691 existing records from primary storage. [2025-10-02T19:01:40.646702] [INFO ] [MAIN ] FRGE: Loaded 17691 existing records. [2025-10-02T19:01:40.847742] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:40.848164] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-02T19:01:40.848240] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-02T19:01:40.855198] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-02T19:01:40.855297] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-02T19:01:40.934686] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-10-02T19:01:41.089115] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-02T19:01:41.277426] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:41.299987] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T19:01:41.767461] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-02T19:01:41.873043] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-02T19:01:42.572502] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T19:01:42.673021] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-02T19:01:43.472999] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-02T19:01:44.208328] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-02T19:01:44.272972] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-02T19:01:44.513023] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T19:01:44.536099] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T19:01:45.073002] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-02T19:01:45.801631] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T19:01:45.872978] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-02T19:01:46.402270] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T19:01:46.672996] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-02T19:01:47.473058] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-02T19:01:47.580286] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T19:01:47.776206] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T19:01:47.777769] [INFO ] [REMOTE ] FPI: Full fetch complete (44364 records). [2025-10-02T19:01:47.777882] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-02T19:01:48.188929] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-02T19:01:48.189028] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-02T19:01:48.189807] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-02T19:01:48.189881] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-02T19:01:48.191130] [DEBUG] [LOCAL ] FPI: Trimmed 44364 records to 31264 (keeping 200 days of data) [2025-10-02T19:01:48.282611] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-10-02T19:01:48.392286] [DEBUG] [LOCAL ] FPI: Primary data saved (31264 records). [2025-10-02T19:01:48.392439] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-02T19:01:48.393282] [INFO ] [MAIN ] Update Progress: 867/2370 symbols completed. FPI took 38.0s. Estimated remaining: 3h 31m 3s. Rate: 7.1 symbols/min [2025-10-02T19:01:48.596834] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:48.605298] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-02T19:01:48.665597] [DEBUG] [LOCAL ] FRO: Loaded 51761 existing records from primary storage. [2025-10-02T19:01:48.665980] [INFO ] [MAIN ] FRO: Loaded 51761 existing records. [2025-10-02T19:01:48.857794] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:48.858019] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-02T19:01:48.858070] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-02T19:01:48.859696] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-02T19:01:48.859760] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-02T19:01:49.078182] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-02T19:01:49.273776] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:49.406679] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T19:01:49.873008] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-10-02T19:01:50.667538] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T19:01:50.676128] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-02T19:01:51.473037] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-02T19:01:51.496816] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T19:01:51.748262] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T19:01:52.273062] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-02T19:01:52.990943] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T19:01:53.073000] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-02T19:01:53.872999] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-02T19:01:54.197343] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-02T19:01:54.380296] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T19:01:54.382384] [INFO ] [REMOTE ] FR: Full fetch complete (66737 records). [2025-10-02T19:01:54.382498] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-02T19:01:54.678185] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-02T19:01:54.856530] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-02T19:01:54.877267] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-02T19:01:54.877971] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-02T19:01:54.878997] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-02T19:01:54.879079] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-02T19:01:54.881179] [DEBUG] [LOCAL ] FR: Trimmed 66737 records to 46743 (keeping 200 days of data) [2025-10-02T19:01:55.179492] [DEBUG] [LOCAL ] FR: Primary data saved (46743 records). [2025-10-02T19:01:55.179635] [INFO ] [MAIN ] FR: Full history saved. [2025-10-02T19:01:55.179779] [INFO ] [MAIN ] Update Progress: 868/2370 symbols completed. FR took 27.2s. Estimated remaining: 3h 30m 52s. Rate: 7.1 symbols/min [2025-10-02T19:01:55.371005] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:01:55.415396] [DEBUG] [LOCAL ] FRT: Loaded 41996 existing records from primary storage. [2025-10-02T19:01:55.415772] [INFO ] [MAIN ] FRT: Loaded 41996 existing records. [2025-10-02T19:01:55.480705] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-02T19:01:55.635741] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:01:55.635959] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-02T19:01:55.636010] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-02T19:01:55.637542] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-02T19:01:55.637616] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-02T19:01:56.038807] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:01:56.061629] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T19:01:56.273013] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-02T19:01:56.511025] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T19:01:57.073059] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-10-02T19:01:57.873037] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-02T19:01:58.165868] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-02T19:01:58.568355] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T19:01:58.673027] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-02T19:01:58.696149] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-02T19:01:59.472997] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-02T19:02:00.272979] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-02T19:02:00.304806] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T19:02:00.682020] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-10-02T19:02:01.073026] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-02T19:02:01.825183] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T19:02:01.873126] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-02T19:02:02.673082] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-02T19:02:03.077519] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-02T19:02:03.179517] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T19:02:03.472997] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-02T19:02:04.138681] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T19:02:04.272999] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-02T19:02:04.583889] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T19:02:05.039916] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T19:02:05.040945] [INFO ] [REMOTE ] FRA: Full fetch complete (24043 records). [2025-10-02T19:02:05.041021] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-02T19:02:05.078241] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-02T19:02:05.447584] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-02T19:02:05.447699] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-02T19:02:05.448301] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-02T19:02:05.448367] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-02T19:02:05.449255] [DEBUG] [LOCAL ] FRA: Trimmed 24043 records to 14628 (keeping 200 days of data) [2025-10-02T19:02:05.558681] [DEBUG] [LOCAL ] FRA: Primary data saved (14628 records). [2025-10-02T19:02:05.559001] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-02T19:02:05.559362] [INFO ] [MAIN ] Update Progress: 869/2370 symbols completed. FRA took 35.2s. Estimated remaining: 3h 30m 47s. Rate: 7.1 symbols/min [2025-10-02T19:02:05.759389] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:05.809126] [DEBUG] [LOCAL ] FSCO: Loaded 37554 existing records from primary storage. [2025-10-02T19:02:05.809461] [INFO ] [MAIN ] FSCO: Loaded 37554 existing records. [2025-10-02T19:02:05.878365] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-02T19:02:06.029624] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:06.029866] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-02T19:02:06.029916] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-02T19:02:06.031007] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-02T19:02:06.031095] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-02T19:02:06.431739] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:06.672968] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-02T19:02:06.715443] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:02:07.473008] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-02T19:02:07.847330] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T19:02:07.897509] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T19:02:08.273200] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-02T19:02:08.884787] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T19:02:09.073007] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-02T19:02:09.872988] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-02T19:02:10.257089] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T19:02:10.585527] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-02T19:02:10.673001] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-10-02T19:02:10.706311] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T19:02:11.473062] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-02T19:02:11.745420] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T19:02:12.273046] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-02T19:02:13.073003] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-02T19:02:13.263320] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T19:02:13.451584] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T19:02:13.873003] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-02T19:02:14.565280] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:02:14.673019] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-02T19:02:15.473005] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-02T19:02:15.799002] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T19:02:15.827991] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T19:02:16.272971] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-02T19:02:16.747182] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T19:02:17.073006] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-02T19:02:17.356256] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T19:02:17.873036] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-02T19:02:18.557293] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T19:02:18.672989] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-02T19:02:18.685323] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T19:02:19.473011] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-02T19:02:20.240685] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T19:02:20.242737] [INFO ] [REMOTE ] FRO: Full fetch complete (75244 records). [2025-10-02T19:02:20.242867] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-02T19:02:20.279714] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-02T19:02:20.711201] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-02T19:02:20.711382] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-02T19:02:20.712325] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-02T19:02:20.712401] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-02T19:02:20.718878] [DEBUG] [LOCAL ] FRO: Trimmed 75244 records to 52117 (keeping 200 days of data) [2025-10-02T19:02:20.986370] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T19:02:21.084113] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-02T19:02:21.111741] [DEBUG] [LOCAL ] FRO: Primary data saved (52117 records). [2025-10-02T19:02:21.111899] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-02T19:02:21.113947] [INFO ] [MAIN ] Update Progress: 870/2370 symbols completed. FRO took 32.7s. Estimated remaining: 3h 30m 51s. Rate: 7.1 symbols/min [2025-10-02T19:02:21.221013] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T19:02:21.242392] [INFO ] [REMOTE ] FRGE: Full fetch complete (32481 records). [2025-10-02T19:02:21.263579] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-02T19:02:21.432216] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:21.803245] [DEBUG] [LOCAL ] FSK: Loaded 49410 existing records from primary storage. [2025-10-02T19:02:21.803587] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-02T19:02:21.803788] [INFO ] [MAIN ] FSK: Loaded 49410 existing records. [2025-10-02T19:02:21.803898] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-02T19:02:21.804575] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-02T19:02:21.804719] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-02T19:02:21.875832] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-02T19:02:21.913683] [DEBUG] [LOCAL ] FRGE: Trimmed 32481 records to 17758 (keeping 200 days of data) [2025-10-02T19:02:22.087786] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:22.107099] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-02T19:02:22.112782] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-02T19:02:22.119493] [DEBUG] [LOCAL ] FRGE: Primary data saved (17758 records). [2025-10-02T19:02:22.119672] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-02T19:02:22.119811] [INFO ] [MAIN ] Update Progress: 871/2370 symbols completed. FRGE took 41.7s. Estimated remaining: 3h 30m 29s. Rate: 7.1 symbols/min [2025-10-02T19:02:22.125222] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-02T19:02:22.159660] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-02T19:02:22.461755] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:22.769443] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:22.769998] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-10-02T19:02:22.805632] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-02T19:02:22.832195] [DEBUG] [LOCAL ] FSLY: Loaded 51231 existing records from primary storage. [2025-10-02T19:02:22.833153] [INFO ] [MAIN ] FSLY: Loaded 51231 existing records. [2025-10-02T19:02:23.043748] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:23.043987] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-02T19:02:23.044039] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-02T19:02:23.046014] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-02T19:02:23.046159] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-02T19:02:23.456735] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:23.476579] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-10-02T19:02:23.482386] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T19:02:24.272981] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-02T19:02:24.457724] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T19:02:24.805262] [DEBUG] [REMOTE ] FRT: Error fetching primary data for 2025-08: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-10-02T19:02:24.805422] [WARN ] [REMOTE ] FRT: No data returned for month 2025-08 [2025-10-02T19:02:24.805499] [FATAL] [REMOTE ] FRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:02:24.805574] [FATAL] [MAIN ] FRT: Failed to fetch primary data. [2025-10-02T19:02:24.805667] [WARN ] [MAIN ] FRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:02:24.805745] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-02T19:02:24.805816] [DEBUG] [LOCAL ] FRT: No primary data file found to delete. [2025-10-02T19:02:24.805864] [INFO ] [LOCAL ] FRT: Starting deletion of derivative data. [2025-10-02T19:02:24.806259] [DEBUG] [LOCAL ] FRT: Deleted derivative data file. [2025-10-02T19:02:24.806337] [INFO ] [MAIN ] Update Progress: 872/2370 symbols completed. FRT took 29.6s. Estimated remaining: 3h 30m 11s. Rate: 7.1 symbols/min [2025-10-02T19:02:25.011041] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:25.069849] [DEBUG] [LOCAL ] FSM: Loaded 53292 existing records from primary storage. [2025-10-02T19:02:25.070240] [INFO ] [MAIN ] FSM: Loaded 53292 existing records. [2025-10-02T19:02:25.082620] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-02T19:02:25.303724] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:25.304059] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-02T19:02:25.304193] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-02T19:02:25.305915] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-02T19:02:25.305994] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-02T19:02:25.455377] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-10-02T19:02:25.763757] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:25.873014] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-02T19:02:26.310329] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-02T19:02:26.673067] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-10-02T19:02:27.473004] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-02T19:02:27.581232] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T19:02:28.276018] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-02T19:02:28.282623] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T19:02:28.842285] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T19:02:29.072997] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-02T19:02:29.396813] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T19:02:29.873028] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-02T19:02:30.672968] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-02T19:02:30.713114] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T19:02:30.850590] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T19:02:31.473033] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-02T19:02:32.272978] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-02T19:02:32.424012] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T19:02:33.072990] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-02T19:02:33.142414] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T19:02:33.565585] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T19:02:33.873035] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-02T19:02:34.502921] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:02:34.673027] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-02T19:02:35.472991] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-02T19:02:35.691338] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:02:36.272976] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-02T19:02:36.394397] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-02T19:02:36.921117] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T19:02:37.073017] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-02T19:02:37.873007] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-02T19:02:37.932028] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T19:02:38.672996] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-02T19:02:38.801398] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T19:02:39.411837] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T19:02:39.473017] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-02T19:02:40.180035] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T19:02:40.273028] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-02T19:02:40.972816] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T19:02:41.073039] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-02T19:02:41.729946] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-02T19:02:41.873032] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-02T19:02:42.492186] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T19:02:42.673033] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-02T19:02:43.249269] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T19:02:43.251393] [INFO ] [REMOTE ] FSCO: Full fetch complete (54403 records). [2025-10-02T19:02:43.251499] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-02T19:02:43.476942] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-02T19:02:43.725721] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-02T19:02:43.725821] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-02T19:02:43.726679] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-02T19:02:43.726758] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-02T19:02:43.728020] [DEBUG] [LOCAL ] FSCO: Trimmed 54403 records to 37913 (keeping 200 days of data) [2025-10-02T19:02:43.981214] [DEBUG] [LOCAL ] FSCO: Primary data saved (37913 records). [2025-10-02T19:02:43.981363] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-02T19:02:43.981488] [INFO ] [MAIN ] Update Progress: 873/2370 symbols completed. FSCO took 38.4s. Estimated remaining: 3h 30m 21s. Rate: 7.1 symbols/min [2025-10-02T19:02:44.184510] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:44.222264] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T19:02:44.272345] [DEBUG] [LOCAL ] FSS: Loaded 34065 existing records from primary storage. [2025-10-02T19:02:44.272681] [INFO ] [MAIN ] FSS: Loaded 34065 existing records. [2025-10-02T19:02:44.278208] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-02T19:02:44.478316] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:44.478578] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-02T19:02:44.478628] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-02T19:02:44.481021] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-02T19:02:44.481087] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-02T19:02:44.905696] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:45.073115] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-02T19:02:45.389463] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T19:02:45.873015] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-02T19:02:46.114935] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T19:02:46.470551] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T19:02:46.673066] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-02T19:02:47.179194] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T19:02:47.473021] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-02T19:02:48.273022] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-02T19:02:48.547760] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T19:02:48.799341] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:02:49.073050] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-02T19:02:49.872970] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-02T19:02:50.094782] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T19:02:50.673047] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-02T19:02:50.917195] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T19:02:51.473002] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-10-02T19:02:51.636477] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T19:02:52.272996] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-02T19:02:52.391566] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T19:02:52.423996] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T19:02:53.073034] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-02T19:02:53.872998] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-02T19:02:54.036624] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T19:02:54.291300] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-02T19:02:54.673048] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-02T19:02:55.447942] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T19:02:55.450507] [INFO ] [REMOTE ] FSM: Full fetch complete (76769 records). [2025-10-02T19:02:55.450710] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-02T19:02:55.478181] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-02T19:02:55.906405] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-02T19:02:55.906527] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-02T19:02:55.908713] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-02T19:02:55.908803] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-02T19:02:55.910525] [DEBUG] [LOCAL ] FSM: Trimmed 76769 records to 53680 (keeping 200 days of data) [2025-10-02T19:02:56.027533] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T19:02:56.032859] [INFO ] [REMOTE ] FSK: Full fetch complete (71538 records). [2025-10-02T19:02:56.035136] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-02T19:02:56.308525] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-02T19:02:56.706673] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-02T19:02:56.717535] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-02T19:02:56.721800] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-02T19:02:56.721977] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-02T19:02:56.740954] [DEBUG] [LOCAL ] FSM: Primary data saved (53680 records). [2025-10-02T19:02:56.741373] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-02T19:02:56.741810] [INFO ] [MAIN ] Update Progress: 874/2370 symbols completed. FSM took 31.9s. Estimated remaining: 3h 30m 20s. Rate: 7.1 symbols/min [2025-10-02T19:02:56.747596] [DEBUG] [LOCAL ] FSK: Trimmed 71538 records to 49800 (keeping 200 days of data) [2025-10-02T19:02:56.991159] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T19:02:57.082870] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-02T19:02:57.088366] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:57.109987] [DEBUG] [LOCAL ] FT: Loaded 6535 existing records from primary storage. [2025-10-02T19:02:57.112219] [INFO ] [MAIN ] FT: Loaded 6535 existing records. [2025-10-02T19:02:57.357109] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:57.363524] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-02T19:02:57.372993] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-02T19:02:57.373527] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-02T19:02:57.373598] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-02T19:02:57.975521] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:57.977296] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-10-02T19:02:58.078829] [DEBUG] [LOCAL ] FSK: Primary data saved (49800 records). [2025-10-02T19:02:58.078996] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-02T19:02:58.079816] [INFO ] [MAIN ] Update Progress: 875/2370 symbols completed. FSK took 37.0s. Estimated remaining: 3h 29m 59s. Rate: 7.1 symbols/min [2025-10-02T19:02:58.285904] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:02:58.325877] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-10-02T19:02:58.344812] [DEBUG] [LOCAL ] FTHY: Loaded 11958 existing records from primary storage. [2025-10-02T19:02:58.345264] [INFO ] [MAIN ] FTHY: Loaded 11958 existing records. [2025-10-02T19:02:58.517151] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T19:02:58.509995] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-02T19:02:58.613059] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:02:58.613579] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-02T19:02:58.613629] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-02T19:02:58.614595] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-02T19:02:58.614698] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-02T19:02:58.682104] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-02T19:02:59.020268] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:02:59.189861] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-02T19:02:59.473015] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-02T19:03:00.273007] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-02T19:03:01.073038] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-02T19:03:01.752697] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T19:03:01.783772] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-02T19:03:01.873024] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-10-02T19:03:02.165905] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-02T19:03:02.168851] [INFO ] [REMOTE ] FSLY: Full fetch complete (74894 records). [2025-10-02T19:03:02.168982] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-02T19:03:02.609131] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-02T19:03:02.609251] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-02T19:03:02.610170] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-02T19:03:02.610237] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-02T19:03:02.611992] [DEBUG] [LOCAL ] FSLY: Trimmed 74894 records to 51615 (keeping 200 days of data) [2025-10-02T19:03:02.674983] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-02T19:03:02.836008] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-10-02T19:03:02.952558] [DEBUG] [LOCAL ] FSLY: Primary data saved (51615 records). [2025-10-02T19:03:02.952731] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-02T19:03:02.952825] [INFO ] [MAIN ] Update Progress: 876/2370 symbols completed. FSLY took 40.8s. Estimated remaining: 3h 29m 45s. Rate: 7.1 symbols/min [2025-10-02T19:03:03.149807] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-02T19:03:03.154353] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:03:03.213732] [DEBUG] [LOCAL ] FTI: Loaded 53299 existing records from primary storage. [2025-10-02T19:03:03.214119] [INFO ] [MAIN ] FTI: Loaded 53299 existing records. [2025-10-02T19:03:03.413005] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:03:03.413295] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-02T19:03:03.413353] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-02T19:03:03.415207] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-02T19:03:03.415270] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-02T19:03:03.478492] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-02T19:03:03.805904] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:03:04.272996] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-10-02T19:03:04.393402] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T19:03:05.073006] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-02T19:03:05.781842] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-02T19:03:05.872991] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-02T19:03:06.022807] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-10-02T19:03:06.661055] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T19:03:06.672955] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-02T19:03:07.232057] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-02T19:03:07.473044] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-02T19:03:08.085835] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T19:03:08.273041] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-02T19:03:09.073030] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-02T19:03:09.325620] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T19:03:09.801536] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T19:03:09.872992] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-02T19:03:10.598237] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T19:03:10.673043] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-02T19:03:11.473087] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-02T19:03:12.273062] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-02T19:03:12.371187] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:03:12.840556] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:03:13.022452] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T19:03:13.073020] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-02T19:03:13.690231] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T19:03:13.691262] [INFO ] [REMOTE ] FT: Full fetch complete (9155 records). [2025-10-02T19:03:13.691352] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-02T19:03:13.886399] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-02T19:03:14.104873] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-02T19:03:14.104962] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-02T19:03:14.105207] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-02T19:03:14.105249] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-02T19:03:14.105731] [DEBUG] [LOCAL ] FT: Trimmed 9155 records to 6571 (keeping 200 days of data) [2025-10-02T19:03:14.152233] [DEBUG] [LOCAL ] FT: Primary data saved (6571 records). [2025-10-02T19:03:14.152373] [INFO ] [MAIN ] FT: Full history saved. [2025-10-02T19:03:14.152494] [INFO ] [MAIN ] Update Progress: 877/2370 symbols completed. FT took 17.4s. Estimated remaining: 3h 29m 41s. Rate: 7.1 symbols/min [2025-10-02T19:03:14.673058] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-02T19:03:15.473267] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-02T19:03:15.596519] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T19:03:15.881095] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T19:03:15.907403] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-02T19:03:16.273027] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-02T19:03:17.073005] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-02T19:03:17.244436] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T19:03:17.873001] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-02T19:03:18.171321] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T19:03:18.673043] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-02T19:03:19.287547] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T19:03:19.449930] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T19:03:19.473007] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-02T19:03:20.273071] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-02T19:03:20.805913] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T19:03:21.073144] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-02T19:03:21.873098] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-02T19:03:21.982999] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T19:03:21.985441] [INFO ] [REMOTE ] FSS: Full fetch complete (48386 records). [2025-10-02T19:03:21.985630] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-02T19:03:22.428159] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-02T19:03:22.486775] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-02T19:03:22.487625] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-02T19:03:22.488897] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-02T19:03:22.488971] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-02T19:03:22.490619] [DEBUG] [LOCAL ] FSS: Trimmed 48386 records to 34339 (keeping 200 days of data) [2025-10-02T19:03:22.678418] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-02T19:03:22.714469] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T19:03:22.749087] [DEBUG] [LOCAL ] FSS: Primary data saved (34339 records). [2025-10-02T19:03:22.749315] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-02T19:03:22.749429] [INFO ] [MAIN ] Update Progress: 878/2370 symbols completed. FSS took 38.8s. Estimated remaining: 3h 29m 33s. Rate: 7.1 symbols/min [2025-10-02T19:03:23.473022] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-02T19:03:24.263144] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T19:03:24.272961] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-02T19:03:24.368580] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T19:03:24.748794] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-02T19:03:25.073064] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-02T19:03:25.873124] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-02T19:03:25.908581] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T19:03:26.673113] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-02T19:03:27.507515] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T19:03:27.509028] [INFO ] [REMOTE ] FTHY: Full fetch complete (17575 records). [2025-10-02T19:03:27.509145] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-02T19:03:27.887916] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T19:03:28.027330] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-02T19:03:28.028928] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-02T19:03:28.029044] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-02T19:03:28.029703] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-02T19:03:28.029777] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-02T19:03:28.030808] [DEBUG] [LOCAL ] FTHY: Trimmed 17575 records to 12100 (keeping 200 days of data) [2025-10-02T19:03:28.115178] [DEBUG] [LOCAL ] FTHY: Primary data saved (12100 records). [2025-10-02T19:03:28.115335] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-02T19:03:28.115425] [INFO ] [MAIN ] Update Progress: 879/2370 symbols completed. FTHY took 30.0s. Estimated remaining: 3h 29m 20s. Rate: 7.1 symbols/min [2025-10-02T19:03:29.814271] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T19:03:29.827215] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-02T19:03:31.213501] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T19:03:31.225413] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-02T19:03:32.694841] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T19:03:32.706969] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-02T19:03:34.156534] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T19:03:34.159245] [INFO ] [REMOTE ] FTI: Full fetch complete (77132 records). [2025-10-02T19:03:34.159416] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-02T19:03:34.628282] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-02T19:03:34.628388] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-02T19:03:34.629496] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-02T19:03:34.629574] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-02T19:03:34.631539] [DEBUG] [LOCAL ] FTI: Trimmed 77132 records to 53689 (keeping 200 days of data) [2025-10-02T19:03:34.992359] [DEBUG] [LOCAL ] FTI: Primary data saved (53689 records). [2025-10-02T19:03:34.992500] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-02T19:03:34.992584] [INFO ] [MAIN ] Update Progress: 880/2370 symbols completed. FTI took 32.0s. Estimated remaining: 3h 29m 8s. Rate: 7.1 symbols/min [2025-10-02T19:03:35.654604] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:03:35.767817] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:03:35.801499] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:03:35.829522] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:03:35.835806] [DEBUG] [LOCAL ] FTWO: Loaded 1816 existing records from primary storage. [2025-10-02T19:03:35.836140] [INFO ] [MAIN ] FTWO: Loaded 1816 existing records. [2025-10-02T19:03:36.099316] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:03:36.100424] [DEBUG] [LOCAL ] FTK: Loaded 32200 existing records from primary storage. [2025-10-02T19:03:36.112517] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-02T19:03:36.114138] [INFO ] [MAIN ] FTK: Loaded 32200 existing records. [2025-10-02T19:03:36.119796] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-02T19:03:36.153433] [DEBUG] [LOCAL ] FTS: Loaded 42138 existing records from primary storage. [2025-10-02T19:03:36.191755] [INFO ] [MAIN ] FTS: Loaded 42138 existing records. [2025-10-02T19:03:36.208310] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-02T19:03:36.230389] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-02T19:03:36.219547] [DEBUG] [LOCAL ] FTV: Loaded 52928 existing records from primary storage. [2025-10-02T19:03:36.329361] [INFO ] [MAIN ] FTV: Loaded 52928 existing records. [2025-10-02T19:03:36.758753] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:03:36.792129] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-02T19:03:36.881510] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-02T19:03:36.966504] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:03:37.026336] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-02T19:03:37.047593] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-02T19:03:37.030584] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:03:37.052944] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-02T19:03:37.042244] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-02T19:03:37.070479] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-02T19:03:37.102928] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-02T19:03:37.117998] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-02T19:03:37.173702] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-02T19:03:37.284731] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-02T19:03:37.349628] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-02T19:03:37.595146] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:03:37.718605] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-10-02T19:03:38.551404] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:03:38.583205] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-10-02T19:03:38.577527] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:03:38.582775] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:03:38.588057] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-10-02T19:03:38.587604] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-10-02T19:03:38.592022] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T19:03:38.594393] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-02T19:03:38.971638] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-02T19:03:38.973404] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-02T19:03:39.600452] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-02T19:03:39.601930] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-02T19:03:39.965067] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:03:39.970676] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-02T19:03:40.075266] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-02T19:03:40.076587] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-02T19:03:40.151914] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T19:03:40.163248] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-02T19:03:40.370053] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T19:03:40.380327] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-02T19:03:40.384724] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-02T19:03:40.386027] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-02T19:03:40.657791] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-02T19:03:40.659427] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-02T19:03:41.103836] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T19:03:41.110872] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-02T19:03:41.187418] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T19:03:41.599345] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:03:41.841603] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T19:03:41.872962] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-02T19:03:41.975575] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T19:03:42.672993] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-02T19:03:43.243055] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T19:03:43.472997] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-02T19:03:43.925053] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T19:03:44.273004] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-02T19:03:44.893587] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T19:03:45.073008] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-02T19:03:45.421442] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T19:03:45.508451] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T19:03:45.873031] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-02T19:03:46.673030] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-02T19:03:47.305419] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:03:47.473004] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-02T19:03:48.272974] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-02T19:03:48.498964] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T19:03:48.798048] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T19:03:49.007837] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T19:03:49.073016] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-02T19:03:49.872997] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-02T19:03:50.531711] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T19:03:50.672995] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-02T19:03:51.356825] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:03:51.473054] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-02T19:03:52.273021] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-02T19:03:52.476004] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:03:52.906690] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T19:03:53.073002] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-02T19:03:53.537964] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T19:03:53.873004] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-02T19:03:54.180343] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-02T19:03:54.429811] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T19:03:54.673005] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-02T19:03:55.473005] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-02T19:03:55.864892] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T19:03:55.865602] [INFO ] [REMOTE ] FTWO: Full fetch complete (3344 records). [2025-10-02T19:03:55.865702] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-02T19:03:56.280233] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-02T19:03:56.289016] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-02T19:03:56.289099] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-02T19:03:56.289353] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-02T19:03:56.289430] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-02T19:03:56.290108] [DEBUG] [LOCAL ] FTWO: Trimmed 3344 records to 1836 (keeping 200 days of data) [2025-10-02T19:03:56.317254] [DEBUG] [LOCAL ] FTWO: Primary data saved (1836 records). [2025-10-02T19:03:56.328631] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-02T19:03:56.328983] [INFO ] [MAIN ] Update Progress: 881/2370 symbols completed. FTWO took 21.3s. Estimated remaining: 3h 29m 22s. Rate: 7.1 symbols/min [2025-10-02T19:03:56.335986] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T19:03:56.544917] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:03:56.600098] [DEBUG] [LOCAL ] FUBO: Loaded 53697 existing records from primary storage. [2025-10-02T19:03:56.600485] [INFO ] [MAIN ] FUBO: Loaded 53697 existing records. [2025-10-02T19:03:56.803290] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:03:56.803532] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-02T19:03:56.803583] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-02T19:03:56.805267] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-02T19:03:56.805335] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-02T19:03:57.080359] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-02T19:03:57.224224] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:03:57.466599] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-02T19:03:57.872999] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-10-02T19:03:58.672990] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-02T19:03:59.035084] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T19:03:59.472971] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-02T19:03:59.628257] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T19:04:00.003939] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-10-02T19:04:00.272995] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-02T19:04:01.073023] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-02T19:04:01.769952] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-10-02T19:04:01.873013] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-02T19:04:02.673001] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-02T19:04:03.287684] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (3.01 seconds). [2025-10-02T19:04:03.473026] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-02T19:04:03.692384] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-10-02T19:04:03.908396] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T19:04:03.910871] [INFO ] [REMOTE ] FTK: Full fetch complete (43105 records). [2025-10-02T19:04:03.911013] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-02T19:04:04.278009] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-02T19:04:04.287347] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-10-02T19:04:04.547195] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-02T19:04:04.547318] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-02T19:04:04.548593] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-02T19:04:04.548779] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-02T19:04:04.550560] [DEBUG] [LOCAL ] FTK: Trimmed 43105 records to 32441 (keeping 200 days of data) [2025-10-02T19:04:04.820515] [DEBUG] [LOCAL ] FTK: Primary data saved (32441 records). [2025-10-02T19:04:04.820799] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-02T19:04:04.820920] [INFO ] [MAIN ] Update Progress: 882/2370 symbols completed. FTK took 29.8s. Estimated remaining: 3h 29m 14s. Rate: 7.1 symbols/min [2025-10-02T19:04:05.057353] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:05.078950] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-02T19:04:05.095927] [DEBUG] [LOCAL ] FUL: Loaded 32983 existing records from primary storage. [2025-10-02T19:04:05.096298] [INFO ] [MAIN ] FUL: Loaded 32983 existing records. [2025-10-02T19:04:05.311208] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:05.311505] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-02T19:04:05.311558] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-02T19:04:05.313065] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-02T19:04:05.313129] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-02T19:04:05.712548] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:05.745894] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-02T19:04:05.873032] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-02T19:04:06.086116] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T19:04:06.628938] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T19:04:06.673041] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-02T19:04:07.473008] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-02T19:04:07.888954] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-02T19:04:07.958928] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T19:04:08.273035] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-02T19:04:08.945399] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T19:04:08.947734] [INFO ] [REMOTE ] FTV: Full fetch complete (76321 records). [2025-10-02T19:04:08.947856] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-02T19:04:09.078172] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-02T19:04:09.384772] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-02T19:04:09.389268] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-02T19:04:09.390981] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-02T19:04:09.391270] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T19:04:09.392903] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-02T19:04:09.394063] [INFO ] [REMOTE ] FTS: Full fetch complete (60194 records). [2025-10-02T19:04:09.394491] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-02T19:04:09.431416] [DEBUG] [LOCAL ] FTV: Trimmed 76321 records to 53318 (keeping 200 days of data) [2025-10-02T19:04:09.882526] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-10-02T19:04:09.947798] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-02T19:04:09.949004] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-02T19:04:09.950446] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-02T19:04:09.950573] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-02T19:04:09.957630] [DEBUG] [LOCAL ] FTS: Trimmed 60194 records to 42461 (keeping 200 days of data) [2025-10-02T19:04:10.461912] [DEBUG] [LOCAL ] FTS: Primary data saved (42461 records). [2025-10-02T19:04:10.462945] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-02T19:04:10.463734] [INFO ] [MAIN ] Update Progress: 883/2370 symbols completed. FTS took 35.5s. Estimated remaining: 3h 29m 0s. Rate: 7.1 symbols/min [2025-10-02T19:04:10.539766] [DEBUG] [LOCAL ] FTV: Primary data saved (53318 records). [2025-10-02T19:04:10.551038] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-02T19:04:10.574925] [INFO ] [MAIN ] Update Progress: 884/2370 symbols completed. FTV took 35.6s. Estimated remaining: 3h 28m 38s. Rate: 7.1 symbols/min [2025-10-02T19:04:10.778951] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:10.860634] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:10.887067] [DEBUG] [LOCAL ] FVR: Loaded 21768 existing records from primary storage. [2025-10-02T19:04:10.900472] [INFO ] [MAIN ] FVR: Loaded 21768 existing records. [2025-10-02T19:04:11.062378] [DEBUG] [LOCAL ] FUN: Loaded 51609 existing records from primary storage. [2025-10-02T19:04:11.108019] [INFO ] [MAIN ] FUN: Loaded 51609 existing records. [2025-10-02T19:04:11.141349] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:11.153917] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-02T19:04:11.231168] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-02T19:04:11.232332] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T19:04:11.306178] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-02T19:04:11.312812] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-10-02T19:04:11.306254] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-02T19:04:11.337277] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-02T19:04:11.476015] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-02T19:04:11.475487] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:11.509842] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-02T19:04:11.521731] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-02T19:04:11.549731] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-02T19:04:11.570638] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-02T19:04:12.089430] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:12.278057] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-10-02T19:04:12.282153] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:12.823370] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:04:13.073013] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-02T19:04:13.402583] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T19:04:13.439371] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T19:04:13.873052] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-02T19:04:14.505666] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:04:14.670925] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T19:04:14.674840] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-02T19:04:15.473057] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-10-02T19:04:16.243396] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:04:16.273012] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-02T19:04:17.073000] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-02T19:04:17.140900] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T19:04:17.231586] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T19:04:17.873016] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-02T19:04:18.619501] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T19:04:18.673074] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-02T19:04:18.944476] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T19:04:19.473008] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-02T19:04:19.922762] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T19:04:20.273009] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-02T19:04:20.923679] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:04:21.073052] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-02T19:04:21.575903] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T19:04:21.873004] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-02T19:04:22.190573] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T19:04:22.672976] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-02T19:04:22.883205] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-02T19:04:23.473049] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-02T19:04:24.232863] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:04:24.272963] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-02T19:04:25.072984] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-02T19:04:25.573489] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-02T19:04:25.662362] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T19:04:25.873046] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-02T19:04:26.247828] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T19:04:26.673022] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-02T19:04:27.122435] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T19:04:27.473043] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-02T19:04:28.273036] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-02T19:04:28.445565] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T19:04:29.073033] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-02T19:04:29.594996] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T19:04:29.730829] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-10-02T19:04:29.873014] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-02T19:04:30.678344] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-02T19:04:30.697232] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:04:30.838931] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T19:04:31.472997] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-02T19:04:31.769288] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T19:04:32.273023] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-02T19:04:33.072971] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-02T19:04:33.289587] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T19:04:33.340436] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T19:04:33.873006] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-02T19:04:34.249365] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T19:04:34.251245] [INFO ] [REMOTE ] FUL: Full fetch complete (47596 records). [2025-10-02T19:04:34.251406] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-02T19:04:34.675062] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-02T19:04:34.691895] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-02T19:04:34.692855] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-02T19:04:34.693678] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-02T19:04:34.693745] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-02T19:04:34.695042] [DEBUG] [LOCAL ] FUL: Trimmed 47596 records to 33213 (keeping 200 days of data) [2025-10-02T19:04:34.913812] [DEBUG] [LOCAL ] FUL: Primary data saved (33213 records). [2025-10-02T19:04:34.914028] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-02T19:04:34.914143] [INFO ] [MAIN ] Update Progress: 885/2370 symbols completed. FUL took 30.1s. Estimated remaining: 3h 28m 56s. Rate: 7.1 symbols/min [2025-10-02T19:04:35.103396] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:35.145243] [DEBUG] [LOCAL ] FVRR: Loaded 40034 existing records from primary storage. [2025-10-02T19:04:35.145552] [INFO ] [MAIN ] FVRR: Loaded 40034 existing records. [2025-10-02T19:04:35.340385] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:35.340695] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-02T19:04:35.340758] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-02T19:04:35.343796] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-02T19:04:35.343862] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-02T19:04:35.478149] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-02T19:04:35.754275] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:35.788179] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T19:04:36.274400] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-02T19:04:36.279444] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T19:04:36.597055] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T19:04:37.073011] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-02T19:04:37.872978] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-02T19:04:38.076006] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T19:04:38.672984] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-10-02T19:04:38.898941] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T19:04:38.992961] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-02T19:04:39.473042] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-02T19:04:40.224352] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T19:04:40.272997] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-02T19:04:41.001179] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-02T19:04:41.003603] [INFO ] [REMOTE ] FUN: Full fetch complete (72878 records). [2025-10-02T19:04:41.003820] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-02T19:04:41.078177] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-02T19:04:41.436835] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-02T19:04:41.437067] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-02T19:04:41.438013] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-02T19:04:41.438084] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-02T19:04:41.439787] [DEBUG] [LOCAL ] FUN: Trimmed 72878 records to 51989 (keeping 200 days of data) [2025-10-02T19:04:41.782278] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-02T19:04:41.803450] [DEBUG] [LOCAL ] FUN: Primary data saved (51989 records). [2025-10-02T19:04:41.803610] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-02T19:04:41.803730] [INFO ] [MAIN ] Update Progress: 886/2370 symbols completed. FUN took 31.3s. Estimated remaining: 3h 28m 45s. Rate: 7.1 symbols/min [2025-10-02T19:04:41.876455] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-02T19:04:41.958418] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T19:04:41.994348] [INFO ] [REMOTE ] FVR: Full fetch complete (30312 records). [2025-10-02T19:04:42.018540] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:42.018779] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-02T19:04:42.114218] [DEBUG] [LOCAL ] FXED: Loaded 1241 existing records from primary storage. [2025-10-02T19:04:42.133686] [INFO ] [MAIN ] FXED: Loaded 1241 existing records. [2025-10-02T19:04:42.529765] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:42.547335] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-02T19:04:42.568302] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-02T19:04:42.577197] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-02T19:04:42.587541] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-02T19:04:42.690856] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-02T19:04:42.732468] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-02T19:04:42.758423] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-02T19:04:42.778621] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-02T19:04:42.778833] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-02T19:04:42.829004] [DEBUG] [LOCAL ] FVR: Trimmed 30312 records to 21880 (keeping 200 days of data) [2025-10-02T19:04:43.173121] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:43.218929] [DEBUG] [LOCAL ] FVR: Primary data saved (21880 records). [2025-10-02T19:04:43.219068] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-02T19:04:43.219187] [INFO ] [MAIN ] Update Progress: 887/2370 symbols completed. FVR took 32.6s. Estimated remaining: 3h 28m 25s. Rate: 7.1 symbols/min [2025-10-02T19:04:43.411188] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:43.466775] [DEBUG] [LOCAL ] G: Loaded 49838 existing records from primary storage. [2025-10-02T19:04:43.467130] [INFO ] [MAIN ] G: Loaded 49838 existing records. [2025-10-02T19:04:43.502615] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-10-02T19:04:43.662195] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:43.662417] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-02T19:04:43.662467] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-02T19:04:43.665066] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-02T19:04:43.665130] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-02T19:04:43.972618] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-02T19:04:43.995304] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.12 seconds). [2025-10-02T19:04:44.046174] [INFO ] [REMOTE ] FUBO: Full fetch complete (77767 records). [2025-10-02T19:04:44.069749] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-02T19:04:44.069579] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:44.276041] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-10-02T19:04:44.545469] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-02T19:04:44.549246] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-02T19:04:44.550708] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-02T19:04:44.552800] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-02T19:04:44.553023] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-02T19:04:44.568408] [DEBUG] [LOCAL ] FUBO: Trimmed 77767 records to 54087 (keeping 200 days of data) [2025-10-02T19:04:44.919666] [DEBUG] [LOCAL ] FUBO: Primary data saved (54087 records). [2025-10-02T19:04:44.919828] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-02T19:04:44.919913] [INFO ] [MAIN ] Update Progress: 888/2370 symbols completed. FUBO took 48.6s. Estimated remaining: 3h 28m 5s. Rate: 7.1 symbols/min [2025-10-02T19:04:45.080231] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-02T19:04:45.116186] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:04:45.146847] [DEBUG] [LOCAL ] GAB: Loaded 27976 existing records from primary storage. [2025-10-02T19:04:45.147114] [INFO ] [MAIN ] GAB: Loaded 27976 existing records. [2025-10-02T19:04:45.342738] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:04:45.342944] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-02T19:04:45.342994] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-02T19:04:45.345111] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-02T19:04:45.345175] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-02T19:04:45.751102] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:04:45.873003] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-02T19:04:45.935357] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T19:04:46.524224] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T19:04:46.561962] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T19:04:46.673005] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-02T19:04:47.002841] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-02T19:04:47.473033] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-02T19:04:48.273003] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-10-02T19:04:48.932911] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T19:04:49.073010] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-02T19:04:49.487104] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-10-02T19:04:49.873003] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-02T19:04:50.568227] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:04:50.672976] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-02T19:04:50.984515] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T19:04:51.473007] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-02T19:04:52.082862] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:04:52.273003] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-02T19:04:52.418748] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T19:04:53.073016] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-02T19:04:53.431372] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-02T19:04:53.545504] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T19:04:53.873003] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-02T19:04:54.319269] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T19:04:54.672995] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-02T19:04:55.472997] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-02T19:04:56.015937] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-02T19:04:56.273006] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-02T19:04:56.629590] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-02T19:04:57.078320] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-02T19:04:57.094165] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T19:04:57.372863] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-02T19:04:57.873001] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-02T19:04:58.673027] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-02T19:04:58.958722] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-02T19:04:59.451028] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:04:59.472972] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-02T19:05:00.273030] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-02T19:05:01.073014] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-02T19:05:01.386930] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T19:05:01.438880] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-02T19:05:01.873018] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-02T19:05:02.519449] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T19:05:02.672984] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-02T19:05:02.998261] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-02T19:05:03.473001] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-02T19:05:03.915813] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-02T19:05:04.272981] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-02T19:05:04.655574] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T19:05:05.072967] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-02T19:05:05.480988] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T19:05:05.873030] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-02T19:05:06.672988] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-02T19:05:06.768449] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T19:05:07.081944] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-02T19:05:07.082608] [INFO ] [REMOTE ] FXED: Full fetch complete (1803 records). [2025-10-02T19:05:07.082707] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-02T19:05:07.391819] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-02T19:05:07.480716] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-02T19:05:07.515777] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-02T19:05:07.515863] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-02T19:05:07.515977] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-02T19:05:07.516053] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-02T19:05:07.516410] [DEBUG] [LOCAL ] FXED: Trimmed 1803 records to 1253 (keeping 200 days of data) [2025-10-02T19:05:07.526766] [DEBUG] [LOCAL ] FXED: Primary data saved (1253 records). [2025-10-02T19:05:07.526846] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-02T19:05:07.526950] [INFO ] [MAIN ] Update Progress: 889/2370 symbols completed. FXED took 25.7s. Estimated remaining: 3h 28m 21s. Rate: 7.1 symbols/min [2025-10-02T19:05:07.711215] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:07.723704] [DEBUG] [LOCAL ] GAM: Loaded 4061 existing records from primary storage. [2025-10-02T19:05:07.723930] [INFO ] [MAIN ] GAM: Loaded 4061 existing records. [2025-10-02T19:05:07.925222] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:05:07.925532] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-02T19:05:07.925606] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-02T19:05:07.926033] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-02T19:05:07.926109] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-02T19:05:08.278183] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-02T19:05:08.338135] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:08.834079] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T19:05:08.835887] [INFO ] [REMOTE ] FVRR: Full fetch complete (59003 records). [2025-10-02T19:05:08.835980] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-02T19:05:09.077121] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-02T19:05:09.260880] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-02T19:05:09.261023] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-02T19:05:09.261854] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-02T19:05:09.262062] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-02T19:05:09.280957] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T19:05:09.280122] [DEBUG] [LOCAL ] FVRR: Trimmed 59003 records to 40323 (keeping 200 days of data) [2025-10-02T19:05:09.543278] [DEBUG] [LOCAL ] FVRR: Primary data saved (40323 records). [2025-10-02T19:05:09.543451] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-02T19:05:09.543602] [INFO ] [MAIN ] Update Progress: 890/2370 symbols completed. FVRR took 34.6s. Estimated remaining: 3h 28m 1s. Rate: 7.1 symbols/min [2025-10-02T19:05:09.726098] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:09.783062] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-10-02T19:05:09.783404] [INFO ] [MAIN ] GAP: Loaded 53655 existing records. [2025-10-02T19:05:09.880378] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-10-02T19:05:09.980229] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:05:09.980467] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-02T19:05:09.980539] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-02T19:05:09.983165] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-02T19:05:09.983229] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-02T19:05:10.380244] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:10.512023] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T19:05:10.673022] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-02T19:05:10.680933] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T19:05:11.473006] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-02T19:05:12.063605] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-02T19:05:12.273006] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-02T19:05:12.340566] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T19:05:13.073019] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-10-02T19:05:13.187602] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T19:05:13.872995] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-02T19:05:14.624519] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-10-02T19:05:14.643199] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T19:05:14.672969] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-02T19:05:15.473051] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-02T19:05:16.272997] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-02T19:05:16.548718] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T19:05:16.743807] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-02T19:05:17.073031] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-02T19:05:17.872987] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-02T19:05:17.981094] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T19:05:18.512290] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T19:05:18.628416] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T19:05:18.672992] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-02T19:05:19.473024] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-02T19:05:19.506748] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T19:05:19.508257] [INFO ] [REMOTE ] GAB: Full fetch complete (39597 records). [2025-10-02T19:05:19.508383] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-02T19:05:19.938628] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-02T19:05:19.938793] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-02T19:05:19.939480] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-02T19:05:19.939526] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-02T19:05:19.940600] [DEBUG] [LOCAL ] GAB: Trimmed 39597 records to 28112 (keeping 200 days of data) [2025-10-02T19:05:20.120703] [DEBUG] [LOCAL ] GAB: Primary data saved (28112 records). [2025-10-02T19:05:20.120842] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-02T19:05:20.120939] [INFO ] [MAIN ] Update Progress: 891/2370 symbols completed. GAB took 35.2s. Estimated remaining: 3h 27m 57s. Rate: 7.1 symbols/min [2025-10-02T19:05:20.278205] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-02T19:05:20.312361] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:20.333757] [DEBUG] [LOCAL ] GATX: Loaded 18174 existing records from primary storage. [2025-10-02T19:05:20.334030] [INFO ] [MAIN ] GATX: Loaded 18174 existing records. [2025-10-02T19:05:20.533485] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:05:20.533823] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-02T19:05:20.533886] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-02T19:05:20.535085] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-02T19:05:20.535160] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-02T19:05:20.937928] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:20.976960] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T19:05:20.994246] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T19:05:21.073023] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-02T19:05:21.872984] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-10-02T19:05:22.672993] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-02T19:05:22.794569] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T19:05:22.927917] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T19:05:23.473081] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-02T19:05:24.047548] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T19:05:24.273000] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-02T19:05:24.576771] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T19:05:24.663479] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-02T19:05:25.073000] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-02T19:05:25.873010] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-02T19:05:26.672984] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-02T19:05:26.915024] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T19:05:27.089472] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-02T19:05:27.473049] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-02T19:05:27.966274] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-02T19:05:28.266359] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T19:05:28.277029] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-02T19:05:29.073029] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-02T19:05:29.731628] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T19:05:29.872972] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-02T19:05:30.073379] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T19:05:30.417357] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-02T19:05:30.673041] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-02T19:05:31.473006] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-02T19:05:31.871596] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-02T19:05:31.872362] [INFO ] [REMOTE ] GAM: Full fetch complete (6726 records). [2025-10-02T19:05:31.872447] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-02T19:05:32.247533] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-02T19:05:32.247610] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-02T19:05:32.247820] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-02T19:05:32.247880] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-02T19:05:32.248321] [DEBUG] [LOCAL ] GAM: Trimmed 6726 records to 4081 (keeping 200 days of data) [2025-10-02T19:05:32.273069] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-02T19:05:32.274377] [DEBUG] [LOCAL ] GAM: Primary data saved (4081 records). [2025-10-02T19:05:32.274466] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-02T19:05:32.275354] [INFO ] [MAIN ] Update Progress: 892/2370 symbols completed. GAM took 24.7s. Estimated remaining: 3h 27m 54s. Rate: 7.1 symbols/min [2025-10-02T19:05:32.454380] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:32.473966] [DEBUG] [LOCAL ] GBAB: Loaded 13085 existing records from primary storage. [2025-10-02T19:05:32.474254] [INFO ] [MAIN ] GBAB: Loaded 13085 existing records. [2025-10-02T19:05:32.669982] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:05:32.670297] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-02T19:05:32.670359] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-02T19:05:32.671011] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-02T19:05:32.671090] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-02T19:05:32.924796] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-02T19:05:33.074131] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-02T19:05:33.156620] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:33.713638] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T19:05:33.715794] [INFO ] [REMOTE ] G: Full fetch complete (71634 records). [2025-10-02T19:05:33.715965] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-02T19:05:33.878152] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-02T19:05:34.164904] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-02T19:05:34.165012] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-02T19:05:34.166015] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-02T19:05:34.166105] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-02T19:05:34.167695] [DEBUG] [LOCAL ] G: Trimmed 71634 records to 50210 (keeping 200 days of data) [2025-10-02T19:05:34.500065] [DEBUG] [LOCAL ] G: Primary data saved (50210 records). [2025-10-02T19:05:34.500223] [INFO ] [MAIN ] G: Full history saved. [2025-10-02T19:05:34.501314] [INFO ] [MAIN ] Update Progress: 893/2370 symbols completed. G took 51.3s. Estimated remaining: 3h 27m 36s. Rate: 7.1 symbols/min [2025-10-02T19:05:34.675536] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-10-02T19:05:34.698398] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:34.714289] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-02T19:05:34.768317] [DEBUG] [LOCAL ] GBCI: Loaded 40011 existing records from primary storage. [2025-10-02T19:05:34.770186] [INFO ] [MAIN ] GBCI: Loaded 40011 existing records. [2025-10-02T19:05:34.989259] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:05:34.989552] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-02T19:05:34.989719] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-02T19:05:35.001581] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-02T19:05:35.021928] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-02T19:05:35.029770] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T19:05:35.437949] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:35.472971] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-10-02T19:05:35.489354] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T19:05:36.273013] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-02T19:05:36.893838] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T19:05:37.073009] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-02T19:05:37.178928] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T19:05:37.873003] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-02T19:05:38.600128] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-02T19:05:38.673016] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-02T19:05:38.999600] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T19:05:39.235188] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-02T19:05:39.473008] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-02T19:05:40.273004] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-02T19:05:40.876931] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T19:05:41.073109] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-02T19:05:41.073435] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-02T19:05:41.872984] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-10-02T19:05:42.435995] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T19:05:42.438169] [INFO ] [REMOTE ] GAP: Full fetch complete (77635 records). [2025-10-02T19:05:42.438283] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-02T19:05:42.678166] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-02T19:05:42.823219] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-02T19:05:42.876110] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-02T19:05:42.876197] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-02T19:05:42.877258] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-02T19:05:42.877332] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-02T19:05:42.878968] [DEBUG] [LOCAL ] GAP: Trimmed 77635 records to 54045 (keeping 200 days of data) [2025-10-02T19:05:43.230295] [DEBUG] [LOCAL ] GAP: Primary data saved (54045 records). [2025-10-02T19:05:43.230443] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-02T19:05:43.230544] [INFO ] [MAIN ] Update Progress: 894/2370 symbols completed. GAP took 33.7s. Estimated remaining: 3h 27m 28s. Rate: 7.1 symbols/min [2025-10-02T19:05:43.411555] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:43.411745] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-02T19:05:43.411793] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-02T19:05:43.411903] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-02T19:05:43.411944] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-02T19:05:43.411986] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-02T19:05:43.412018] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-02T19:05:43.479712] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-10-02T19:05:43.795301] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:44.066526] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T19:05:44.273038] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-10-02T19:05:44.297034] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T19:05:44.575570] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-10-02T19:05:45.073000] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-02T19:05:45.873001] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-02T19:05:46.219498] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-02T19:05:46.327447] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T19:05:46.673006] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-02T19:05:47.473009] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-02T19:05:47.763930] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-02T19:05:47.977541] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-02T19:05:48.273004] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-10-02T19:05:49.073003] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-02T19:05:49.307972] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T19:05:49.421243] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-02T19:05:49.873002] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-02T19:05:50.672996] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-02T19:05:51.405818] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T19:05:51.472960] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-02T19:05:51.663315] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T19:05:52.273043] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-02T19:05:52.635876] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T19:05:53.073017] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-02T19:05:53.357686] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-02T19:05:53.497941] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-02T19:05:53.872999] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-10-02T19:05:54.673015] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-02T19:05:54.792605] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T19:05:55.472996] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-10-02T19:05:55.615394] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T19:05:56.249572] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-02T19:05:56.272982] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-10-02T19:05:57.056225] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T19:05:57.073037] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-02T19:05:57.873022] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-10-02T19:05:58.439792] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:05:58.480103] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-02T19:05:58.481188] [INFO ] [REMOTE ] GBAB: Full fetch complete (19692 records). [2025-10-02T19:05:58.481287] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-10-02T19:05:58.694455] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-02T19:05:58.942013] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-10-02T19:05:58.942116] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-10-02T19:05:58.942674] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-10-02T19:05:58.942747] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-10-02T19:05:58.943539] [DEBUG] [LOCAL ] GBAB: Trimmed 19692 records to 13143 (keeping 200 days of data) [2025-10-02T19:05:59.028916] [DEBUG] [LOCAL ] GBAB: Primary data saved (13143 records). [2025-10-02T19:05:59.029064] [INFO ] [MAIN ] GBAB: Full history saved. [2025-10-02T19:05:59.029147] [INFO ] [MAIN ] Update Progress: 895/2370 symbols completed. GBAB took 26.8s. Estimated remaining: 3h 27m 31s. Rate: 7.1 symbols/min [2025-10-02T19:05:59.208159] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:05:59.254207] [DEBUG] [LOCAL ] GBTG: Loaded 40046 existing records from primary storage. [2025-10-02T19:05:59.254536] [INFO ] [MAIN ] GBTG: Loaded 40046 existing records. [2025-10-02T19:05:59.460559] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:05:59.460945] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-02T19:05:59.461030] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-02T19:05:59.462186] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-02T19:05:59.462249] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-02T19:05:59.478111] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-02T19:05:59.815727] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T19:05:59.927774] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:05:59.930577] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T19:06:00.273008] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-02T19:06:00.915918] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T19:06:01.072979] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-02T19:06:01.872994] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-10-02T19:06:02.652257] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:06:02.672977] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-02T19:06:03.320633] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:06:03.472998] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-02T19:06:03.728531] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-02T19:06:04.101582] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:06:04.273033] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-02T19:06:04.716068] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-02T19:06:05.073013] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-02T19:06:05.873012] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-02T19:06:06.415385] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T19:06:06.673059] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-02T19:06:07.009559] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-02T19:06:07.352881] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T19:06:07.473022] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-02T19:06:08.031782] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T19:06:08.032474] [INFO ] [REMOTE ] GBLI: Full fetch complete (1318 records). [2025-10-02T19:06:08.032547] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-02T19:06:08.220341] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-02T19:06:08.220537] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:06:08.220658] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:06:08.220740] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-02T19:06:08.220814] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-02T19:06:08.220858] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-02T19:06:08.220903] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-02T19:06:08.220963] [INFO ] [MAIN ] Update Progress: 896/2370 symbols completed. GBLI took 25.0s. Estimated remaining: 3h 27m 24s. Rate: 7.1 symbols/min [2025-10-02T19:06:08.278173] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-02T19:06:08.406584] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:08.441489] [DEBUG] [LOCAL ] GBX: Loaded 29152 existing records from primary storage. [2025-10-02T19:06:08.441902] [INFO ] [MAIN ] GBX: Loaded 29152 existing records. [2025-10-02T19:06:08.636991] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:08.637208] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-02T19:06:08.637314] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-02T19:06:08.638231] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-02T19:06:08.638294] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-02T19:06:09.036974] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:09.072985] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-10-02T19:06:09.552430] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T19:06:09.554307] [INFO ] [REMOTE ] GBCI: Full fetch complete (58300 records). [2025-10-02T19:06:09.554402] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-02T19:06:09.878094] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-02T19:06:09.968588] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-02T19:06:09.968708] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-02T19:06:09.969468] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-02T19:06:09.969513] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-02T19:06:09.970810] [DEBUG] [LOCAL ] GBCI: Trimmed 58300 records to 40436 (keeping 200 days of data) [2025-10-02T19:06:10.227506] [DEBUG] [LOCAL ] GBCI: Primary data saved (40436 records). [2025-10-02T19:06:10.227664] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-02T19:06:10.228543] [INFO ] [MAIN ] Update Progress: 897/2370 symbols completed. GBCI took 35.7s. Estimated remaining: 3h 27m 5s. Rate: 7.1 symbols/min [2025-10-02T19:06:10.436156] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T19:06:10.446835] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:10.489615] [DEBUG] [LOCAL ] GCI: Loaded 44121 existing records from primary storage. [2025-10-02T19:06:10.489962] [INFO ] [MAIN ] GCI: Loaded 44121 existing records. [2025-10-02T19:06:10.683853] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:10.678418] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-02T19:06:10.684870] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-02T19:06:10.684939] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-02T19:06:10.686275] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-02T19:06:10.686344] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-02T19:06:11.085428] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:11.224682] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T19:06:11.473018] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-10-02T19:06:11.801004] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-02T19:06:12.273055] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-02T19:06:12.854894] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:06:13.073044] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-02T19:06:13.806897] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T19:06:13.873017] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-02T19:06:13.928935] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:06:13.930151] [INFO ] [REMOTE ] GATX: Full fetch complete (25195 records). [2025-10-02T19:06:13.930237] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-02T19:06:14.338985] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-02T19:06:14.339123] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-02T19:06:14.339747] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-02T19:06:14.339839] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-02T19:06:14.340705] [DEBUG] [LOCAL ] GATX: Trimmed 25195 records to 18259 (keeping 200 days of data) [2025-10-02T19:06:14.463161] [DEBUG] [LOCAL ] GATX: Primary data saved (18259 records). [2025-10-02T19:06:14.463314] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-02T19:06:14.463432] [INFO ] [MAIN ] Update Progress: 898/2370 symbols completed. GATX took 54.3s. Estimated remaining: 3h 26m 50s. Rate: 7.1 symbols/min [2025-10-02T19:06:14.657970] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:14.673091] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-02T19:06:14.683887] [DEBUG] [LOCAL ] GCO: Loaded 24664 existing records from primary storage. [2025-10-02T19:06:14.684339] [INFO ] [MAIN ] GCO: Loaded 24664 existing records. [2025-10-02T19:06:14.885117] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:14.885465] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-02T19:06:14.885579] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-02T19:06:14.886480] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-02T19:06:14.886559] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-02T19:06:15.286957] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T19:06:15.328631] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:15.473013] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-10-02T19:06:16.101736] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T19:06:16.272984] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-02T19:06:16.513722] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T19:06:17.073010] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-02T19:06:17.740395] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T19:06:17.872972] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-02T19:06:18.170239] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:06:18.673003] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-02T19:06:18.940517] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T19:06:19.473046] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-02T19:06:20.022797] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T19:06:20.273034] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-02T19:06:20.765473] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T19:06:21.073014] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-02T19:06:21.676814] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:06:21.872985] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-02T19:06:22.144518] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T19:06:22.673060] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-02T19:06:23.105033] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-02T19:06:23.473020] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-02T19:06:23.985797] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T19:06:24.273010] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-02T19:06:24.954800] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T19:06:25.073041] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-02T19:06:25.799426] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T19:06:25.872989] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-02T19:06:26.194755] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T19:06:26.673010] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-02T19:06:27.294716] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T19:06:27.357515] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-02T19:06:27.473017] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-02T19:06:28.273028] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-02T19:06:28.811092] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T19:06:29.073008] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-02T19:06:29.381401] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T19:06:29.872997] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-02T19:06:30.423622] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T19:06:30.673045] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-02T19:06:31.422964] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T19:06:31.473008] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-02T19:06:31.906925] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T19:06:31.908818] [INFO ] [REMOTE ] GBTG: Full fetch complete (56602 records). [2025-10-02T19:06:31.908966] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-02T19:06:32.278164] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-02T19:06:32.338911] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-02T19:06:32.339018] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-02T19:06:32.339943] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-02T19:06:32.340012] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-02T19:06:32.341503] [DEBUG] [LOCAL ] GBTG: Trimmed 56602 records to 40317 (keeping 200 days of data) [2025-10-02T19:06:32.591363] [DEBUG] [LOCAL ] GBTG: Primary data saved (40317 records). [2025-10-02T19:06:32.591501] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-02T19:06:32.591588] [INFO ] [MAIN ] Update Progress: 899/2370 symbols completed. GBTG took 33.6s. Estimated remaining: 3h 26m 57s. Rate: 7.1 symbols/min [2025-10-02T19:06:32.825626] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:32.847700] [DEBUG] [LOCAL ] GCTS: Loaded 19957 existing records from primary storage. [2025-10-02T19:06:32.848048] [INFO ] [MAIN ] GCTS: Loaded 19957 existing records. [2025-10-02T19:06:33.078324] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:33.078442] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-02T19:06:33.080853] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T19:06:33.081366] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-02T19:06:33.089473] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-02T19:06:33.090283] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-02T19:06:33.090495] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-02T19:06:33.517048] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:33.666397] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T19:06:33.873032] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-10-02T19:06:34.682331] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-02T19:06:34.700496] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:06:34.987669] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T19:06:35.419177] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-02T19:06:35.472972] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-02T19:06:36.225607] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T19:06:36.273035] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-02T19:06:37.072984] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-02T19:06:37.431790] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T19:06:37.872971] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-02T19:06:38.136587] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T19:06:38.673023] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-02T19:06:38.889928] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T19:06:39.472997] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-02T19:06:40.255811] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:06:40.272967] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-02T19:06:40.414166] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-02T19:06:40.415968] [INFO ] [REMOTE ] GBX: Full fetch complete (42845 records). [2025-10-02T19:06:40.416090] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-02T19:06:40.852780] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-02T19:06:40.852891] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-02T19:06:40.853787] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-02T19:06:40.853853] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-02T19:06:40.855134] [DEBUG] [LOCAL ] GBX: Trimmed 42845 records to 29327 (keeping 200 days of data) [2025-10-02T19:06:41.041913] [DEBUG] [LOCAL ] GBX: Primary data saved (29327 records). [2025-10-02T19:06:41.042069] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-02T19:06:41.042157] [INFO ] [MAIN ] Update Progress: 900/2370 symbols completed. GBX took 32.8s. Estimated remaining: 3h 26m 49s. Rate: 7.1 symbols/min [2025-10-02T19:06:41.078231] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-02T19:06:41.240505] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:41.250010] [DEBUG] [LOCAL ] GCV: Loaded 7370 existing records from primary storage. [2025-10-02T19:06:41.250239] [INFO ] [MAIN ] GCV: Loaded 7370 existing records. [2025-10-02T19:06:41.447732] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:41.448108] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-02T19:06:41.448198] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-02T19:06:41.448616] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-02T19:06:41.448714] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-02T19:06:41.861933] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:41.878088] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-10-02T19:06:41.891165] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T19:06:42.092800] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-02T19:06:42.560859] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-10-02T19:06:42.673026] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-02T19:06:43.168304] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-02T19:06:43.473001] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-02T19:06:44.150278] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-02T19:06:44.273016] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-02T19:06:45.072994] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-02T19:06:45.395100] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T19:06:45.873003] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-02T19:06:46.047004] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-02T19:06:46.672994] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-02T19:06:47.010990] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T19:06:47.472996] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-02T19:06:47.849683] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T19:06:48.273030] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-02T19:06:48.492930] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T19:06:49.073016] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-02T19:06:49.107353] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-02T19:06:49.817020] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T19:06:49.872998] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-02T19:06:50.466830] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T19:06:50.672995] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-02T19:06:51.472995] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-02T19:06:52.044272] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:06:52.272975] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-02T19:06:52.310402] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T19:06:53.073015] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-02T19:06:53.345732] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T19:06:53.752259] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-02T19:06:53.872996] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-02T19:06:54.672969] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-02T19:06:54.846848] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T19:06:55.473003] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-02T19:06:55.582094] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T19:06:55.583340] [INFO ] [REMOTE ] GCO: Full fetch complete (35434 records). [2025-10-02T19:06:55.583418] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-02T19:06:55.973893] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-02T19:06:55.974040] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-02T19:06:55.974718] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-02T19:06:55.974783] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-02T19:06:55.975636] [DEBUG] [LOCAL ] GCO: Trimmed 35434 records to 24786 (keeping 200 days of data) [2025-10-02T19:06:56.119317] [DEBUG] [LOCAL ] GCO: Primary data saved (24786 records). [2025-10-02T19:06:56.119453] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-02T19:06:56.119582] [INFO ] [MAIN ] Update Progress: 901/2370 symbols completed. GCO took 41.7s. Estimated remaining: 3h 26m 51s. Rate: 7.1 symbols/min [2025-10-02T19:06:56.280111] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-02T19:06:56.307004] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:56.356757] [DEBUG] [LOCAL ] GD: Loaded 47149 existing records from primary storage. [2025-10-02T19:06:56.357111] [INFO ] [MAIN ] GD: Loaded 47149 existing records. [2025-10-02T19:06:56.549232] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:56.549617] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-02T19:06:56.549762] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-02T19:06:56.551273] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-02T19:06:56.551338] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-02T19:06:56.678773] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-02T19:06:56.960115] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:57.073034] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-02T19:06:57.603114] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T19:06:57.605268] [INFO ] [REMOTE ] GCI: Full fetch complete (63186 records). [2025-10-02T19:06:57.605367] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-02T19:06:57.725422] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-02T19:06:57.878185] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-02T19:06:58.060255] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-02T19:06:58.060351] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-02T19:06:58.061183] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-02T19:06:58.061249] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-02T19:06:58.062715] [DEBUG] [LOCAL ] GCI: Trimmed 63186 records to 44426 (keeping 200 days of data) [2025-10-02T19:06:58.316479] [DEBUG] [LOCAL ] GCI: Primary data saved (44426 records). [2025-10-02T19:06:58.316611] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-02T19:06:58.317253] [INFO ] [MAIN ] Update Progress: 902/2370 symbols completed. GCI took 48.1s. Estimated remaining: 3h 26m 33s. Rate: 7.1 symbols/min [2025-10-02T19:06:58.517509] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:58.572851] [DEBUG] [LOCAL ] GDDY: Loaded 49682 existing records from primary storage. [2025-10-02T19:06:58.573203] [INFO ] [MAIN ] GDDY: Loaded 49682 existing records. [2025-10-02T19:06:58.678348] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-02T19:06:58.771928] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:06:58.772159] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-02T19:06:58.772219] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-02T19:06:58.773810] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-02T19:06:58.773873] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-02T19:06:58.885752] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T19:06:58.901169] [INFO ] [REMOTE ] GCTS: Full fetch complete (26906 records). [2025-10-02T19:06:58.911595] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-02T19:06:59.402978] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:06:59.478090] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-10-02T19:06:59.501900] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-02T19:06:59.597989] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-02T19:06:59.598090] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-02T19:06:59.598711] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-02T19:06:59.598777] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-02T19:06:59.599527] [DEBUG] [LOCAL ] GCTS: Trimmed 26906 records to 20086 (keeping 200 days of data) [2025-10-02T19:06:59.716224] [DEBUG] [LOCAL ] GCTS: Primary data saved (20086 records). [2025-10-02T19:06:59.716350] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-02T19:06:59.716445] [INFO ] [MAIN ] Update Progress: 903/2370 symbols completed. GCTS took 27.1s. Estimated remaining: 3h 26m 13s. Rate: 7.1 symbols/min [2025-10-02T19:06:59.908322] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:06:59.914549] [DEBUG] [LOCAL ] GDIV: Loaded 3623 existing records from primary storage. [2025-10-02T19:06:59.914768] [INFO ] [MAIN ] GDIV: Loaded 3623 existing records. [2025-10-02T19:07:00.113963] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:00.114167] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-02T19:07:00.114217] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-02T19:07:00.114606] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-02T19:07:00.114698] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-02T19:07:00.278090] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-02T19:07:00.516414] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:07:01.073024] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-10-02T19:07:01.574072] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:07:01.854530] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-10-02T19:07:01.874817] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-02T19:07:01.875172] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T19:07:02.673038] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-10-02T19:07:03.472979] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-02T19:07:03.650091] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T19:07:04.219393] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T19:07:04.273059] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-02T19:07:04.396965] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-10-02T19:07:04.831803] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-02T19:07:05.073013] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-02T19:07:05.594474] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-02T19:07:05.873004] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-02T19:07:06.673072] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-02T19:07:07.332220] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T19:07:07.333226] [INFO ] [REMOTE ] GCV: Full fetch complete (9418 records). [2025-10-02T19:07:07.333302] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-02T19:07:07.478110] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-02T19:07:07.735455] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-02T19:07:07.735564] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-02T19:07:07.735904] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-02T19:07:07.736050] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-02T19:07:07.736840] [DEBUG] [LOCAL ] GCV: Trimmed 9418 records to 7454 (keeping 200 days of data) [2025-10-02T19:07:07.801391] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-02T19:07:07.825393] [DEBUG] [LOCAL ] GCV: Primary data saved (7454 records). [2025-10-02T19:07:07.825534] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-02T19:07:07.825622] [INFO ] [MAIN ] Update Progress: 904/2370 symbols completed. GCV took 26.8s. Estimated remaining: 3h 26m 4s. Rate: 7.1 symbols/min [2025-10-02T19:07:08.020454] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:07:08.029196] [DEBUG] [LOCAL ] GDL: Loaded 2566 existing records from primary storage. [2025-10-02T19:07:08.029486] [INFO ] [MAIN ] GDL: Loaded 2566 existing records. [2025-10-02T19:07:08.229451] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-02T19:07:08.233511] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:08.235142] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-02T19:07:08.235717] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-02T19:07:08.236090] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-02T19:07:08.236167] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-02T19:07:08.278143] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-02T19:07:08.625088] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:07:09.073086] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-02T19:07:09.873029] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-10-02T19:07:09.980025] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:07:10.205897] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-02T19:07:10.672974] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-02T19:07:10.939302] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T19:07:11.473027] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-02T19:07:12.125143] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T19:07:12.272980] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-02T19:07:12.371750] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-02T19:07:12.741245] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-02T19:07:13.073014] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-02T19:07:13.873031] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-02T19:07:14.251200] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-02T19:07:14.642062] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:07:14.672961] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-02T19:07:15.472999] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-02T19:07:16.272967] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-02T19:07:16.330177] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T19:07:16.621129] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-02T19:07:17.073007] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-02T19:07:17.657537] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T19:07:17.872979] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-02T19:07:17.943893] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T19:07:18.487818] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-02T19:07:18.673029] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-02T19:07:19.133580] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T19:07:19.473058] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-02T19:07:20.273026] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-02T19:07:21.072982] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-02T19:07:21.237444] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T19:07:21.606385] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T19:07:21.872974] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-02T19:07:21.980300] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T19:07:22.512183] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T19:07:22.513400] [INFO ] [REMOTE ] GDIV: Full fetch complete (5462 records). [2025-10-02T19:07:22.513519] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-02T19:07:22.680224] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-02T19:07:22.902427] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-02T19:07:22.902568] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-02T19:07:22.902775] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-02T19:07:22.902855] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-02T19:07:22.903357] [DEBUG] [LOCAL ] GDIV: Trimmed 5462 records to 3648 (keeping 200 days of data) [2025-10-02T19:07:22.932545] [DEBUG] [LOCAL ] GDIV: Primary data saved (3648 records). [2025-10-02T19:07:22.932680] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-02T19:07:22.932808] [INFO ] [MAIN ] Update Progress: 905/2370 symbols completed. GDIV took 23.2s. Estimated remaining: 3h 26m 6s. Rate: 7.1 symbols/min [2025-10-02T19:07:23.113912] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:07:23.127893] [DEBUG] [LOCAL ] GDO: Loaded 5984 existing records from primary storage. [2025-10-02T19:07:23.128155] [INFO ] [MAIN ] GDO: Loaded 5984 existing records. [2025-10-02T19:07:23.326374] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:23.326612] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-02T19:07:23.326707] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-02T19:07:23.327209] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-02T19:07:23.327283] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-02T19:07:23.488257] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-02T19:07:23.740347] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:07:24.004772] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-02T19:07:24.272999] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-02T19:07:24.405749] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T19:07:24.610502] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-02T19:07:25.073010] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-02T19:07:25.872993] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-10-02T19:07:26.678041] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-02T19:07:26.681633] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T19:07:26.887526] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-02T19:07:27.473007] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-02T19:07:28.144395] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T19:07:28.180974] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T19:07:28.273022] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-02T19:07:29.073007] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-02T19:07:29.873044] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-02T19:07:30.098721] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T19:07:30.303159] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-02T19:07:30.672969] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-02T19:07:30.992427] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T19:07:31.473034] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-02T19:07:32.125452] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T19:07:32.129597] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T19:07:32.273020] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-02T19:07:33.072996] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-02T19:07:33.550925] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-02T19:07:33.837393] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T19:07:33.839554] [INFO ] [REMOTE ] GDDY: Full fetch complete (71470 records). [2025-10-02T19:07:33.839685] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-02T19:07:33.878265] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-02T19:07:34.272362] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-02T19:07:34.272488] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-02T19:07:34.273784] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-02T19:07:34.273860] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-02T19:07:34.275411] [DEBUG] [LOCAL ] GDDY: Trimmed 71470 records to 50069 (keeping 200 days of data) [2025-10-02T19:07:34.406829] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T19:07:34.611437] [DEBUG] [LOCAL ] GDDY: Primary data saved (50069 records). [2025-10-02T19:07:34.611585] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-02T19:07:34.612750] [INFO ] [MAIN ] Update Progress: 906/2370 symbols completed. GDDY took 36.3s. Estimated remaining: 3h 26m 3s. Rate: 7.1 symbols/min [2025-10-02T19:07:34.680001] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-02T19:07:34.802418] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:07:34.843790] [DEBUG] [LOCAL ] GDOT: Loaded 38324 existing records from primary storage. [2025-10-02T19:07:34.844099] [INFO ] [MAIN ] GDOT: Loaded 38324 existing records. [2025-10-02T19:07:35.048413] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:35.048665] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-02T19:07:35.048730] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-02T19:07:35.049991] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-02T19:07:35.050052] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-02T19:07:35.232313] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T19:07:35.456480] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:07:35.472989] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-10-02T19:07:36.272980] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-02T19:07:36.403325] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T19:07:36.818380] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T19:07:37.072999] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-02T19:07:37.873004] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-02T19:07:38.292943] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T19:07:38.293876] [INFO ] [REMOTE ] GDL: Full fetch complete (3651 records). [2025-10-02T19:07:38.293960] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-02T19:07:38.610121] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T19:07:38.678108] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-02T19:07:38.742613] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-02T19:07:38.742737] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-02T19:07:38.742883] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-02T19:07:38.742944] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-02T19:07:38.743332] [DEBUG] [LOCAL ] GDL: Trimmed 3651 records to 2576 (keeping 200 days of data) [2025-10-02T19:07:38.761977] [DEBUG] [LOCAL ] GDL: Primary data saved (2576 records). [2025-10-02T19:07:38.762097] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-02T19:07:38.762216] [INFO ] [MAIN ] Update Progress: 907/2370 symbols completed. GDL took 30.9s. Estimated remaining: 3h 25m 48s. Rate: 7.1 symbols/min [2025-10-02T19:07:38.996835] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:07:39.019680] [DEBUG] [LOCAL ] GDV: Loaded 19475 existing records from primary storage. [2025-10-02T19:07:39.019934] [INFO ] [MAIN ] GDV: Loaded 19475 existing records. [2025-10-02T19:07:39.223179] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:39.223580] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-02T19:07:39.223662] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-02T19:07:39.224552] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-02T19:07:39.224616] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-02T19:07:39.482426] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-02T19:07:39.530286] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T19:07:39.628088] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:07:40.273000] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-10-02T19:07:40.759301] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T19:07:41.072989] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-02T19:07:41.147346] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T19:07:41.739878] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-02T19:07:41.873002] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-02T19:07:42.673023] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-02T19:07:43.443579] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T19:07:43.472972] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-02T19:07:43.498036] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T19:07:44.273017] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-02T19:07:44.858532] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T19:07:44.890293] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T19:07:45.072998] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-02T19:07:45.873006] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-02T19:07:46.586452] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T19:07:46.672964] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-02T19:07:46.690448] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T19:07:47.472989] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-02T19:07:47.801083] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-02T19:07:48.273004] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-02T19:07:48.898572] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T19:07:48.901340] [INFO ] [REMOTE ] GD: Full fetch complete (70296 records). [2025-10-02T19:07:48.901470] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-02T19:07:49.081436] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-02T19:07:49.366472] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-02T19:07:49.366605] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-02T19:07:49.367693] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-02T19:07:49.367773] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-02T19:07:49.369338] [DEBUG] [LOCAL ] GD: Trimmed 70296 records to 47468 (keeping 200 days of data) [2025-10-02T19:07:49.717921] [DEBUG] [LOCAL ] GD: Primary data saved (47468 records). [2025-10-02T19:07:49.718255] [INFO ] [MAIN ] GD: Full history saved. [2025-10-02T19:07:49.718361] [INFO ] [MAIN ] Update Progress: 908/2370 symbols completed. GD took 53.6s. Estimated remaining: 3h 25m 43s. Rate: 7.1 symbols/min [2025-10-02T19:07:49.874802] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-02T19:07:49.878086] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T19:07:49.960282] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:07:50.024074] [DEBUG] [LOCAL ] GE: Loaded 53714 existing records from primary storage. [2025-10-02T19:07:50.024457] [INFO ] [MAIN ] GE: Loaded 53714 existing records. [2025-10-02T19:07:50.223491] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:50.223827] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-02T19:07:50.223964] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-02T19:07:50.226147] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-02T19:07:50.226215] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-02T19:07:50.387869] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T19:07:50.592615] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T19:07:50.678234] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-02T19:07:50.685418] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:07:51.473000] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-10-02T19:07:51.751479] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-02T19:07:52.272990] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-02T19:07:52.821668] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-02T19:07:53.072973] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-02T19:07:53.175005] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T19:07:53.873055] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-02T19:07:54.524211] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T19:07:54.673072] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-02T19:07:55.060838] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T19:07:55.473037] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-02T19:07:56.201729] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T19:07:56.273017] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-02T19:07:56.723040] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-10-02T19:07:56.906999] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-02T19:07:57.073051] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-02T19:07:57.873069] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-02T19:07:58.181726] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T19:07:58.409114] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T19:07:58.409987] [INFO ] [REMOTE ] GDO: Full fetch complete (9190 records). [2025-10-02T19:07:58.410065] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-02T19:07:58.678102] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-02T19:07:58.807489] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-02T19:07:58.807572] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-02T19:07:58.807852] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-02T19:07:58.807919] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-02T19:07:58.808545] [DEBUG] [LOCAL ] GDO: Trimmed 9190 records to 6027 (keeping 200 days of data) [2025-10-02T19:07:58.848381] [DEBUG] [LOCAL ] GDO: Primary data saved (6027 records). [2025-10-02T19:07:58.848516] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-02T19:07:58.848605] [INFO ] [MAIN ] Update Progress: 909/2370 symbols completed. GDO took 35.9s. Estimated remaining: 3h 25m 36s. Rate: 7.1 symbols/min [2025-10-02T19:07:59.035279] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:07:59.058049] [DEBUG] [LOCAL ] GEF: Loaded 20682 existing records from primary storage. [2025-10-02T19:07:59.058333] [INFO ] [MAIN ] GEF: Loaded 20682 existing records. [2025-10-02T19:07:59.255065] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:07:59.255285] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-02T19:07:59.255335] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-02T19:07:59.256083] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-02T19:07:59.256145] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-02T19:07:59.478095] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-02T19:07:59.638193] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:00.272996] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-02T19:08:00.538518] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T19:08:00.793380] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-02T19:08:01.073039] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-10-02T19:08:01.610563] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-02T19:08:01.873045] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-02T19:08:01.912489] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T19:08:02.673009] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-02T19:08:03.148110] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T19:08:03.472982] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-02T19:08:03.750937] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T19:08:04.273065] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-02T19:08:04.629520] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T19:08:05.073001] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-02T19:08:05.491268] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T19:08:05.493476] [INFO ] [REMOTE ] GDOT: Full fetch complete (53132 records). [2025-10-02T19:08:05.493594] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-02T19:08:05.877522] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-02T19:08:05.940942] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T19:08:05.939981] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-02T19:08:05.944782] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-02T19:08:05.945986] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-02T19:08:05.946074] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-02T19:08:05.947307] [DEBUG] [LOCAL ] GDOT: Trimmed 53132 records to 38623 (keeping 200 days of data) [2025-10-02T19:08:06.183262] [DEBUG] [LOCAL ] GDOT: Primary data saved (38623 records). [2025-10-02T19:08:06.183410] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-02T19:08:06.184629] [INFO ] [MAIN ] Update Progress: 910/2370 symbols completed. GDOT took 31.6s. Estimated remaining: 3h 25m 26s. Rate: 7.1 symbols/min [2025-10-02T19:08:06.369261] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:08:06.409108] [DEBUG] [LOCAL ] GEL: Loaded 33118 existing records from primary storage. [2025-10-02T19:08:06.409410] [INFO ] [MAIN ] GEL: Loaded 33118 existing records. [2025-10-02T19:08:06.600027] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:08:06.600243] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-02T19:08:06.600359] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-02T19:08:06.601282] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-02T19:08:06.601344] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-02T19:08:06.682025] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-02T19:08:07.011424] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:07.026013] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T19:08:07.472991] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-02T19:08:07.835924] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:08:08.272992] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-02T19:08:09.072984] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-10-02T19:08:09.191440] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T19:08:09.380799] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-02T19:08:09.855486] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T19:08:09.872974] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-02T19:08:10.673001] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-02T19:08:11.224111] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T19:08:11.473007] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-02T19:08:12.273024] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-02T19:08:12.529096] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T19:08:12.952740] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-02T19:08:13.073005] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-02T19:08:13.645966] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T19:08:13.848899] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T19:08:13.872975] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-02T19:08:14.501876] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-02T19:08:14.504911] [INFO ] [REMOTE ] GDV: Full fetch complete (28524 records). [2025-10-02T19:08:14.505002] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-02T19:08:14.680610] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-02T19:08:14.928161] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-02T19:08:14.928267] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-02T19:08:14.928874] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-02T19:08:14.928964] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-02T19:08:14.930587] [DEBUG] [LOCAL ] GDV: Trimmed 28524 records to 19585 (keeping 200 days of data) [2025-10-02T19:08:15.070632] [DEBUG] [LOCAL ] GDV: Primary data saved (19585 records). [2025-10-02T19:08:15.070818] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-02T19:08:15.070905] [INFO ] [MAIN ] Update Progress: 911/2370 symbols completed. GDV took 36.3s. Estimated remaining: 3h 25m 18s. Rate: 7.1 symbols/min [2025-10-02T19:08:15.261102] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:08:15.323095] [DEBUG] [LOCAL ] GENI: Loaded 52930 existing records from primary storage. [2025-10-02T19:08:15.323452] [INFO ] [MAIN ] GENI: Loaded 52930 existing records. [2025-10-02T19:08:15.478087] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-02T19:08:15.523488] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:08:15.523838] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-02T19:08:15.523902] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-02T19:08:15.525101] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-02T19:08:15.525163] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-02T19:08:15.923956] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:15.948757] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-02T19:08:16.273037] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-02T19:08:16.985873] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T19:08:17.072980] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-10-02T19:08:17.309562] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-02T19:08:17.873008] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-02T19:08:18.516784] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T19:08:18.672990] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-02T19:08:19.164196] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T19:08:19.473040] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-02T19:08:20.274598] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-02T19:08:20.280399] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T19:08:20.817520] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-02T19:08:21.073025] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-02T19:08:21.873044] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-02T19:08:22.131376] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T19:08:22.276038] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-02T19:08:22.673032] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-02T19:08:23.278463] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:08:23.473017] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-02T19:08:24.273072] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-02T19:08:24.735912] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-02T19:08:24.788591] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-10-02T19:08:25.010810] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T19:08:25.072998] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-02T19:08:25.873019] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-02T19:08:26.092765] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T19:08:26.094204] [INFO ] [REMOTE ] GEF: Full fetch complete (29530 records). [2025-10-02T19:08:26.094281] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-02T19:08:26.501296] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-02T19:08:26.501399] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-02T19:08:26.502043] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-02T19:08:26.502107] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-02T19:08:26.503011] [DEBUG] [LOCAL ] GEF: Trimmed 29530 records to 20830 (keeping 200 days of data) [2025-10-02T19:08:26.651118] [DEBUG] [LOCAL ] GEF: Primary data saved (20830 records). [2025-10-02T19:08:26.651283] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-02T19:08:26.651386] [INFO ] [MAIN ] Update Progress: 912/2370 symbols completed. GEF took 27.8s. Estimated remaining: 3h 25m 14s. Rate: 7.1 symbols/min [2025-10-02T19:08:26.678248] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-02T19:08:26.848810] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:08:26.905501] [DEBUG] [LOCAL ] GEO: Loaded 51950 existing records from primary storage. [2025-10-02T19:08:26.905881] [INFO ] [MAIN ] GEO: Loaded 51950 existing records. [2025-10-02T19:08:27.116265] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:08:27.116509] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-02T19:08:27.116561] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-02T19:08:27.117938] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-02T19:08:27.118002] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-02T19:08:27.477806] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-02T19:08:27.500622] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:27.864182] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-02T19:08:28.179514] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T19:08:28.273036] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-10-02T19:08:29.070353] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T19:08:29.079383] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-02T19:08:29.872977] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-02T19:08:30.070049] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T19:08:30.181820] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T19:08:30.673016] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-02T19:08:31.404459] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-02T19:08:31.472978] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-02T19:08:31.537500] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:08:31.539344] [INFO ] [REMOTE ] GEL: Full fetch complete (48534 records). [2025-10-02T19:08:31.539475] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-02T19:08:31.961493] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-02T19:08:31.961579] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-02T19:08:31.962306] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-02T19:08:31.962374] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-02T19:08:31.963476] [DEBUG] [LOCAL ] GEL: Trimmed 48534 records to 33312 (keeping 200 days of data) [2025-10-02T19:08:32.174478] [DEBUG] [LOCAL ] GEL: Primary data saved (33312 records). [2025-10-02T19:08:32.174622] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-02T19:08:32.176409] [INFO ] [MAIN ] Update Progress: 913/2370 symbols completed. GEL took 26.0s. Estimated remaining: 3h 25m 1s. Rate: 7.1 symbols/min [2025-10-02T19:08:32.279605] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-02T19:08:32.370756] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:08:32.414194] [DEBUG] [LOCAL ] GES: Loaded 39414 existing records from primary storage. [2025-10-02T19:08:32.414595] [INFO ] [MAIN ] GES: Loaded 39414 existing records. [2025-10-02T19:08:32.623859] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:08:32.624260] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-02T19:08:32.624319] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-02T19:08:32.625578] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-02T19:08:32.625690] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-02T19:08:33.021390] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:33.073024] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-02T19:08:33.602524] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-02T19:08:33.649571] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T19:08:33.873005] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-02T19:08:34.673003] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-10-02T19:08:35.050886] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-02T19:08:35.473030] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-02T19:08:35.920413] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-02T19:08:36.272986] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-02T19:08:36.347322] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T19:08:36.949497] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T19:08:37.072993] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-02T19:08:37.872993] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-02T19:08:37.998805] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T19:08:38.673015] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-02T19:08:38.957857] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-02T19:08:38.960373] [INFO ] [REMOTE ] GE: Full fetch complete (77779 records). [2025-10-02T19:08:38.960566] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-02T19:08:39.397863] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-02T19:08:39.397963] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-02T19:08:39.399019] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-02T19:08:39.399101] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-02T19:08:39.400705] [DEBUG] [LOCAL ] GE: Trimmed 77779 records to 54103 (keeping 200 days of data) [2025-10-02T19:08:39.474869] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-02T19:08:39.545028] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T19:08:39.813422] [DEBUG] [LOCAL ] GE: Primary data saved (54103 records). [2025-10-02T19:08:39.813572] [INFO ] [MAIN ] GE: Full history saved. [2025-10-02T19:08:39.813680] [INFO ] [MAIN ] Update Progress: 914/2370 symbols completed. GE took 50.1s. Estimated remaining: 3h 24m 52s. Rate: 7.1 symbols/min [2025-10-02T19:08:40.017346] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:08:40.054186] [DEBUG] [LOCAL ] GETY: Loaded 35605 existing records from primary storage. [2025-10-02T19:08:40.054530] [INFO ] [MAIN ] GETY: Loaded 35605 existing records. [2025-10-02T19:08:40.280173] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-02T19:08:40.288031] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:08:40.289397] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-02T19:08:40.289513] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-02T19:08:40.292343] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-02T19:08:40.292272] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:08:40.292590] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-02T19:08:40.736920] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:41.073039] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-10-02T19:08:41.357095] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T19:08:41.873026] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-02T19:08:41.915762] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T19:08:42.455503] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:08:42.673015] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-02T19:08:43.472988] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-02T19:08:43.672665] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T19:08:44.230525] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:08:44.273014] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-02T19:08:45.025028] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T19:08:45.072975] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-02T19:08:45.873002] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-02T19:08:46.119935] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T19:08:46.673031] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-02T19:08:46.786993] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T19:08:47.472970] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-02T19:08:47.701151] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T19:08:48.132294] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-02T19:08:48.272987] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-02T19:08:48.994440] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T19:08:49.073020] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-02T19:08:49.641355] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T19:08:49.872993] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-02T19:08:50.526478] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T19:08:50.529179] [INFO ] [REMOTE ] GENI: Full fetch complete (75489 records). [2025-10-02T19:08:50.529360] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-02T19:08:50.684867] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-02T19:08:50.961027] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-02T19:08:50.961137] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-02T19:08:50.962154] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-02T19:08:50.962222] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-02T19:08:50.963894] [DEBUG] [LOCAL ] GENI: Trimmed 75489 records to 53320 (keeping 200 days of data) [2025-10-02T19:08:51.298244] [DEBUG] [LOCAL ] GENI: Primary data saved (53320 records). [2025-10-02T19:08:51.298508] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-02T19:08:51.298607] [INFO ] [MAIN ] Update Progress: 915/2370 symbols completed. GENI took 36.2s. Estimated remaining: 3h 24m 48s. Rate: 7.1 symbols/min [2025-10-02T19:08:51.479799] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-02T19:08:51.503263] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:08:51.540492] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T19:08:51.601475] [DEBUG] [LOCAL ] GEV: Loaded 53053 existing records from primary storage. [2025-10-02T19:08:51.601877] [INFO ] [MAIN ] GEV: Loaded 53053 existing records. [2025-10-02T19:08:51.799925] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:08:51.800211] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-02T19:08:51.800305] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-02T19:08:51.802260] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-02T19:08:51.802325] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-02T19:08:52.217088] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:08:52.243924] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T19:08:52.272969] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-02T19:08:53.073005] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-02T19:08:53.126534] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T19:08:53.660996] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T19:08:53.873005] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-02T19:08:54.673004] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-10-02T19:08:54.981458] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T19:08:55.019147] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-02T19:08:55.473055] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-02T19:08:56.272993] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-02T19:08:56.564275] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T19:08:57.037393] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T19:08:57.072975] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-02T19:08:57.698601] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:08:57.873015] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-02T19:08:58.673074] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-02T19:08:59.259942] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T19:08:59.386376] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-02T19:08:59.473011] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-02T19:09:00.211817] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T19:09:00.272982] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-02T19:09:01.073039] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-02T19:09:01.859680] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-02T19:09:01.872958] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-02T19:09:01.916147] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T19:09:02.673567] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-02T19:09:02.677537] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T19:09:03.472994] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-02T19:09:03.926828] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T19:09:03.928677] [INFO ] [REMOTE ] GES: Full fetch complete (59446 records). [2025-10-02T19:09:03.928787] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-02T19:09:04.276126] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-02T19:09:04.415771] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-02T19:09:04.415895] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-02T19:09:04.416905] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-02T19:09:04.416990] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-02T19:09:04.451217] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-10-02T19:09:04.449769] [DEBUG] [LOCAL ] GES: Trimmed 59446 records to 39655 (keeping 200 days of data) [2025-10-02T19:09:04.720952] [DEBUG] [LOCAL ] GES: Primary data saved (39655 records). [2025-10-02T19:09:04.721102] [INFO ] [MAIN ] GES: Full history saved. [2025-10-02T19:09:04.724728] [INFO ] [MAIN ] Update Progress: 916/2370 symbols completed. GES took 32.5s. Estimated remaining: 3h 24m 47s. Rate: 7.1 symbols/min [2025-10-02T19:09:04.936241] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:09:04.943066] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T19:09:04.946982] [INFO ] [REMOTE ] GEO: Full fetch complete (75476 records). [2025-10-02T19:09:04.947245] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-02T19:09:04.950465] [DEBUG] [LOCAL ] GF: Loaded 2967 existing records from primary storage. [2025-10-02T19:09:04.956153] [INFO ] [MAIN ] GF: Loaded 2967 existing records. [2025-10-02T19:09:05.073353] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-02T19:09:05.447416] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:09:05.481594] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-02T19:09:05.485872] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-02T19:09:05.486215] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-02T19:09:05.491717] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-02T19:09:05.712482] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-02T19:09:05.723463] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-02T19:09:05.729575] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-02T19:09:05.793911] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-02T19:09:05.913790] [DEBUG] [LOCAL ] GEO: Trimmed 75476 records to 52324 (keeping 200 days of data) [2025-10-02T19:09:06.059630] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:09:06.106075] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-10-02T19:09:06.111115] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-02T19:09:06.353132] [DEBUG] [LOCAL ] GEO: Primary data saved (52324 records). [2025-10-02T19:09:06.353277] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-02T19:09:06.353373] [INFO ] [MAIN ] Update Progress: 917/2370 symbols completed. GEO took 39.7s. Estimated remaining: 3h 24m 28s. Rate: 7.1 symbols/min [2025-10-02T19:09:06.673055] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-02T19:09:06.763096] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-10-02T19:09:07.117447] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-02T19:09:07.473011] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-02T19:09:07.763841] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T19:09:08.093071] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T19:09:08.273050] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-02T19:09:08.967738] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-02T19:09:09.073012] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-02T19:09:09.873028] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-02T19:09:10.529767] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-02T19:09:10.673010] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-02T19:09:11.482725] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-02T19:09:11.517104] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-10-02T19:09:12.051874] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T19:09:12.094511] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T19:09:12.273023] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-02T19:09:13.072944] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-02T19:09:13.744063] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-02T19:09:13.748518] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T19:09:13.872998] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-02T19:09:14.457534] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T19:09:14.673040] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-02T19:09:15.130685] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-02T19:09:15.473008] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-02T19:09:15.944837] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-02T19:09:16.273044] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-02T19:09:16.754158] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-02T19:09:17.073029] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-02T19:09:17.873014] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-02T19:09:18.236982] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-02T19:09:18.237723] [INFO ] [REMOTE ] GF: Full fetch complete (5175 records). [2025-10-02T19:09:18.237828] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-02T19:09:18.649371] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-02T19:09:18.649448] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-02T19:09:18.649586] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-02T19:09:18.649633] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-02T19:09:18.650033] [DEBUG] [LOCAL ] GF: Trimmed 5175 records to 2981 (keeping 200 days of data) [2025-10-02T19:09:18.670225] [DEBUG] [LOCAL ] GF: Primary data saved (2981 records). [2025-10-02T19:09:18.670312] [INFO ] [MAIN ] GF: Full history saved. [2025-10-02T19:09:18.670387] [INFO ] [MAIN ] Update Progress: 918/2370 symbols completed. GF took 13.9s. Estimated remaining: 3h 24m 26s. Rate: 7.1 symbols/min [2025-10-02T19:09:18.673009] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-02T19:09:19.294030] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-10-02T19:09:19.473064] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-02T19:09:19.803206] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T19:09:19.804912] [INFO ] [REMOTE ] GETY: Full fetch complete (55448 records). [2025-10-02T19:09:19.804998] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-02T19:09:20.227265] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-02T19:09:20.227354] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-02T19:09:20.228395] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-02T19:09:20.228534] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-02T19:09:20.229864] [DEBUG] [LOCAL ] GETY: Trimmed 55448 records to 35780 (keeping 200 days of data) [2025-10-02T19:09:20.456290] [DEBUG] [LOCAL ] GETY: Primary data saved (35780 records). [2025-10-02T19:09:20.456444] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-02T19:09:20.456565] [INFO ] [MAIN ] Update Progress: 919/2370 symbols completed. GETY took 40.6s. Estimated remaining: 3h 24m 7s. Rate: 7.1 symbols/min [2025-10-02T19:09:22.001374] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-02T19:09:22.014336] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-02T19:09:24.498814] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-10-02T19:09:24.510361] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-02T19:09:27.028897] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-10-02T19:09:27.041011] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-02T19:09:29.192878] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-02T19:09:29.195256] [INFO ] [REMOTE ] GEV: Full fetch complete (76903 records). [2025-10-02T19:09:29.195411] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-02T19:09:29.636614] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-02T19:09:29.636790] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-02T19:09:29.637875] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-02T19:09:29.637990] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-02T19:09:29.640271] [DEBUG] [LOCAL ] GEV: Trimmed 76903 records to 53424 (keeping 200 days of data) [2025-10-02T19:09:29.998540] [DEBUG] [LOCAL ] GEV: Primary data saved (53424 records). [2025-10-02T19:09:29.998728] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-02T19:09:29.998928] [INFO ] [MAIN ] Update Progress: 920/2370 symbols completed. GEV took 38.7s. Estimated remaining: 3h 24m 0s. Rate: 7.1 symbols/min [2025-10-02T19:09:30.652633] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:09:30.703437] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:09:30.780440] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:09:30.800005] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:09:30.809086] [DEBUG] [LOCAL ] GFR: Loaded 8335 existing records from primary storage. [2025-10-02T19:09:30.810097] [INFO ] [MAIN ] GFR: Loaded 8335 existing records. [2025-10-02T19:09:31.024700] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:09:31.039161] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-02T19:09:31.050893] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-02T19:09:31.052533] [DEBUG] [LOCAL ] GFF: Loaded 30368 existing records from primary storage. [2025-10-02T19:09:31.052834] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-02T19:09:31.053178] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-02T19:09:31.053106] [INFO ] [MAIN ] GFF: Loaded 30368 existing records. [2025-10-02T19:09:31.263698] [DEBUG] [LOCAL ] GFI: Loaded 53104 existing records from primary storage. [2025-10-02T19:09:31.305789] [DEBUG] [LOCAL ] GFL: Loaded 47938 existing records from primary storage. [2025-10-02T19:09:31.312140] [INFO ] [MAIN ] GFI: Loaded 53104 existing records. [2025-10-02T19:09:31.354871] [INFO ] [MAIN ] GFL: Loaded 47938 existing records. [2025-10-02T19:09:31.625589] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:09:31.718016] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-02T19:09:31.794963] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-02T19:09:31.876041] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-02T19:09:31.901962] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-02T19:09:32.029072] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:09:32.129226] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:09:32.139327] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-02T19:09:32.149912] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-02T19:09:32.165913] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-02T19:09:32.181420] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-02T19:09:32.206234] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-02T19:09:32.248236] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-02T19:09:32.263113] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-02T19:09:32.269573] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:09:32.263227] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-02T19:09:32.275498] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-10-02T19:09:33.237912] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:09:33.264383] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-10-02T19:09:33.444762] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T19:09:33.436393] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:09:33.479091] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:09:33.484081] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-10-02T19:09:33.483799] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-02T19:09:33.480096] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-10-02T19:09:34.217858] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T19:09:34.220946] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-02T19:09:34.634948] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T19:09:34.641955] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-02T19:09:34.709994] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T19:09:34.712423] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-02T19:09:35.026392] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T19:09:35.035705] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-02T19:09:35.314415] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T19:09:35.324873] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-02T19:09:35.472044] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T19:09:35.477323] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-02T19:09:35.714699] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T19:09:35.721141] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-02T19:09:36.128956] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-02T19:09:36.132860] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-02T19:09:36.574882] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T19:09:36.585224] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-02T19:09:36.829403] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-02T19:09:36.833607] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-02T19:09:36.949074] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-02T19:09:36.961180] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-02T19:09:37.198887] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T19:09:37.209846] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-02T19:09:37.547187] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T19:09:37.549496] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-02T19:09:38.055870] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-02T19:09:38.058860] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-02T19:09:38.088034] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:09:38.098676] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-02T19:09:38.519384] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T19:09:38.610288] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T19:09:38.673002] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-02T19:09:38.758962] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T19:09:39.203851] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T19:09:39.351317] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T19:09:39.473053] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-02T19:09:39.939749] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T19:09:39.941047] [INFO ] [REMOTE ] GFR: Full fetch complete (12471 records). [2025-10-02T19:09:39.941150] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-02T19:09:40.280167] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-02T19:09:40.484683] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-02T19:09:40.484802] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-02T19:09:40.485276] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-02T19:09:40.485352] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-02T19:09:40.486093] [DEBUG] [LOCAL ] GFR: Trimmed 12471 records to 8355 (keeping 200 days of data) [2025-10-02T19:09:40.544040] [DEBUG] [LOCAL ] GFR: Primary data saved (8355 records). [2025-10-02T19:09:40.544238] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-02T19:09:40.544379] [INFO ] [MAIN ] Update Progress: 921/2370 symbols completed. GFR took 10.5s. Estimated remaining: 3h 23m 55s. Rate: 7.1 symbols/min [2025-10-02T19:09:40.760284] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:09:40.821166] [DEBUG] [LOCAL ] GGB: Loaded 51093 existing records from primary storage. [2025-10-02T19:09:40.821496] [INFO ] [MAIN ] GGB: Loaded 51093 existing records. [2025-10-02T19:09:41.018576] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:09:41.018847] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-02T19:09:41.018923] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-02T19:09:41.020966] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-02T19:09:41.021045] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-02T19:09:41.078116] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-02T19:09:41.430282] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:09:41.873012] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-02T19:09:42.068316] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T19:09:42.672970] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-02T19:09:42.857076] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T19:09:43.473001] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-02T19:09:43.934200] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-10-02T19:09:44.272965] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-02T19:09:44.339372] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-02T19:09:44.381449] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T19:09:45.072998] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-02T19:09:45.873018] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-02T19:09:46.343806] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-02T19:09:46.672968] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-02T19:09:46.753228] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-10-02T19:09:47.356570] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:09:47.473040] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-10-02T19:09:47.874280] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T19:09:48.273046] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-02T19:09:48.903610] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T19:09:49.073025] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-02T19:09:49.872995] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-02T19:09:50.385437] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-10-02T19:09:50.672995] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-02T19:09:50.749394] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T19:09:50.894917] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T19:09:51.473043] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-02T19:09:52.246803] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T19:09:52.273013] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-02T19:09:52.853805] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T19:09:53.073050] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-02T19:09:53.873013] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-02T19:09:53.929396] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T19:09:54.599439] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T19:09:54.672971] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-02T19:09:55.473005] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-02T19:09:55.829573] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T19:09:56.270676] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T19:09:56.279942] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-02T19:09:56.650519] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-02T19:09:57.073013] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-02T19:09:57.872988] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-02T19:09:58.017477] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T19:09:58.461423] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T19:09:58.464048] [INFO ] [REMOTE ] GFL: Full fetch complete (69137 records). [2025-10-02T19:09:58.464157] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-02T19:09:58.679055] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-02T19:09:58.802477] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-02T19:09:58.824825] [INFO ] [REMOTE ] GFF: Full fetch complete (44161 records). [2025-10-02T19:09:58.844509] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-02T19:09:58.986874] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-02T19:09:59.012301] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-02T19:09:59.016164] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-02T19:09:59.016296] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-02T19:09:59.082495] [DEBUG] [LOCAL ] GFL: Trimmed 69137 records to 48290 (keeping 200 days of data) [2025-10-02T19:09:59.461023] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-02T19:09:59.461916] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-02T19:09:59.464105] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-02T19:09:59.464496] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-02T19:09:59.470235] [DEBUG] [LOCAL ] GFF: Trimmed 44161 records to 30582 (keeping 200 days of data) [2025-10-02T19:09:59.521827] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-02T19:09:59.771241] [DEBUG] [LOCAL ] GFF: Primary data saved (30582 records). [2025-10-02T19:09:59.772000] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-02T19:09:59.772377] [INFO ] [MAIN ] Update Progress: 922/2370 symbols completed. GFF took 29.8s. Estimated remaining: 3h 24m 4s. Rate: 7.1 symbols/min [2025-10-02T19:09:59.993851] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:00.082854] [DEBUG] [LOCAL ] GGG: Loaded 40968 existing records from primary storage. [2025-10-02T19:10:00.084598] [INFO ] [MAIN ] GGG: Loaded 40968 existing records. [2025-10-02T19:10:00.200134] [DEBUG] [LOCAL ] GFL: Primary data saved (48290 records). [2025-10-02T19:10:00.200347] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-02T19:10:00.200845] [INFO ] [MAIN ] Update Progress: 923/2370 symbols completed. GFL took 30.2s. Estimated remaining: 3h 23m 43s. Rate: 7.1 symbols/min [2025-10-02T19:10:00.413531] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:00.448710] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-02T19:10:00.463975] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-02T19:10:00.484973] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:00.487825] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-02T19:10:00.487974] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-02T19:10:00.615967] [DEBUG] [LOCAL ] GGT: Loaded 14063 existing records from primary storage. [2025-10-02T19:10:00.642324] [INFO ] [MAIN ] GGT: Loaded 14063 existing records. [2025-10-02T19:10:01.106441] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:01.123968] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-02T19:10:01.201916] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:01.202556] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-10-02T19:10:01.194517] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-02T19:10:01.204896] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-02T19:10:01.205118] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-02T19:10:01.519983] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.84 seconds). [2025-10-02T19:10:01.609150] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-02T19:10:01.774692] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:01.805455] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-10-02T19:10:01.872990] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-02T19:10:02.541501] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T19:10:02.673063] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-02T19:10:03.473027] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-10-02T19:10:03.678083] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-02T19:10:03.680307] [INFO ] [REMOTE ] GFI: Full fetch complete (76406 records). [2025-10-02T19:10:03.680414] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-02T19:10:04.033163] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-10-02T19:10:04.205389] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-02T19:10:04.205756] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-02T19:10:04.206855] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-02T19:10:04.206987] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-02T19:10:04.230861] [DEBUG] [LOCAL ] GFI: Trimmed 76406 records to 53491 (keeping 200 days of data) [2025-10-02T19:10:04.233109] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T19:10:04.296368] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-02T19:10:04.449829] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-10-02T19:10:04.614092] [DEBUG] [LOCAL ] GFI: Primary data saved (53491 records). [2025-10-02T19:10:04.614264] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-02T19:10:04.615296] [INFO ] [MAIN ] Update Progress: 924/2370 symbols completed. GFI took 34.6s. Estimated remaining: 3h 23m 28s. Rate: 7.1 symbols/min [2025-10-02T19:10:04.810516] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:04.815537] [DEBUG] [LOCAL ] GGZ: Loaded 2416 existing records from primary storage. [2025-10-02T19:10:04.815768] [INFO ] [MAIN ] GGZ: Loaded 2416 existing records. [2025-10-02T19:10:05.016344] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:05.016721] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-02T19:10:05.016795] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-02T19:10:05.017129] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-02T19:10:05.017217] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-02T19:10:05.080476] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-02T19:10:05.407810] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:05.872988] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-10-02T19:10:06.039403] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T19:10:06.097728] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:10:06.472467] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-02T19:10:06.673005] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-02T19:10:07.419521] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T19:10:07.473048] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-02T19:10:08.272988] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-02T19:10:08.344790] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T19:10:09.073040] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-02T19:10:09.706258] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:10:09.873022] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-02T19:10:10.673030] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-02T19:10:10.825743] [DEBUG] [REMOTE ] GGZ: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-10-02T19:10:10.826076] [WARN ] [REMOTE ] GGZ: No data returned for month 2025-01 [2025-10-02T19:10:10.826174] [FATAL] [REMOTE ] GGZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:10:10.826265] [FATAL] [MAIN ] GGZ: Failed to fetch primary data. [2025-10-02T19:10:10.826341] [WARN ] [MAIN ] GGZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:10:10.826447] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-02T19:10:10.826512] [DEBUG] [LOCAL ] GGZ: No primary data file found to delete. [2025-10-02T19:10:10.826551] [INFO ] [LOCAL ] GGZ: Starting deletion of derivative data. [2025-10-02T19:10:10.827076] [DEBUG] [LOCAL ] GGZ: Deleted derivative data file. [2025-10-02T19:10:10.827168] [INFO ] [MAIN ] Update Progress: 925/2370 symbols completed. GGZ took 6.2s. Estimated remaining: 3h 23m 16s. Rate: 7.1 symbols/min [2025-10-02T19:10:11.046347] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:11.049346] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-02T19:10:11.064194] [DEBUG] [LOCAL ] GHC: Loaded 2669 existing records from primary storage. [2025-10-02T19:10:11.064933] [INFO ] [MAIN ] GHC: Loaded 2669 existing records. [2025-10-02T19:10:11.267181] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:11.267512] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-02T19:10:11.267676] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-02T19:10:11.268104] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-02T19:10:11.268211] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-02T19:10:11.478730] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-02T19:10:11.688181] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:10:11.720878] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:12.273000] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-10-02T19:10:12.700573] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-10-02T19:10:13.079995] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-02T19:10:13.103477] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T19:10:13.872998] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-02T19:10:13.917507] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T19:10:14.443393] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T19:10:14.673030] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-02T19:10:15.473008] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-02T19:10:15.831037] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-02T19:10:15.869537] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-02T19:10:16.273028] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-02T19:10:16.940143] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-02T19:10:17.072992] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-02T19:10:17.873004] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-02T19:10:18.009898] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T19:10:18.673000] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-02T19:10:19.472971] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-02T19:10:19.655694] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T19:10:20.059488] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T19:10:20.272991] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-02T19:10:20.409537] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T19:10:20.802771] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T19:10:21.073044] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-02T19:10:21.866491] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T19:10:21.867604] [INFO ] [REMOTE ] GGT: Full fetch complete (18793 records). [2025-10-02T19:10:21.867725] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-02T19:10:21.879611] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-02T19:10:22.277926] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-02T19:10:22.278050] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-02T19:10:22.278530] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-02T19:10:22.278595] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-02T19:10:22.279205] [DEBUG] [LOCAL ] GGT: Trimmed 18793 records to 14175 (keeping 200 days of data) [2025-10-02T19:10:22.368244] [DEBUG] [LOCAL ] GGT: Primary data saved (14175 records). [2025-10-02T19:10:22.368384] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-02T19:10:22.368505] [INFO ] [MAIN ] Update Progress: 926/2370 symbols completed. GGT took 22.2s. Estimated remaining: 3h 23m 12s. Rate: 7.1 symbols/min [2025-10-02T19:10:22.559396] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:22.566124] [DEBUG] [LOCAL ] GHG: Loaded 3185 existing records from primary storage. [2025-10-02T19:10:22.566363] [INFO ] [MAIN ] GHG: Loaded 3185 existing records. [2025-10-02T19:10:22.674900] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-02T19:10:22.759829] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:22.760070] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-02T19:10:22.760124] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-02T19:10:22.760698] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-02T19:10:22.760774] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-02T19:10:23.160588] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:23.193071] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T19:10:23.473021] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-10-02T19:10:24.272996] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-02T19:10:24.345411] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T19:10:24.460970] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T19:10:25.073019] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-02T19:10:25.398574] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T19:10:25.568282] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T19:10:25.872997] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-02T19:10:26.300165] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T19:10:26.673035] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-02T19:10:27.197142] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-02T19:10:27.472995] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-02T19:10:28.021408] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-02T19:10:28.273009] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-02T19:10:28.615192] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-02T19:10:29.073003] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-02T19:10:29.803196] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-02T19:10:29.873048] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-02T19:10:30.672986] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-02T19:10:31.013795] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-02T19:10:31.392752] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T19:10:31.395001] [INFO ] [REMOTE ] GGB: Full fetch complete (74071 records). [2025-10-02T19:10:31.395137] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-02T19:10:31.478106] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-02T19:10:31.868907] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-02T19:10:31.869058] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-02T19:10:31.870040] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-02T19:10:31.870156] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-02T19:10:31.871704] [DEBUG] [LOCAL ] GGB: Trimmed 74071 records to 51478 (keeping 200 days of data) [2025-10-02T19:10:32.004962] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-02T19:10:32.192552] [DEBUG] [LOCAL ] GGB: Primary data saved (51478 records). [2025-10-02T19:10:32.192735] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-02T19:10:32.192839] [INFO ] [MAIN ] Update Progress: 927/2370 symbols completed. GGB took 51.6s. Estimated remaining: 3h 23m 6s. Rate: 7.1 symbols/min [2025-10-02T19:10:32.278163] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-02T19:10:32.381081] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:32.390400] [DEBUG] [LOCAL ] GHI: Loaded 7020 existing records from primary storage. [2025-10-02T19:10:32.390635] [INFO ] [MAIN ] GHI: Loaded 7020 existing records. [2025-10-02T19:10:32.594347] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:32.594575] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-02T19:10:32.594661] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-02T19:10:32.595472] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-02T19:10:32.595533] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-02T19:10:32.875258] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-02T19:10:32.985183] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:33.073002] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-10-02T19:10:33.873022] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-02T19:10:34.098743] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T19:10:34.239764] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-02T19:10:34.673001] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-02T19:10:35.472998] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-02T19:10:35.987536] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-02T19:10:36.182574] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T19:10:36.272976] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-02T19:10:37.073009] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-02T19:10:37.520389] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T19:10:37.776087] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T19:10:37.873005] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-02T19:10:38.672993] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-02T19:10:39.472998] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-02T19:10:39.505367] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T19:10:39.993366] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-02T19:10:40.191847] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-02T19:10:40.272992] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-02T19:10:40.828925] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-02T19:10:41.072997] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-02T19:10:41.872994] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-02T19:10:42.415399] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T19:10:42.672983] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-02T19:10:42.733584] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T19:10:43.472998] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-02T19:10:44.273042] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-02T19:10:44.560485] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T19:10:44.562850] [INFO ] [REMOTE ] GGG: Full fetch complete (59333 records). [2025-10-02T19:10:44.563014] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-02T19:10:44.904350] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-02T19:10:45.009065] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-02T19:10:45.009155] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-02T19:10:45.010051] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-02T19:10:45.010116] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-02T19:10:45.011400] [DEBUG] [LOCAL ] GGG: Trimmed 59333 records to 41247 (keeping 200 days of data) [2025-10-02T19:10:45.081361] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-02T19:10:45.287184] [DEBUG] [LOCAL ] GGG: Primary data saved (41247 records). [2025-10-02T19:10:45.287977] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-02T19:10:45.288284] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-10-02T19:10:45.288535] [INFO ] [MAIN ] Update Progress: 928/2370 symbols completed. GGG took 45.5s. Estimated remaining: 3h 23m 5s. Rate: 7.1 symbols/min [2025-10-02T19:10:45.497231] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:45.504300] [DEBUG] [LOCAL ] GHLD: Loaded 4179 existing records from primary storage. [2025-10-02T19:10:45.504515] [INFO ] [MAIN ] GHLD: Loaded 4179 existing records. [2025-10-02T19:10:45.599832] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T19:10:45.617263] [INFO ] [REMOTE ] GHC: Full fetch complete (3322 records). [2025-10-02T19:10:45.617397] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-02T19:10:45.831058] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:45.864419] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-02T19:10:45.874762] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-02T19:10:45.874613] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-02T19:10:45.882913] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-02T19:10:45.900182] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-02T19:10:46.342480] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-02T19:10:46.382107] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-02T19:10:46.388364] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-02T19:10:46.393580] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-02T19:10:46.414408] [DEBUG] [LOCAL ] GHC: Trimmed 3322 records to 2690 (keeping 200 days of data) [2025-10-02T19:10:46.482494] [DEBUG] [LOCAL ] GHC: Primary data saved (2690 records). [2025-10-02T19:10:46.537578] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T19:10:46.541233] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:46.542315] [INFO ] [REMOTE ] GHG: Full fetch complete (4030 records). [2025-10-02T19:10:46.542433] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-02T19:10:46.529823] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-02T19:10:46.542578] [INFO ] [MAIN ] Update Progress: 929/2370 symbols completed. GHC took 35.7s. Estimated remaining: 3h 22m 45s. Rate: 7.1 symbols/min [2025-10-02T19:10:46.677591] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-10-02T19:10:46.975474] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:47.115300] [DEBUG] [LOCAL ] GHM: Loaded 14066 existing records from primary storage. [2025-10-02T19:10:47.140896] [INFO ] [MAIN ] GHM: Loaded 14066 existing records. [2025-10-02T19:10:47.141033] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-02T19:10:47.163223] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-02T19:10:47.180239] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-02T19:10:47.192903] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-02T19:10:47.228401] [DEBUG] [LOCAL ] GHG: Trimmed 4030 records to 3197 (keeping 200 days of data) [2025-10-02T19:10:47.249155] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-02T19:10:47.375239] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:47.376485] [DEBUG] [LOCAL ] GHG: Primary data saved (3197 records). [2025-10-02T19:10:47.376693] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-02T19:10:47.376774] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-02T19:10:47.376888] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-02T19:10:47.376985] [INFO ] [MAIN ] Update Progress: 930/2370 symbols completed. GHG took 25.0s. Estimated remaining: 3h 22m 25s. Rate: 7.1 symbols/min [2025-10-02T19:10:47.410278] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-02T19:10:47.436218] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-02T19:10:47.509586] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-02T19:10:47.681135] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:10:47.902598] [DEBUG] [LOCAL ] GHY: Loaded 20837 existing records from primary storage. [2025-10-02T19:10:47.918680] [INFO ] [MAIN ] GHY: Loaded 20837 existing records. [2025-10-02T19:10:48.063520] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:48.105833] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T19:10:48.191818] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:10:48.192045] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-02T19:10:48.192095] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-02T19:10:48.192878] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-02T19:10:48.192942] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-02T19:10:48.278187] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-02T19:10:48.583858] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:10:49.073082] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-10-02T19:10:49.089450] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T19:10:49.873037] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-02T19:10:49.976047] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T19:10:50.268708] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-02T19:10:50.673014] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-02T19:10:51.472984] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-02T19:10:51.534496] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T19:10:52.094838] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-02T19:10:52.273009] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-10-02T19:10:53.072999] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-02T19:10:53.329463] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T19:10:53.560133] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-02T19:10:53.873010] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-02T19:10:54.672987] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-02T19:10:55.029467] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T19:10:55.184893] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-02T19:10:55.473049] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-02T19:10:56.273068] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-02T19:10:56.447432] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T19:10:57.072998] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-02T19:10:57.083232] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T19:10:57.571059] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T19:10:57.873040] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-02T19:10:58.673044] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-02T19:10:58.847395] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T19:10:59.136094] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-02T19:10:59.473025] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-02T19:11:00.272974] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-02T19:11:00.643989] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T19:11:00.783483] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-02T19:11:01.073018] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-02T19:11:01.591116] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-02T19:11:01.873042] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-02T19:11:02.483862] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-02T19:11:02.673025] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-02T19:11:03.297742] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T19:11:03.298786] [INFO ] [REMOTE ] GHI: Full fetch complete (11661 records). [2025-10-02T19:11:03.298860] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-02T19:11:03.481117] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-02T19:11:03.686860] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-02T19:11:03.686946] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-02T19:11:03.687223] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-02T19:11:03.687263] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-02T19:11:03.687823] [DEBUG] [LOCAL ] GHI: Trimmed 11661 records to 7089 (keeping 200 days of data) [2025-10-02T19:11:03.739665] [DEBUG] [LOCAL ] GHI: Primary data saved (7089 records). [2025-10-02T19:11:03.739832] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-02T19:11:03.739930] [INFO ] [MAIN ] Update Progress: 931/2370 symbols completed. GHI took 31.5s. Estimated remaining: 3h 22m 29s. Rate: 7.1 symbols/min [2025-10-02T19:11:03.924305] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:03.959343] [DEBUG] [LOCAL ] GIB: Loaded 32101 existing records from primary storage. [2025-10-02T19:11:03.959615] [INFO ] [MAIN ] GIB: Loaded 32101 existing records. [2025-10-02T19:11:04.155848] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:04.156060] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-02T19:11:04.156114] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-02T19:11:04.157332] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-02T19:11:04.157398] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-02T19:11:04.278087] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-02T19:11:04.567196] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:04.774360] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T19:11:05.073017] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-10-02T19:11:05.369155] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-02T19:11:05.873012] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-02T19:11:06.153345] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T19:11:06.672981] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-02T19:11:06.728770] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T19:11:07.301554] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T19:11:07.473024] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-02T19:11:08.167385] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T19:11:08.273032] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-02T19:11:09.073037] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-02T19:11:09.363332] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-02T19:11:09.582911] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-02T19:11:09.873015] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-02T19:11:10.672975] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-02T19:11:10.879362] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:11:11.259247] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-02T19:11:11.473034] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-02T19:11:12.272970] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-02T19:11:12.486811] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:11:13.073012] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-02T19:11:13.234302] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-02T19:11:13.873009] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-02T19:11:14.310479] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T19:11:14.373463] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T19:11:14.374327] [INFO ] [REMOTE ] GHLD: Full fetch complete (4790 records). [2025-10-02T19:11:14.374405] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-02T19:11:14.678149] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-02T19:11:14.779351] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-02T19:11:14.779432] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-02T19:11:14.779576] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-02T19:11:14.779616] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-02T19:11:14.780053] [DEBUG] [LOCAL ] GHLD: Trimmed 4790 records to 4203 (keeping 200 days of data) [2025-10-02T19:11:14.805039] [DEBUG] [LOCAL ] GHLD: Primary data saved (4203 records). [2025-10-02T19:11:14.805149] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-02T19:11:14.805231] [INFO ] [MAIN ] Update Progress: 932/2370 symbols completed. GHLD took 29.5s. Estimated remaining: 3h 22m 24s. Rate: 7.1 symbols/min [2025-10-02T19:11:14.981671] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:14.996552] [DEBUG] [LOCAL ] GIC: Loaded 13517 existing records from primary storage. [2025-10-02T19:11:14.996812] [INFO ] [MAIN ] GIC: Loaded 13517 existing records. [2025-10-02T19:11:15.185993] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:15.186236] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-02T19:11:15.186297] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-02T19:11:15.186821] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-02T19:11:15.186882] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-02T19:11:15.478172] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-02T19:11:15.626784] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:15.730740] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T19:11:16.273016] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-02T19:11:16.641071] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T19:11:17.071984] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T19:11:17.073840] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-02T19:11:17.872997] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-02T19:11:17.924815] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-02T19:11:18.672975] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-02T19:11:18.728395] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:11:18.729816] [INFO ] [REMOTE ] GHM: Full fetch complete (21788 records). [2025-10-02T19:11:18.729893] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-02T19:11:19.122870] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-02T19:11:19.122951] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-02T19:11:19.123443] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-02T19:11:19.123493] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-02T19:11:19.124174] [DEBUG] [LOCAL ] GHM: Trimmed 21788 records to 14163 (keeping 200 days of data) [2025-10-02T19:11:19.216206] [DEBUG] [LOCAL ] GHM: Primary data saved (14163 records). [2025-10-02T19:11:19.216363] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-02T19:11:19.216470] [INFO ] [MAIN ] Update Progress: 933/2370 symbols completed. GHM took 32.6s. Estimated remaining: 3h 22m 10s. Rate: 7.1 symbols/min [2025-10-02T19:11:19.405068] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:19.417730] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T19:11:19.467457] [DEBUG] [LOCAL ] GIL: Loaded 43388 existing records from primary storage. [2025-10-02T19:11:19.467825] [INFO ] [MAIN ] GIL: Loaded 43388 existing records. [2025-10-02T19:11:19.479599] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-02T19:11:19.663605] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:19.663930] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-02T19:11:19.664047] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-02T19:11:19.665556] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-02T19:11:19.665620] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-02T19:11:20.050849] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:20.272992] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-10-02T19:11:20.866719] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T19:11:21.073073] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-02T19:11:21.321442] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T19:11:21.873037] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-02T19:11:22.558942] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T19:11:22.662994] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T19:11:22.664320] [INFO ] [REMOTE ] GHY: Full fetch complete (32266 records). [2025-10-02T19:11:22.664397] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-02T19:11:22.678150] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-02T19:11:23.117602] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-02T19:11:23.117714] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-02T19:11:23.118354] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-02T19:11:23.118416] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-02T19:11:23.119240] [DEBUG] [LOCAL ] GHY: Trimmed 32266 records to 20989 (keeping 200 days of data) [2025-10-02T19:11:23.250430] [DEBUG] [LOCAL ] GHY: Primary data saved (20989 records). [2025-10-02T19:11:23.250557] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-02T19:11:23.250638] [INFO ] [MAIN ] Update Progress: 934/2370 symbols completed. GHY took 35.9s. Estimated remaining: 3h 21m 54s. Rate: 7.1 symbols/min [2025-10-02T19:11:23.444230] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:23.476818] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-10-02T19:11:23.503134] [DEBUG] [LOCAL ] GIS: Loaded 53672 existing records from primary storage. [2025-10-02T19:11:23.503499] [INFO ] [MAIN ] GIS: Loaded 53672 existing records. [2025-10-02T19:11:23.706187] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:23.706492] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-02T19:11:23.706568] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-02T19:11:23.708442] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-02T19:11:23.708539] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-02T19:11:23.819065] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T19:11:24.137706] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:24.273043] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-10-02T19:11:24.889052] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T19:11:25.073028] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-02T19:11:25.872981] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-02T19:11:25.964602] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T19:11:26.231241] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-10-02T19:11:26.673049] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-02T19:11:27.328005] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T19:11:27.473016] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-02T19:11:27.597469] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T19:11:28.272989] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-02T19:11:29.073010] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-02T19:11:29.660859] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T19:11:29.699471] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-02T19:11:29.873019] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-02T19:11:30.610073] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T19:11:30.673025] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-02T19:11:30.891058] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T19:11:31.472996] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-02T19:11:32.023598] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T19:11:32.273002] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-02T19:11:32.887500] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T19:11:33.072995] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-02T19:11:33.872983] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-02T19:11:34.022940] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T19:11:34.672971] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-02T19:11:34.711762] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:11:34.730841] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-02T19:11:35.473014] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-02T19:11:36.272988] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-02T19:11:36.470132] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T19:11:37.073010] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-02T19:11:37.167971] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T19:11:37.546403] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T19:11:37.872999] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-02T19:11:38.654082] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T19:11:38.672958] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-02T19:11:39.137968] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-10-02T19:11:39.320290] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-02T19:11:39.472996] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-02T19:11:40.272991] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-02T19:11:41.073016] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-02T19:11:41.452388] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T19:11:41.770426] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T19:11:41.873001] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-02T19:11:42.456159] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T19:11:42.673029] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-02T19:11:43.297235] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T19:11:43.473042] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-02T19:11:44.273034] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-02T19:11:44.565284] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-02T19:11:45.010455] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:11:45.073013] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-02T19:11:45.458628] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T19:11:45.460224] [INFO ] [REMOTE ] GIB: Full fetch complete (45769 records). [2025-10-02T19:11:45.460313] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-02T19:11:45.879022] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-02T19:11:45.878228] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-02T19:11:45.879135] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-02T19:11:45.880811] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-02T19:11:45.880884] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-02T19:11:45.882139] [DEBUG] [LOCAL ] GIB: Trimmed 45769 records to 32317 (keeping 200 days of data) [2025-10-02T19:11:46.091590] [DEBUG] [LOCAL ] GIB: Primary data saved (32317 records). [2025-10-02T19:11:46.091771] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-02T19:11:46.091872] [INFO ] [MAIN ] Update Progress: 935/2370 symbols completed. GIB took 42.4s. Estimated remaining: 3h 22m 8s. Rate: 7.1 symbols/min [2025-10-02T19:11:46.275345] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:46.315880] [DEBUG] [LOCAL ] GKOS: Loaded 42661 existing records from primary storage. [2025-10-02T19:11:46.316191] [INFO ] [MAIN ] GKOS: Loaded 42661 existing records. [2025-10-02T19:11:46.507195] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:46.507447] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-02T19:11:46.507507] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-02T19:11:46.511909] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-02T19:11:46.512028] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-02T19:11:46.682973] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-02T19:11:46.957967] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:47.234548] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-10-02T19:11:47.472975] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-10-02T19:11:47.573680] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T19:11:47.816629] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-02T19:11:48.272988] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-02T19:11:48.610747] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-02T19:11:49.072995] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-02T19:11:49.825685] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T19:11:49.865004] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T19:11:49.872961] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-02T19:11:50.512155] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T19:11:50.513127] [INFO ] [REMOTE ] GIC: Full fetch complete (20185 records). [2025-10-02T19:11:50.513299] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-02T19:11:50.678158] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-02T19:11:50.925997] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-02T19:11:50.926087] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-02T19:11:50.926552] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-02T19:11:50.926597] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-02T19:11:50.927219] [DEBUG] [LOCAL ] GIC: Trimmed 20185 records to 13577 (keeping 200 days of data) [2025-10-02T19:11:51.012488] [DEBUG] [LOCAL ] GIC: Primary data saved (13577 records). [2025-10-02T19:11:51.012631] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-02T19:11:51.012769] [INFO ] [MAIN ] Update Progress: 936/2370 symbols completed. GIC took 36.2s. Estimated remaining: 3h 21m 54s. Rate: 7.1 symbols/min [2025-10-02T19:11:51.197552] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:51.239335] [DEBUG] [LOCAL ] GL: Loaded 37783 existing records from primary storage. [2025-10-02T19:11:51.239701] [INFO ] [MAIN ] GL: Loaded 37783 existing records. [2025-10-02T19:11:51.430977] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:51.431189] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-02T19:11:51.431239] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-02T19:11:51.432188] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-02T19:11:51.432251] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-02T19:11:51.478084] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-02T19:11:51.837979] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:52.278194] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-10-02T19:11:52.291059] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T19:11:52.921475] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:11:53.073070] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-02T19:11:53.705109] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-10-02T19:11:53.873002] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-02T19:11:54.576833] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:11:54.673044] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-02T19:11:55.295816] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T19:11:55.298089] [INFO ] [REMOTE ] GIL: Full fetch complete (61480 records). [2025-10-02T19:11:55.298324] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-02T19:11:55.475006] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-02T19:11:55.747365] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-02T19:11:55.747462] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-02T19:11:55.748352] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-02T19:11:55.748426] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-02T19:11:55.749789] [DEBUG] [LOCAL ] GIL: Trimmed 61480 records to 43689 (keeping 200 days of data) [2025-10-02T19:11:56.031896] [DEBUG] [LOCAL ] GIL: Primary data saved (43689 records). [2025-10-02T19:11:56.032050] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-02T19:11:56.032705] [INFO ] [MAIN ] Update Progress: 937/2370 symbols completed. GIL took 36.8s. Estimated remaining: 3h 21m 41s. Rate: 7.1 symbols/min [2025-10-02T19:11:56.273966] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-02T19:11:56.275881] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:11:56.330225] [DEBUG] [LOCAL ] GLOB: Loaded 47585 existing records from primary storage. [2025-10-02T19:11:56.330583] [INFO ] [MAIN ] GLOB: Loaded 47585 existing records. [2025-10-02T19:11:56.587157] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:11:56.587589] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-02T19:11:56.587791] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-02T19:11:56.589516] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-02T19:11:56.589594] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-02T19:11:56.955807] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-02T19:11:57.079729] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-02T19:11:57.086521] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:11:57.165267] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T19:11:57.870139] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T19:11:57.879007] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-10-02T19:11:58.672998] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-02T19:11:58.844024] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-02T19:11:59.302298] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T19:11:59.472991] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-02T19:12:00.272980] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-02T19:12:00.381485] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T19:12:01.073023] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-02T19:12:01.304303] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T19:12:01.873027] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-02T19:12:02.187942] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-02T19:12:02.190581] [INFO ] [REMOTE ] GIS: Full fetch complete (77653 records). [2025-10-02T19:12:02.190766] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-02T19:12:02.646977] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T19:12:02.685502] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-02T19:12:02.720871] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-02T19:12:02.720997] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-02T19:12:02.722660] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-02T19:12:02.722805] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-02T19:12:02.724764] [DEBUG] [LOCAL ] GIS: Trimmed 77653 records to 54062 (keeping 200 days of data) [2025-10-02T19:12:03.078686] [DEBUG] [LOCAL ] GIS: Primary data saved (54062 records). [2025-10-02T19:12:03.078834] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-02T19:12:03.078963] [INFO ] [MAIN ] Update Progress: 938/2370 symbols completed. GIS took 39.8s. Estimated remaining: 3h 21m 30s. Rate: 7.1 symbols/min [2025-10-02T19:12:03.279275] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:03.290522] [DEBUG] [LOCAL ] GLP: Loaded 9351 existing records from primary storage. [2025-10-02T19:12:03.290763] [INFO ] [MAIN ] GLP: Loaded 9351 existing records. [2025-10-02T19:12:03.484306] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-02T19:12:03.512315] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T19:12:03.510728] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:03.521908] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-02T19:12:03.522350] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-02T19:12:03.522869] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-02T19:12:03.523324] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-02T19:12:03.925131] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:03.951252] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-02T19:12:04.273011] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-02T19:12:05.021860] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:12:05.072990] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-02T19:12:05.873011] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-10-02T19:12:05.910310] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:12:06.672978] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-02T19:12:06.724820] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T19:12:06.824436] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T19:12:07.472999] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-02T19:12:08.281835] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-02T19:12:08.305256] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T19:12:08.323783] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T19:12:09.072986] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-02T19:12:09.859755] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T19:12:09.872970] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-02T19:12:09.895877] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T19:12:10.673056] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-02T19:12:11.220391] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-02T19:12:11.459087] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T19:12:11.472983] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-02T19:12:12.273050] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-02T19:12:12.381353] [DEBUG] [REMOTE ] GLP: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-02T19:12:12.381704] [WARN ] [REMOTE ] GLP: No data returned for month 2025-04 [2025-10-02T19:12:12.381807] [FATAL] [REMOTE ] GLP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:12:12.381902] [FATAL] [MAIN ] GLP: Failed to fetch primary data. [2025-10-02T19:12:12.381975] [WARN ] [MAIN ] GLP: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:12:12.382069] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-02T19:12:12.382147] [DEBUG] [LOCAL ] GLP: No primary data file found to delete. [2025-10-02T19:12:12.382186] [INFO ] [LOCAL ] GLP: Starting deletion of derivative data. [2025-10-02T19:12:12.382636] [DEBUG] [LOCAL ] GLP: Deleted derivative data file. [2025-10-02T19:12:12.382758] [INFO ] [MAIN ] Update Progress: 939/2370 symbols completed. GLP took 9.3s. Estimated remaining: 3h 21m 23s. Rate: 7.1 symbols/min [2025-10-02T19:12:12.556472] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:12.617307] [DEBUG] [LOCAL ] GLW: Loaded 53636 existing records from primary storage. [2025-10-02T19:12:12.617894] [INFO ] [MAIN ] GLW: Loaded 53636 existing records. [2025-10-02T19:12:12.834572] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:12.834856] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-02T19:12:12.834916] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-02T19:12:12.836599] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-02T19:12:12.836691] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-02T19:12:13.078105] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-02T19:12:13.214237] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:13.249688] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T19:12:13.873057] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-02T19:12:14.669496] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T19:12:14.678037] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-10-02T19:12:15.473381] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-02T19:12:15.473287] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T19:12:16.272997] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-02T19:12:16.647002] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-02T19:12:17.038064] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T19:12:17.072968] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-02T19:12:17.787673] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T19:12:17.873029] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-02T19:12:18.606336] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-02T19:12:18.608705] [INFO ] [REMOTE ] GKOS: Full fetch complete (60032 records). [2025-10-02T19:12:18.608864] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-02T19:12:18.678160] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-02T19:12:19.040566] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-02T19:12:19.040724] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-02T19:12:19.041900] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-02T19:12:19.041977] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-02T19:12:19.043993] [DEBUG] [LOCAL ] GKOS: Trimmed 60032 records to 42984 (keeping 200 days of data) [2025-10-02T19:12:19.317367] [DEBUG] [LOCAL ] GKOS: Primary data saved (42984 records). [2025-10-02T19:12:19.317555] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-02T19:12:19.317695] [INFO ] [MAIN ] Update Progress: 940/2370 symbols completed. GKOS took 33.2s. Estimated remaining: 3h 21m 12s. Rate: 7.1 symbols/min [2025-10-02T19:12:19.475108] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-02T19:12:19.497296] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:19.545077] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T19:12:19.608482] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-10-02T19:12:19.609017] [INFO ] [MAIN ] GM: Loaded 53728 existing records. [2025-10-02T19:12:19.789960] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:19.790283] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-02T19:12:19.790339] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-02T19:12:19.792311] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-02T19:12:19.792378] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-02T19:12:20.174615] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:20.273009] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-10-02T19:12:20.332436] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T19:12:21.072979] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-02T19:12:21.185464] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T19:12:21.873087] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-02T19:12:22.517606] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T19:12:22.565453] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-10-02T19:12:22.673012] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-02T19:12:23.478241] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-02T19:12:23.505260] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T19:12:24.007326] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T19:12:24.273026] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-02T19:12:25.073056] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-02T19:12:25.306927] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-02T19:12:25.872982] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-02T19:12:25.982525] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T19:12:26.299577] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T19:12:26.301826] [INFO ] [REMOTE ] GL: Full fetch complete (55420 records). [2025-10-02T19:12:26.302001] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-02T19:12:26.675979] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-02T19:12:26.736583] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-02T19:12:26.736812] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-02T19:12:26.738897] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-02T19:12:26.739020] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-02T19:12:26.741393] [DEBUG] [LOCAL ] GL: Trimmed 55420 records to 38054 (keeping 200 days of data) [2025-10-02T19:12:27.030491] [DEBUG] [LOCAL ] GL: Primary data saved (38054 records). [2025-10-02T19:12:27.030761] [INFO ] [MAIN ] GL: Full history saved. [2025-10-02T19:12:27.030925] [INFO ] [MAIN ] Update Progress: 941/2370 symbols completed. GL took 36.0s. Estimated remaining: 3h 21m 3s. Rate: 7.1 symbols/min [2025-10-02T19:12:27.215634] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:27.273268] [DEBUG] [LOCAL ] GME: Loaded 53762 existing records from primary storage. [2025-10-02T19:12:27.273770] [INFO ] [MAIN ] GME: Loaded 53762 existing records. [2025-10-02T19:12:27.460689] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:27.461121] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-02T19:12:27.461186] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-02T19:12:27.463397] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-02T19:12:27.463460] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-02T19:12:27.495336] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-02T19:12:27.844302] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:27.890570] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-02T19:12:28.273011] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-02T19:12:28.737916] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-02T19:12:29.072989] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-02T19:12:29.279561] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T19:12:29.872993] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-10-02T19:12:29.917631] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:12:30.672994] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-02T19:12:31.241259] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-02T19:12:31.473047] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-02T19:12:32.272995] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-02T19:12:32.350494] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T19:12:32.500855] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-10-02T19:12:33.072995] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-02T19:12:33.259749] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-02T19:12:33.873132] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-02T19:12:34.483753] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-10-02T19:12:34.673009] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-02T19:12:34.877751] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T19:12:35.473005] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-02T19:12:36.272974] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-02T19:12:36.407116] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-10-02T19:12:36.536532] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T19:12:37.072999] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-02T19:12:37.448616] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T19:12:37.565668] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:12:37.567965] [INFO ] [REMOTE ] GLOB: Full fetch complete (64177 records). [2025-10-02T19:12:37.568115] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-02T19:12:37.878245] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-02T19:12:38.002091] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-02T19:12:38.002187] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-02T19:12:38.003045] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-02T19:12:38.003122] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-02T19:12:38.004548] [DEBUG] [LOCAL ] GLOB: Trimmed 64177 records to 47963 (keeping 200 days of data) [2025-10-02T19:12:38.308459] [DEBUG] [LOCAL ] GLOB: Primary data saved (47963 records). [2025-10-02T19:12:38.308725] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-02T19:12:38.309950] [INFO ] [MAIN ] Update Progress: 942/2370 symbols completed. GLOB took 42.3s. Estimated remaining: 3h 20m 58s. Rate: 7.1 symbols/min [2025-10-02T19:12:38.505563] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:38.568701] [DEBUG] [LOCAL ] GMED: Loaded 48332 existing records from primary storage. [2025-10-02T19:12:38.569108] [INFO ] [MAIN ] GMED: Loaded 48332 existing records. [2025-10-02T19:12:38.678234] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-02T19:12:38.799160] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:38.799369] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-02T19:12:38.799418] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-02T19:12:38.801049] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-02T19:12:38.801123] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-02T19:12:39.189169] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:39.227242] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-02T19:12:39.472983] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-02T19:12:39.611147] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T19:12:40.272991] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-02T19:12:40.448000] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-02T19:12:41.072998] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-02T19:12:41.873023] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-10-02T19:12:42.023613] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-10-02T19:12:42.092756] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T19:12:42.673050] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-02T19:12:43.277295] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-10-02T19:12:43.436580] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T19:12:43.472955] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-02T19:12:44.272983] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-02T19:12:44.525773] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-02T19:12:44.529054] [INFO ] [REMOTE ] GLW: Full fetch complete (77618 records). [2025-10-02T19:12:44.529217] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-02T19:12:44.990884] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-02T19:12:44.991004] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-02T19:12:44.992210] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-02T19:12:44.992310] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-02T19:12:44.994772] [DEBUG] [LOCAL ] GLW: Trimmed 77618 records to 54026 (keeping 200 days of data) [2025-10-02T19:12:45.092893] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-02T19:12:45.129614] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T19:12:45.408258] [DEBUG] [LOCAL ] GLW: Primary data saved (54026 records). [2025-10-02T19:12:45.408504] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-02T19:12:45.408669] [INFO ] [MAIN ] Update Progress: 943/2370 symbols completed. GLW took 33.0s. Estimated remaining: 3h 20m 48s. Rate: 7.1 symbols/min [2025-10-02T19:12:45.603980] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:45.644316] [DEBUG] [LOCAL ] GMRE: Loaded 37396 existing records from primary storage. [2025-10-02T19:12:45.644712] [INFO ] [MAIN ] GMRE: Loaded 37396 existing records. [2025-10-02T19:12:45.852113] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:45.852356] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-02T19:12:45.852417] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-02T19:12:45.853971] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-02T19:12:45.854037] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-02T19:12:45.888711] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-02T19:12:46.272332] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:46.673043] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-10-02T19:12:46.826408] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-10-02T19:12:47.106833] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-02T19:12:47.473001] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-02T19:12:47.620687] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T19:12:47.779122] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T19:12:48.272996] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-02T19:12:49.072988] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-02T19:12:49.516543] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-02T19:12:49.721523] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:12:49.873047] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-02T19:12:50.673031] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-02T19:12:51.472967] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-02T19:12:51.581389] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-10-02T19:12:51.646454] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T19:12:51.983758] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T19:12:52.273051] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-02T19:12:53.072979] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-02T19:12:53.236974] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-02T19:12:53.239174] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-10-02T19:12:53.239293] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-02T19:12:53.737165] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T19:12:53.741876] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-02T19:12:53.749962] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-02T19:12:53.751421] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-02T19:12:53.751505] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-02T19:12:53.753112] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 54118 (keeping 200 days of data) [2025-10-02T19:12:53.873119] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-02T19:12:54.142631] [DEBUG] [LOCAL ] GM: Primary data saved (54118 records). [2025-10-02T19:12:54.142804] [INFO ] [MAIN ] GM: Full history saved. [2025-10-02T19:12:54.142928] [INFO ] [MAIN ] Update Progress: 944/2370 symbols completed. GM took 34.8s. Estimated remaining: 3h 20m 40s. Rate: 7.1 symbols/min [2025-10-02T19:12:54.333430] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:12:54.353683] [DEBUG] [LOCAL ] GNE: Loaded 17835 existing records from primary storage. [2025-10-02T19:12:54.353999] [INFO ] [MAIN ] GNE: Loaded 17835 existing records. [2025-10-02T19:12:54.551133] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:12:54.551382] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-02T19:12:54.551429] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-02T19:12:54.552238] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-02T19:12:54.552336] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-02T19:12:54.678106] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-02T19:12:54.953894] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:12:55.298463] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-02T19:12:55.472992] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-10-02T19:12:55.620160] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T19:12:55.936873] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-02T19:12:56.272989] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-02T19:12:56.343490] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-10-02T19:12:57.073017] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-02T19:12:57.516388] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T19:12:57.847320] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T19:12:57.872959] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-02T19:12:58.673007] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-02T19:12:59.464249] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-02T19:12:59.472955] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-02T19:13:00.273002] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-02T19:13:00.273079] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-02T19:13:00.559950] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-02T19:13:01.073021] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-02T19:13:01.882166] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-02T19:13:01.908159] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T19:13:02.673000] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-02T19:13:02.738725] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T19:13:03.472988] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-02T19:13:03.572941] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-02T19:13:03.795213] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T19:13:04.054135] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T19:13:04.273021] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-02T19:13:05.073048] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-02T19:13:05.873048] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-02T19:13:06.628930] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T19:13:06.672976] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-02T19:13:06.765397] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-10-02T19:13:07.158731] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T19:13:07.473047] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-02T19:13:08.185369] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T19:13:08.273045] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-02T19:13:08.531270] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-02T19:13:09.073023] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-02T19:13:09.873059] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-02T19:13:10.028756] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T19:13:10.055041] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T19:13:10.672995] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-02T19:13:11.443968] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-02T19:13:11.472964] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-02T19:13:11.926721] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-02T19:13:11.929926] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-10-02T19:13:11.930061] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-02T19:13:12.278118] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-02T19:13:12.364870] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-02T19:13:12.364957] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-02T19:13:12.366058] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-02T19:13:12.366183] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-02T19:13:12.367857] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 54152 (keeping 200 days of data) [2025-10-02T19:13:12.645627] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T19:13:12.779768] [DEBUG] [LOCAL ] GME: Primary data saved (54152 records). [2025-10-02T19:13:12.779906] [INFO ] [MAIN ] GME: Full history saved. [2025-10-02T19:13:12.780046] [INFO ] [MAIN ] Update Progress: 945/2370 symbols completed. GME took 45.7s. Estimated remaining: 3h 20m 47s. Rate: 7.1 symbols/min [2025-10-02T19:13:12.971136] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:13.014042] [DEBUG] [LOCAL ] GNK: Loaded 40264 existing records from primary storage. [2025-10-02T19:13:13.014430] [INFO ] [MAIN ] GNK: Loaded 40264 existing records. [2025-10-02T19:13:13.079273] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-02T19:13:13.202913] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:13.203188] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-02T19:13:13.203238] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-02T19:13:13.204459] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-02T19:13:13.204522] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-02T19:13:13.600455] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:13.629262] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T19:13:13.872997] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-02T19:13:14.459040] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T19:13:14.673006] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-02T19:13:15.132890] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T19:13:15.473020] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-02T19:13:15.497046] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-02T19:13:15.500026] [INFO ] [REMOTE ] GNE: Full fetch complete (22478 records). [2025-10-02T19:13:15.500205] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-02T19:13:15.963245] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-02T19:13:15.963326] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-02T19:13:15.963860] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-02T19:13:15.963924] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-02T19:13:15.964586] [DEBUG] [LOCAL ] GNE: Trimmed 22478 records to 17926 (keeping 200 days of data) [2025-10-02T19:13:16.077240] [DEBUG] [LOCAL ] GNE: Primary data saved (17926 records). [2025-10-02T19:13:16.077381] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-02T19:13:16.077464] [INFO ] [MAIN ] Update Progress: 946/2370 symbols completed. GNE took 21.9s. Estimated remaining: 3h 20m 31s. Rate: 7.1 symbols/min [2025-10-02T19:13:16.265413] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:16.273030] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-02T19:13:16.315801] [DEBUG] [LOCAL ] GNL: Loaded 46827 existing records from primary storage. [2025-10-02T19:13:16.316133] [INFO ] [MAIN ] GNL: Loaded 46827 existing records. [2025-10-02T19:13:16.506245] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:16.506466] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-02T19:13:16.506515] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-02T19:13:16.508089] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-02T19:13:16.508171] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-02T19:13:16.934853] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:17.049090] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-02T19:13:17.053222] [INFO ] [REMOTE ] GMED: Full fetch complete (69679 records). [2025-10-02T19:13:17.053379] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-02T19:13:17.080762] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-10-02T19:13:17.508538] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-02T19:13:17.508634] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-02T19:13:17.509616] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-02T19:13:17.509711] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-02T19:13:17.511128] [DEBUG] [LOCAL ] GMED: Trimmed 69679 records to 48729 (keeping 200 days of data) [2025-10-02T19:13:17.731152] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T19:13:17.734560] [INFO ] [REMOTE ] GMRE: Full fetch complete (53331 records). [2025-10-02T19:13:17.735958] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-02T19:13:17.874042] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-10-02T19:13:18.201320] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-02T19:13:18.201443] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-02T19:13:18.202334] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-02T19:13:18.202425] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-02T19:13:18.256138] [DEBUG] [LOCAL ] GMED: Primary data saved (48729 records). [2025-10-02T19:13:18.256541] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-02T19:13:18.258769] [DEBUG] [LOCAL ] GMRE: Trimmed 53331 records to 37572 (keeping 200 days of data) [2025-10-02T19:13:18.258616] [INFO ] [MAIN ] Update Progress: 947/2370 symbols completed. GMED took 39.9s. Estimated remaining: 3h 20m 13s. Rate: 7.1 symbols/min [2025-10-02T19:13:18.544962] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:18.612408] [DEBUG] [LOCAL ] GNRC: Loaded 45108 existing records from primary storage. [2025-10-02T19:13:18.612808] [INFO ] [MAIN ] GNRC: Loaded 45108 existing records. [2025-10-02T19:13:18.908946] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:18.915097] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-02T19:13:18.915266] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-02T19:13:18.917746] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-02T19:13:18.918937] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-02T19:13:19.098795] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-10-02T19:13:19.166882] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-02T19:13:19.271992] [DEBUG] [LOCAL ] GMRE: Primary data saved (37572 records). [2025-10-02T19:13:19.298112] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-02T19:13:19.298381] [INFO ] [MAIN ] Update Progress: 948/2370 symbols completed. GMRE took 33.9s. Estimated remaining: 3h 19m 53s. Rate: 7.1 symbols/min [2025-10-02T19:13:19.506385] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:19.498920] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T19:13:19.514906] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-10-02T19:13:19.610495] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:19.621294] [DEBUG] [LOCAL ] GNT: Loaded 8141 existing records from primary storage. [2025-10-02T19:13:19.621619] [INFO ] [MAIN ] GNT: Loaded 8141 existing records. [2025-10-02T19:13:19.818777] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:19.819002] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-02T19:13:19.819050] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-02T19:13:19.819452] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-02T19:13:19.819523] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-02T19:13:20.203119] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:20.272991] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-10-02T19:13:20.764042] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T19:13:20.865006] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:13:20.941943] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-02T19:13:21.072990] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-02T19:13:21.657804] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-02T19:13:21.872992] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-02T19:13:22.673010] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-02T19:13:23.098827] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T19:13:23.472996] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-02T19:13:24.191336] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:13:24.272999] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-02T19:13:24.779238] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T19:13:25.073002] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-02T19:13:25.576192] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-02T19:13:25.873057] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-02T19:13:26.355488] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-02T19:13:26.619634] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T19:13:26.673057] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-02T19:13:27.473018] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-02T19:13:28.069440] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T19:13:28.273022] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-02T19:13:29.024670] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T19:13:29.073015] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-02T19:13:29.873006] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-02T19:13:29.942569] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T19:13:30.621118] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T19:13:30.672980] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-02T19:13:31.259058] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T19:13:31.439538] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T19:13:31.472969] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-02T19:13:32.273008] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-02T19:13:33.074818] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-02T19:13:33.077733] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T19:13:33.456391] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-02T19:13:33.828072] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T19:13:33.872994] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-02T19:13:34.672998] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-02T19:13:35.279384] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:13:35.435928] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T19:13:35.472984] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-02T19:13:36.273038] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-02T19:13:36.290415] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T19:13:37.073039] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-02T19:13:37.628930] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-02T19:13:37.884675] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-02T19:13:37.891771] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-02T19:13:38.673018] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-02T19:13:39.473010] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-02T19:13:39.522318] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T19:13:40.256392] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:13:40.272954] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-02T19:13:41.016696] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:13:41.073006] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-02T19:13:41.801196] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T19:13:41.873030] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-02T19:13:42.214674] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T19:13:42.574719] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T19:13:42.673021] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-02T19:13:43.473003] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-02T19:13:44.129012] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T19:13:44.273039] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-02T19:13:44.896499] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T19:13:44.943047] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T19:13:45.073009] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-02T19:13:45.873032] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-02T19:13:46.306325] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T19:13:46.673000] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-02T19:13:47.208829] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T19:13:47.472996] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-02T19:13:48.111016] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T19:13:48.112003] [INFO ] [REMOTE ] GNT: Full fetch complete (10840 records). [2025-10-02T19:13:48.112081] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-02T19:13:48.280142] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-02T19:13:48.491677] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T19:13:48.574051] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-02T19:13:48.574136] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-02T19:13:48.574409] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-02T19:13:48.574451] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-02T19:13:48.574979] [DEBUG] [LOCAL ] GNT: Trimmed 10840 records to 8217 (keeping 200 days of data) [2025-10-02T19:13:48.624347] [DEBUG] [LOCAL ] GNT: Primary data saved (8217 records). [2025-10-02T19:13:48.624478] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-02T19:13:48.624556] [INFO ] [MAIN ] Update Progress: 949/2370 symbols completed. GNT took 29.3s. Estimated remaining: 3h 20m 16s. Rate: 7.1 symbols/min [2025-10-02T19:13:48.825674] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:48.877591] [DEBUG] [LOCAL ] GNW: Loaded 51326 existing records from primary storage. [2025-10-02T19:13:48.877988] [INFO ] [MAIN ] GNW: Loaded 51326 existing records. [2025-10-02T19:13:49.070912] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:49.071150] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-02T19:13:49.071202] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-02T19:13:49.072453] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-02T19:13:49.072518] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-02T19:13:49.083878] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-02T19:13:49.486390] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:49.873005] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-10-02T19:13:49.951439] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T19:13:50.394291] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T19:13:50.396360] [INFO ] [REMOTE ] GNL: Full fetch complete (68266 records). [2025-10-02T19:13:50.396487] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-02T19:13:50.679455] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-02T19:13:50.811817] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-02T19:13:50.811914] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-02T19:13:50.812897] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-02T19:13:50.812972] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-02T19:13:50.814444] [DEBUG] [LOCAL ] GNL: Trimmed 68266 records to 47148 (keeping 200 days of data) [2025-10-02T19:13:51.093694] [DEBUG] [LOCAL ] GNL: Primary data saved (47148 records). [2025-10-02T19:13:51.093840] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-02T19:13:51.093927] [INFO ] [MAIN ] Update Progress: 950/2370 symbols completed. GNL took 35.0s. Estimated remaining: 3h 19m 59s. Rate: 7.1 symbols/min [2025-10-02T19:13:51.280887] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:51.312137] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T19:13:51.362778] [DEBUG] [LOCAL ] GOF: Loaded 42589 existing records from primary storage. [2025-10-02T19:13:51.363095] [INFO ] [MAIN ] GOF: Loaded 42589 existing records. [2025-10-02T19:13:51.475050] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-02T19:13:51.559922] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:51.560190] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-02T19:13:51.560248] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-02T19:13:51.561673] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-02T19:13:51.561738] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-02T19:13:51.945270] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:52.039063] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T19:13:52.041093] [INFO ] [REMOTE ] GNK: Full fetch complete (57175 records). [2025-10-02T19:13:52.041209] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-02T19:13:52.285339] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-10-02T19:13:52.463207] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-02T19:13:52.463293] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-02T19:13:52.464079] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-02T19:13:52.464143] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-02T19:13:52.465364] [DEBUG] [LOCAL ] GNK: Trimmed 57175 records to 40592 (keeping 200 days of data) [2025-10-02T19:13:52.725955] [DEBUG] [LOCAL ] GNK: Primary data saved (40592 records). [2025-10-02T19:13:52.726086] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-02T19:13:52.726174] [INFO ] [MAIN ] Update Progress: 951/2370 symbols completed. GNK took 39.9s. Estimated remaining: 3h 19m 40s. Rate: 7.1 symbols/min [2025-10-02T19:13:52.902099] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:13:52.934433] [DEBUG] [LOCAL ] GOLF: Loaded 31207 existing records from primary storage. [2025-10-02T19:13:52.934839] [INFO ] [MAIN ] GOLF: Loaded 31207 existing records. [2025-10-02T19:13:53.079944] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-02T19:13:53.123404] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:13:53.123800] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-02T19:13:53.123890] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-02T19:13:53.124934] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-02T19:13:53.124998] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-02T19:13:53.421171] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-02T19:13:53.556027] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:13:53.624092] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T19:13:53.872992] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-02T19:13:54.568486] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:13:54.673042] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-10-02T19:13:55.472995] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-02T19:13:55.564910] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T19:13:55.789376] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T19:13:56.273014] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-02T19:13:56.848319] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-02T19:13:57.073047] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-02T19:13:57.878053] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-02T19:13:57.898629] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T19:13:58.672990] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-02T19:13:58.814807] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T19:13:59.006412] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T19:13:59.473046] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-02T19:14:00.105431] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T19:14:00.107460] [INFO ] [REMOTE ] GNRC: Full fetch complete (65302 records). [2025-10-02T19:14:00.107581] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-02T19:14:00.278162] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-02T19:14:00.549206] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-02T19:14:00.549325] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-02T19:14:00.550278] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-02T19:14:00.550347] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-02T19:14:00.551791] [DEBUG] [LOCAL ] GNRC: Trimmed 65302 records to 45434 (keeping 200 days of data) [2025-10-02T19:14:00.849829] [DEBUG] [LOCAL ] GNRC: Primary data saved (45434 records). [2025-10-02T19:14:00.849965] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-02T19:14:00.853208] [INFO ] [MAIN ] Update Progress: 952/2370 symbols completed. GNRC took 42.6s. Estimated remaining: 3h 19m 31s. Rate: 7.1 symbols/min [2025-10-02T19:14:01.049121] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:14:01.076986] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-02T19:14:01.098535] [DEBUG] [LOCAL ] GOOS: Loaded 45028 existing records from primary storage. [2025-10-02T19:14:01.099008] [INFO ] [MAIN ] GOOS: Loaded 45028 existing records. [2025-10-02T19:14:01.298971] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:14:01.299222] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-02T19:14:01.299272] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-02T19:14:01.300771] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-02T19:14:01.300833] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-02T19:14:01.707696] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:14:01.743451] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-10-02T19:14:01.873003] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-10-02T19:14:01.949923] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T19:14:02.672985] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-02T19:14:02.769462] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T19:14:03.473065] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-02T19:14:03.541539] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T19:14:03.771224] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T19:14:04.273018] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-02T19:14:04.789077] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T19:14:05.073010] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-02T19:14:05.734430] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T19:14:05.873024] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-02T19:14:06.297550] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-02T19:14:06.673041] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-02T19:14:07.292199] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T19:14:07.473059] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-02T19:14:08.068557] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:14:08.273048] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-02T19:14:08.849792] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T19:14:09.073027] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-02T19:14:09.873060] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-02T19:14:10.038185] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-02T19:14:10.296088] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T19:14:10.673050] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-02T19:14:11.398058] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:14:11.473007] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-02T19:14:11.911983] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T19:14:12.273009] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-02T19:14:13.038554] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:14:13.072994] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-02T19:14:13.566253] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T19:14:13.873007] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-02T19:14:14.673009] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-02T19:14:14.840911] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T19:14:15.231520] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T19:14:15.473022] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-02T19:14:16.050639] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T19:14:16.273008] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-02T19:14:16.881084] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T19:14:17.072986] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-02T19:14:17.390141] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-02T19:14:17.873015] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-02T19:14:18.447028] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T19:14:18.673014] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-02T19:14:19.472971] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-02T19:14:19.522551] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-02T19:14:19.524082] [INFO ] [REMOTE ] GOLF: Full fetch complete (45107 records). [2025-10-02T19:14:19.524176] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-02T19:14:19.728604] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T19:14:19.982457] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-02T19:14:19.982545] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-02T19:14:19.983319] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-02T19:14:19.983387] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-02T19:14:19.984495] [DEBUG] [LOCAL ] GOLF: Trimmed 45107 records to 31420 (keeping 200 days of data) [2025-10-02T19:14:20.183360] [DEBUG] [LOCAL ] GOLF: Primary data saved (31420 records). [2025-10-02T19:14:20.183504] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-02T19:14:20.183590] [INFO ] [MAIN ] Update Progress: 953/2370 symbols completed. GOLF took 27.5s. Estimated remaining: 3h 19m 39s. Rate: 7.1 symbols/min [2025-10-02T19:14:20.279743] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-02T19:14:20.376348] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:14:20.421119] [DEBUG] [LOCAL ] GOTU: Loaded 38435 existing records from primary storage. [2025-10-02T19:14:20.421618] [INFO ] [MAIN ] GOTU: Loaded 38435 existing records. [2025-10-02T19:14:20.619485] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:14:20.619755] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-02T19:14:20.619842] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-02T19:14:20.621116] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-02T19:14:20.621182] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-02T19:14:21.011404] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:14:21.073026] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-10-02T19:14:21.241360] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T19:14:21.709333] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T19:14:21.711251] [INFO ] [REMOTE ] GOF: Full fetch complete (62118 records). [2025-10-02T19:14:21.711419] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-02T19:14:21.878244] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-02T19:14:22.167087] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-02T19:14:22.167219] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-02T19:14:22.168168] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-02T19:14:22.168235] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-02T19:14:22.169784] [DEBUG] [LOCAL ] GOF: Trimmed 62118 records to 42879 (keeping 200 days of data) [2025-10-02T19:14:22.468326] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T19:14:22.488151] [DEBUG] [LOCAL ] GOF: Primary data saved (42879 records). [2025-10-02T19:14:22.488270] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-02T19:14:22.488384] [INFO ] [MAIN ] Update Progress: 954/2370 symbols completed. GOF took 31.4s. Estimated remaining: 3h 19m 21s. Rate: 7.1 symbols/min [2025-10-02T19:14:22.677820] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-02T19:14:22.679585] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:14:22.734208] [DEBUG] [LOCAL ] GPC: Loaded 46349 existing records from primary storage. [2025-10-02T19:14:22.734563] [INFO ] [MAIN ] GPC: Loaded 46349 existing records. [2025-10-02T19:14:22.925557] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:14:22.925868] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-02T19:14:22.925919] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-02T19:14:22.928207] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-02T19:14:22.928270] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-02T19:14:23.343755] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:14:23.472997] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-02T19:14:23.725900] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-02T19:14:24.272999] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-02T19:14:24.339248] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T19:14:25.072995] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-02T19:14:25.159379] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T19:14:25.832066] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T19:14:25.834377] [INFO ] [REMOTE ] GNW: Full fetch complete (73558 records). [2025-10-02T19:14:25.834511] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-02T19:14:25.878105] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-02T19:14:26.298358] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-02T19:14:26.298584] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-02T19:14:26.299726] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-02T19:14:26.299920] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-02T19:14:26.301454] [DEBUG] [LOCAL ] GNW: Trimmed 73558 records to 51722 (keeping 200 days of data) [2025-10-02T19:14:26.646680] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:14:26.663548] [DEBUG] [LOCAL ] GNW: Primary data saved (51722 records). [2025-10-02T19:14:26.663780] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-02T19:14:26.663906] [INFO ] [MAIN ] Update Progress: 955/2370 symbols completed. GNW took 38.0s. Estimated remaining: 3h 19m 7s. Rate: 7.1 symbols/min [2025-10-02T19:14:26.678103] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-10-02T19:14:26.855450] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:14:26.873521] [DEBUG] [LOCAL ] GPI: Loaded 14648 existing records from primary storage. [2025-10-02T19:14:26.873800] [INFO ] [MAIN ] GPI: Loaded 14648 existing records. [2025-10-02T19:14:27.086719] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:14:27.086924] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-02T19:14:27.086976] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-02T19:14:27.087832] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-02T19:14:27.087895] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-02T19:14:27.496360] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:14:27.473406] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-02T19:14:27.524630] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T19:14:28.273019] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-02T19:14:28.626714] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-02T19:14:28.893487] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T19:14:29.072995] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-02T19:14:29.740068] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T19:14:29.872983] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-10-02T19:14:30.669861] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T19:14:30.672901] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-02T19:14:30.699153] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T19:14:31.472983] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-02T19:14:31.679524] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T19:14:32.273014] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-02T19:14:32.843045] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T19:14:33.072992] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-02T19:14:33.166254] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T19:14:33.873003] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-02T19:14:34.672976] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-02T19:14:34.737359] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T19:14:35.172885] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T19:14:35.473000] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-02T19:14:35.800764] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-02T19:14:36.273049] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-02T19:14:36.784953] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T19:14:37.073102] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-02T19:14:37.351772] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-02T19:14:37.873040] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-02T19:14:38.292785] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T19:14:38.294783] [INFO ] [REMOTE ] GOOS: Full fetch complete (65541 records). [2025-10-02T19:14:38.294921] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-02T19:14:38.674428] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-02T19:14:38.722522] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-02T19:14:38.722612] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-02T19:14:38.723618] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-02T19:14:38.723800] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-02T19:14:38.725338] [DEBUG] [LOCAL ] GOOS: Trimmed 65541 records to 45342 (keeping 200 days of data) [2025-10-02T19:14:39.006877] [DEBUG] [LOCAL ] GOOS: Primary data saved (45342 records). [2025-10-02T19:14:39.007009] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-02T19:14:39.008104] [INFO ] [MAIN ] Update Progress: 956/2370 symbols completed. GOOS took 38.2s. Estimated remaining: 3h 19m 4s. Rate: 7.1 symbols/min [2025-10-02T19:14:39.191977] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:14:39.202710] [DEBUG] [LOCAL ] GPJA: Loaded 4229 existing records from primary storage. [2025-10-02T19:14:39.202942] [INFO ] [MAIN ] GPJA: Loaded 4229 existing records. [2025-10-02T19:14:39.398945] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:14:39.399239] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-02T19:14:39.399340] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-02T19:14:39.399839] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-02T19:14:39.399901] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-02T19:14:39.481324] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-02T19:14:39.835164] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:14:39.847276] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-02T19:14:40.090051] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T19:14:40.108153] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T19:14:40.273011] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-02T19:14:41.072984] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-02T19:14:41.220549] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T19:14:41.873009] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-02T19:14:42.200476] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T19:14:42.673029] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-02T19:14:43.440022] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:14:43.472983] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-02T19:14:43.758523] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T19:14:44.273026] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-02T19:14:44.901018] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:14:44.918843] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T19:14:45.073011] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-02T19:14:45.873003] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-02T19:14:46.073286] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T19:14:46.673004] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-10-02T19:14:47.228809] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-02T19:14:47.473016] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-02T19:14:47.674428] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T19:14:48.273025] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-02T19:14:48.452462] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T19:14:49.077505] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-02T19:14:49.081393] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T19:14:49.873023] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-02T19:14:50.149297] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T19:14:50.150871] [INFO ] [REMOTE ] GOTU: Full fetch complete (59141 records). [2025-10-02T19:14:50.151049] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-02T19:14:50.597561] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-02T19:14:50.597719] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-02T19:14:50.598670] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-02T19:14:50.598782] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-02T19:14:50.600344] [DEBUG] [LOCAL ] GOTU: Trimmed 59141 records to 38626 (keeping 200 days of data) [2025-10-02T19:14:50.689717] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-02T19:14:50.834556] [DEBUG] [LOCAL ] GOTU: Primary data saved (38626 records). [2025-10-02T19:14:50.834747] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-02T19:14:50.834896] [INFO ] [MAIN ] Update Progress: 957/2370 symbols completed. GOTU took 30.7s. Estimated remaining: 3h 19m 0s. Rate: 7.1 symbols/min [2025-10-02T19:14:51.460105] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T19:14:51.461395] [INFO ] [REMOTE ] GPI: Full fetch complete (21138 records). [2025-10-02T19:14:51.461511] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-02T19:14:51.497472] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-02T19:14:51.873383] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-10-02T19:14:51.910370] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-02T19:14:51.910552] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-02T19:14:51.911030] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-02T19:14:51.911112] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-02T19:14:51.912025] [DEBUG] [LOCAL ] GPI: Trimmed 21138 records to 14747 (keeping 200 days of data) [2025-10-02T19:14:52.013742] [DEBUG] [LOCAL ] GPI: Primary data saved (14747 records). [2025-10-02T19:14:52.013885] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-02T19:14:52.013969] [INFO ] [MAIN ] Update Progress: 958/2370 symbols completed. GPI took 25.3s. Estimated remaining: 3h 18m 41s. Rate: 7.1 symbols/min [2025-10-02T19:14:52.156725] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-02T19:14:52.272994] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-02T19:14:53.073005] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-02T19:14:53.804789] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-02T19:14:53.840422] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T19:14:53.872991] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-02T19:14:54.430144] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-02T19:14:54.673019] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-02T19:14:55.472976] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-02T19:14:55.926577] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T19:14:56.272975] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-02T19:14:56.318508] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T19:14:56.858413] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-02T19:14:57.073054] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-02T19:14:57.873021] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-02T19:14:58.384768] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-02T19:14:58.672994] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-02T19:14:58.763909] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T19:14:59.261476] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T19:14:59.473015] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-02T19:15:00.273060] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-02T19:15:01.175354] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T19:15:01.177332] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-02T19:15:01.664031] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T19:15:01.873026] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-02T19:15:02.524466] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-02T19:15:02.525316] [INFO ] [REMOTE ] GPJA: Full fetch complete (7350 records). [2025-10-02T19:15:02.525423] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-02T19:15:02.948073] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-02T19:15:02.948199] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-02T19:15:02.948440] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-02T19:15:02.948511] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-02T19:15:02.949067] [DEBUG] [LOCAL ] GPJA: Trimmed 7350 records to 4260 (keeping 200 days of data) [2025-10-02T19:15:02.978329] [DEBUG] [LOCAL ] GPJA: Primary data saved (4260 records). [2025-10-02T19:15:02.978476] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-02T19:15:02.978562] [INFO ] [MAIN ] Update Progress: 959/2370 symbols completed. GPJA took 24.0s. Estimated remaining: 3h 18m 36s. Rate: 7.1 symbols/min [2025-10-02T19:15:03.327272] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T19:15:03.329244] [INFO ] [REMOTE ] GPC: Full fetch complete (68945 records). [2025-10-02T19:15:03.329373] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-02T19:15:03.769830] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-02T19:15:03.769918] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-02T19:15:03.770876] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-02T19:15:03.770941] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-02T19:15:03.772395] [DEBUG] [LOCAL ] GPC: Trimmed 68945 records to 46702 (keeping 200 days of data) [2025-10-02T19:15:04.088889] [DEBUG] [LOCAL ] GPC: Primary data saved (46702 records). [2025-10-02T19:15:04.089041] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-02T19:15:04.089194] [INFO ] [MAIN ] Update Progress: 960/2370 symbols completed. GPC took 41.6s. Estimated remaining: 3h 18m 17s. Rate: 7.1 symbols/min [2025-10-02T19:15:04.787594] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:04.745536] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:04.898723] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:04.903029] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:04.939547] [DEBUG] [LOCAL ] GPOR: Loaded 23138 existing records from primary storage. [2025-10-02T19:15:04.939976] [INFO ] [MAIN ] GPOR: Loaded 23138 existing records. [2025-10-02T19:15:05.008856] [DEBUG] [LOCAL ] GPMT: Loaded 26086 existing records from primary storage. [2025-10-02T19:15:05.037400] [INFO ] [MAIN ] GPMT: Loaded 26086 existing records. [2025-10-02T19:15:05.364529] [DEBUG] [LOCAL ] GPK: Loaded 52660 existing records from primary storage. [2025-10-02T19:15:05.356584] [DEBUG] [LOCAL ] GPN: Loaded 52049 existing records from primary storage. [2025-10-02T19:15:05.364927] [INFO ] [MAIN ] GPK: Loaded 52660 existing records. [2025-10-02T19:15:05.364431] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:05.370389] [INFO ] [MAIN ] GPN: Loaded 52049 existing records. [2025-10-02T19:15:05.387331] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-02T19:15:05.420633] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-02T19:15:05.567308] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:05.622292] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-02T19:15:05.637922] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-02T19:15:05.678275] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-02T19:15:05.677930] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-02T19:15:05.698357] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-02T19:15:05.729910] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-02T19:15:05.984992] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:06.056469] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-02T19:15:06.049537] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:06.056796] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-02T19:15:06.071548] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-02T19:15:06.108104] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-02T19:15:06.152186] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-02T19:15:06.163195] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-02T19:15:06.178264] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-02T19:15:06.234048] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-02T19:15:07.177713] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:07.234291] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:07.244853] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-10-02T19:15:07.294740] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-10-02T19:15:07.478351] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:07.489284] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-10-02T19:15:07.567800] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:07.568300] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-10-02T19:15:08.691220] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:15:08.709765] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-02T19:15:08.711671] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T19:15:08.719914] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-02T19:15:09.163896] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T19:15:09.174614] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-02T19:15:09.453513] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-10-02T19:15:09.464723] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-02T19:15:09.712073] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-02T19:15:09.721794] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-02T19:15:09.783970] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T19:15:09.873046] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-02T19:15:10.529216] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T19:15:10.644772] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T19:15:10.672959] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-02T19:15:10.736831] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T19:15:10.810309] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T19:15:11.472970] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-02T19:15:11.510525] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T19:15:12.273029] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-02T19:15:12.619691] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:15:13.073048] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-02T19:15:13.641858] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T19:15:13.872997] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-02T19:15:14.422080] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T19:15:14.673015] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-02T19:15:15.243490] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T19:15:15.472998] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-02T19:15:16.273023] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-02T19:15:16.491220] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:15:16.636170] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-02T19:15:17.073018] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-02T19:15:17.873009] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-02T19:15:18.047391] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T19:15:18.160072] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-02T19:15:18.673021] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-02T19:15:19.396260] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T19:15:19.472990] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-02T19:15:19.643594] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T19:15:20.273003] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-02T19:15:20.729020] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-02T19:15:21.073057] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-02T19:15:21.873010] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-02T19:15:21.996016] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T19:15:22.672971] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-02T19:15:22.867250] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T19:15:23.226176] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T19:15:23.472995] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-02T19:15:24.273035] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-02T19:15:24.756945] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-02T19:15:25.073017] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-02T19:15:25.702544] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:15:25.875152] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-02T19:15:25.879488] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-10-02T19:15:26.678524] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-02T19:15:26.694471] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:15:27.472968] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-02T19:15:27.549290] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-02T19:15:28.166927] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T19:15:28.272997] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-02T19:15:28.558438] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T19:15:29.073019] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-02T19:15:29.873033] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-02T19:15:30.028992] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T19:15:30.063867] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T19:15:30.673001] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-02T19:15:30.756104] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T19:15:30.757458] [INFO ] [REMOTE ] GPOR: Full fetch complete (34976 records). [2025-10-02T19:15:30.757598] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-02T19:15:31.174823] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-02T19:15:31.174904] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-02T19:15:31.175565] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-02T19:15:31.175608] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-02T19:15:31.176443] [DEBUG] [LOCAL ] GPOR: Trimmed 34976 records to 23347 (keeping 200 days of data) [2025-10-02T19:15:31.328388] [DEBUG] [LOCAL ] GPOR: Primary data saved (23347 records). [2025-10-02T19:15:31.328550] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-02T19:15:31.328754] [INFO ] [MAIN ] Update Progress: 961/2370 symbols completed. GPOR took 27.2s. Estimated remaining: 3h 18m 36s. Rate: 7.1 symbols/min [2025-10-02T19:15:31.478099] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-02T19:15:31.536163] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:31.575257] [DEBUG] [LOCAL ] GPRK: Loaded 39366 existing records from primary storage. [2025-10-02T19:15:31.575551] [INFO ] [MAIN ] GPRK: Loaded 39366 existing records. [2025-10-02T19:15:31.784337] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:31.784706] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-02T19:15:31.784842] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-02T19:15:31.796827] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-02T19:15:31.797560] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-02T19:15:31.798346] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-02T19:15:32.206348] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:32.272999] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-02T19:15:33.072973] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-02T19:15:33.197089] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-10-02T19:15:33.219927] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T19:15:33.873031] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-02T19:15:34.509662] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T19:15:34.673013] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-02T19:15:35.440572] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-02T19:15:35.441823] [INFO ] [REMOTE ] GPMT: Full fetch complete (37335 records). [2025-10-02T19:15:35.441912] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-02T19:15:35.473691] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-10-02T19:15:35.922731] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-02T19:15:35.949850] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-02T19:15:35.950151] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-02T19:15:35.951258] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-02T19:15:35.951344] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-02T19:15:35.953040] [DEBUG] [LOCAL ] GPMT: Trimmed 37335 records to 26208 (keeping 200 days of data) [2025-10-02T19:15:36.120639] [DEBUG] [LOCAL ] GPMT: Primary data saved (26208 records). [2025-10-02T19:15:36.120808] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-02T19:15:36.120891] [INFO ] [MAIN ] Update Progress: 962/2370 symbols completed. GPMT took 32.0s. Estimated remaining: 3h 18m 23s. Rate: 7.1 symbols/min [2025-10-02T19:15:36.282020] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-02T19:15:36.322448] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:36.351420] [DEBUG] [LOCAL ] GRBK: Loaded 26888 existing records from primary storage. [2025-10-02T19:15:36.351737] [INFO ] [MAIN ] GRBK: Loaded 26888 existing records. [2025-10-02T19:15:36.561105] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:36.561405] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-02T19:15:36.561471] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-02T19:15:36.562230] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-02T19:15:36.562293] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-02T19:15:36.979547] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:37.082092] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-02T19:15:37.087358] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T19:15:37.637399] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T19:15:37.639489] [INFO ] [REMOTE ] GPK: Full fetch complete (75559 records). [2025-10-02T19:15:37.639601] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-02T19:15:37.878189] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-02T19:15:38.082460] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-02T19:15:38.082550] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-02T19:15:38.083561] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-02T19:15:38.083630] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-02T19:15:38.085194] [DEBUG] [LOCAL ] GPK: Trimmed 75559 records to 53044 (keeping 200 days of data) [2025-10-02T19:15:38.423894] [DEBUG] [LOCAL ] GPK: Primary data saved (53044 records). [2025-10-02T19:15:38.424101] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-02T19:15:38.424259] [INFO ] [MAIN ] Update Progress: 963/2370 symbols completed. GPK took 34.3s. Estimated remaining: 3h 18m 5s. Rate: 7.1 symbols/min [2025-10-02T19:15:38.621520] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:38.637873] [DEBUG] [LOCAL ] GRC: Loaded 8958 existing records from primary storage. [2025-10-02T19:15:38.638286] [INFO ] [MAIN ] GRC: Loaded 8958 existing records. [2025-10-02T19:15:38.680634] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-10-02T19:15:38.878840] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:38.879131] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-02T19:15:38.879186] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-02T19:15:38.879556] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-02T19:15:38.879619] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-02T19:15:39.291823] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:39.332857] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-02T19:15:39.475192] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-02T19:15:39.485361] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T19:15:40.042734] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T19:15:40.273000] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-02T19:15:41.073019] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-10-02T19:15:41.117862] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-02T19:15:41.120035] [INFO ] [REMOTE ] GPN: Full fetch complete (74888 records). [2025-10-02T19:15:41.120186] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-02T19:15:41.547943] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-02T19:15:41.548043] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-02T19:15:41.549082] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-02T19:15:41.549153] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-02T19:15:41.550747] [DEBUG] [LOCAL ] GPN: Trimmed 74888 records to 52423 (keeping 200 days of data) [2025-10-02T19:15:41.878310] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-02T19:15:41.890392] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T19:15:41.929110] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T19:15:41.951676] [DEBUG] [LOCAL ] GPN: Primary data saved (52423 records). [2025-10-02T19:15:41.952543] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-02T19:15:41.952742] [INFO ] [MAIN ] Update Progress: 964/2370 symbols completed. GPN took 37.8s. Estimated remaining: 3h 17m 50s. Rate: 7.1 symbols/min [2025-10-02T19:15:42.150227] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:15:42.172060] [DEBUG] [LOCAL ] GRDN: Loaded 20512 existing records from primary storage. [2025-10-02T19:15:42.172327] [INFO ] [MAIN ] GRDN: Loaded 20512 existing records. [2025-10-02T19:15:42.370874] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:15:42.371083] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-02T19:15:42.371133] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-02T19:15:42.371810] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-02T19:15:42.371873] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-02T19:15:42.675535] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-02T19:15:42.761145] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:15:43.153497] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T19:15:43.473049] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-02T19:15:44.246263] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:15:44.272971] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-02T19:15:44.445738] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-02T19:15:45.073005] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-02T19:15:45.812977] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T19:15:45.873020] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-02T19:15:45.971409] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-02T19:15:46.673018] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-10-02T19:15:47.473023] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-02T19:15:47.517000] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T19:15:47.931917] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T19:15:48.105382] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-02T19:15:48.272999] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-02T19:15:48.864245] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T19:15:49.073049] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-02T19:15:49.873013] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-02T19:15:50.441559] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T19:15:50.672996] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-02T19:15:50.689558] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T19:15:51.473035] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-02T19:15:51.887376] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T19:15:52.273008] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-02T19:15:52.658978] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T19:15:53.035102] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T19:15:53.072979] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-02T19:15:53.873029] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-02T19:15:54.244569] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T19:15:54.672983] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-02T19:15:54.955809] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-02T19:15:55.473019] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-02T19:15:55.869576] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T19:15:56.273002] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-02T19:15:56.692237] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T19:15:57.073012] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-02T19:15:57.128915] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-02T19:15:57.873028] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-02T19:15:58.313399] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T19:15:58.547349] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-02T19:15:58.673005] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-02T19:15:59.473019] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-02T19:15:59.485543] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-02T19:16:00.273006] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-02T19:16:01.072998] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-02T19:16:01.436685] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-02T19:16:01.864870] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T19:16:01.873020] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-02T19:16:02.625834] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T19:16:02.673021] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-02T19:16:03.119486] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T19:16:03.472996] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-02T19:16:04.059012] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T19:16:04.061228] [INFO ] [REMOTE ] GPRK: Full fetch complete (57451 records). [2025-10-02T19:16:04.061361] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-02T19:16:04.283345] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-02T19:16:04.495325] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T19:16:04.513010] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-02T19:16:04.513296] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-02T19:16:04.513204] [INFO ] [REMOTE ] GRBK: Full fetch complete (40558 records). [2025-10-02T19:16:04.514306] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-02T19:16:04.514393] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-02T19:16:04.514637] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-02T19:16:04.570107] [DEBUG] [LOCAL ] GPRK: Trimmed 57451 records to 39690 (keeping 200 days of data) [2025-10-02T19:16:05.081812] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-02T19:16:05.196967] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T19:16:05.201494] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-02T19:16:05.202190] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-02T19:16:05.204891] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-02T19:16:05.205253] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-02T19:16:05.213344] [DEBUG] [LOCAL ] GRBK: Trimmed 40558 records to 27074 (keeping 200 days of data) [2025-10-02T19:16:05.327027] [DEBUG] [LOCAL ] GPRK: Primary data saved (39690 records). [2025-10-02T19:16:05.336429] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-02T19:16:05.338726] [INFO ] [MAIN ] Update Progress: 965/2370 symbols completed. GPRK took 34.0s. Estimated remaining: 3h 18m 3s. Rate: 7.1 symbols/min [2025-10-02T19:16:05.577965] [DEBUG] [LOCAL ] GRBK: Primary data saved (27074 records). [2025-10-02T19:16:05.595102] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-02T19:16:05.599517] [INFO ] [MAIN ] Update Progress: 966/2370 symbols completed. GRBK took 29.5s. Estimated remaining: 3h 17m 42s. Rate: 7.1 symbols/min [2025-10-02T19:16:05.599340] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:05.787941] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:05.819615] [DEBUG] [LOCAL ] GRMN: Loaded 41016 existing records from primary storage. [2025-10-02T19:16:05.819994] [INFO ] [MAIN ] GRMN: Loaded 41016 existing records. [2025-10-02T19:16:05.877834] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-02T19:16:06.056844] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:06.073671] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-02T19:16:06.073774] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-02T19:16:06.075116] [DEBUG] [LOCAL ] GRND: Loaded 49918 existing records from primary storage. [2025-10-02T19:16:06.075380] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-02T19:16:06.075460] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-02T19:16:06.080844] [INFO ] [MAIN ] GRND: Loaded 49918 existing records. [2025-10-02T19:16:06.330014] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T19:16:06.607821] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:06.618582] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-02T19:16:06.632379] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-02T19:16:06.647851] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-02T19:16:06.681360] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-02T19:16:06.681493] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-02T19:16:06.726542] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:06.774744] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T19:16:07.147601] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:07.472999] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-10-02T19:16:07.747985] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-02T19:16:08.273003] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-10-02T19:16:09.040152] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T19:16:09.073011] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-02T19:16:09.753926] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T19:16:09.873044] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-02T19:16:10.668486] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T19:16:10.673174] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-02T19:16:10.803376] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T19:16:11.473013] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-02T19:16:12.001827] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T19:16:12.150280] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T19:16:12.273027] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-02T19:16:13.073052] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-02T19:16:13.271463] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T19:16:13.748901] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-02T19:16:13.873017] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-02T19:16:14.673044] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-02T19:16:14.969904] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T19:16:14.972190] [INFO ] [REMOTE ] GRDN: Full fetch complete (26329 records). [2025-10-02T19:16:14.972280] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-02T19:16:15.376303] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-02T19:16:15.376402] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-02T19:16:15.377113] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-02T19:16:15.377218] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-02T19:16:15.378317] [DEBUG] [LOCAL ] GRDN: Trimmed 26329 records to 20716 (keeping 200 days of data) [2025-10-02T19:16:15.482685] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-02T19:16:15.526070] [DEBUG] [LOCAL ] GRDN: Primary data saved (20716 records). [2025-10-02T19:16:15.526210] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-02T19:16:15.526294] [INFO ] [MAIN ] Update Progress: 967/2370 symbols completed. GRDN took 33.6s. Estimated remaining: 3h 17m 36s. Rate: 7.1 symbols/min [2025-10-02T19:16:15.712842] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:15.748112] [DEBUG] [LOCAL ] GRNT: Loaded 33794 existing records from primary storage. [2025-10-02T19:16:15.748425] [INFO ] [MAIN ] GRNT: Loaded 33794 existing records. [2025-10-02T19:16:15.950435] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:15.950663] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-02T19:16:15.950729] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-02T19:16:15.951685] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-02T19:16:15.951747] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-02T19:16:16.275613] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-02T19:16:16.353246] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:16.383895] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T19:16:16.741075] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:16:17.072995] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-10-02T19:16:17.170759] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-02T19:16:17.873017] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-02T19:16:18.375527] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T19:16:18.673036] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-02T19:16:19.467260] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T19:16:19.468568] [INFO ] [REMOTE ] GRC: Full fetch complete (13142 records). [2025-10-02T19:16:19.468719] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-02T19:16:19.481058] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-02T19:16:19.627488] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T19:16:19.919348] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-02T19:16:19.919436] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-02T19:16:19.919887] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-02T19:16:19.919958] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-02T19:16:19.920557] [DEBUG] [LOCAL ] GRC: Trimmed 13142 records to 9062 (keeping 200 days of data) [2025-10-02T19:16:19.978915] [DEBUG] [LOCAL ] GRC: Primary data saved (9062 records). [2025-10-02T19:16:19.979061] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-02T19:16:19.979150] [INFO ] [MAIN ] Update Progress: 968/2370 symbols completed. GRC took 41.6s. Estimated remaining: 3h 17m 22s. Rate: 7.1 symbols/min [2025-10-02T19:16:20.170035] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:20.181093] [DEBUG] [LOCAL ] GROV: Loaded 8902 existing records from primary storage. [2025-10-02T19:16:20.181425] [INFO ] [MAIN ] GROV: Loaded 8902 existing records. [2025-10-02T19:16:20.278880] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-02T19:16:20.379000] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:20.379220] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-02T19:16:20.379269] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-02T19:16:20.379620] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-02T19:16:20.379718] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-02T19:16:20.781827] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:21.072990] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-10-02T19:16:21.341236] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T19:16:21.873031] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-02T19:16:21.920486] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T19:16:22.183784] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T19:16:22.673032] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-02T19:16:23.473012] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-02T19:16:23.597554] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-02T19:16:23.815559] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T19:16:24.154215] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T19:16:24.272986] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-02T19:16:25.073019] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-02T19:16:25.794439] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T19:16:25.827490] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-02T19:16:25.873023] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-02T19:16:26.672995] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-02T19:16:27.351255] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:16:27.472993] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-02T19:16:28.050058] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T19:16:28.217757] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T19:16:28.272996] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-02T19:16:28.757814] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T19:16:29.073007] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-02T19:16:29.873001] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-02T19:16:30.672973] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-02T19:16:30.703864] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T19:16:31.472975] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-02T19:16:31.533075] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T19:16:31.809475] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T19:16:32.273000] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-02T19:16:33.050847] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:16:33.072972] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-02T19:16:33.315537] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T19:16:33.873023] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-02T19:16:34.626159] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T19:16:34.672985] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-02T19:16:34.784900] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T19:16:35.472988] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-02T19:16:35.485860] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T19:16:36.273009] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-02T19:16:36.893630] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T19:16:37.073004] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-02T19:16:37.872996] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-02T19:16:37.937668] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T19:16:38.583992] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T19:16:38.673014] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-02T19:16:39.363395] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T19:16:39.473047] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-02T19:16:40.035849] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-02T19:16:40.272997] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-02T19:16:41.067770] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T19:16:41.078060] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-02T19:16:41.378310] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T19:16:41.873045] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-02T19:16:42.409323] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:16:42.673021] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-02T19:16:43.173131] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-02T19:16:43.282864] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:16:43.284875] [INFO ] [REMOTE ] GRND: Full fetch complete (70921 records). [2025-10-02T19:16:43.284978] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-02T19:16:43.478529] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-02T19:16:43.726421] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-02T19:16:43.726515] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-02T19:16:43.727597] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-02T19:16:43.727691] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-02T19:16:43.729341] [DEBUG] [LOCAL ] GRND: Trimmed 70921 records to 50304 (keeping 200 days of data) [2025-10-02T19:16:44.045334] [DEBUG] [LOCAL ] GRND: Primary data saved (50304 records). [2025-10-02T19:16:44.045484] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-02T19:16:44.045574] [INFO ] [MAIN ] Update Progress: 969/2370 symbols completed. GRND took 38.4s. Estimated remaining: 3h 17m 36s. Rate: 7.1 symbols/min [2025-10-02T19:16:44.240097] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:44.246873] [DEBUG] [LOCAL ] GRX: Loaded 4663 existing records from primary storage. [2025-10-02T19:16:44.247089] [INFO ] [MAIN ] GRX: Loaded 4663 existing records. [2025-10-02T19:16:44.282971] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-02T19:16:44.399615] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-02T19:16:44.478428] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:44.478704] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-02T19:16:44.478771] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-02T19:16:44.479083] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-02T19:16:44.479181] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-02T19:16:44.871864] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:45.072999] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-02T19:16:45.675399] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T19:16:45.873005] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-02T19:16:46.311586] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T19:16:46.313454] [INFO ] [REMOTE ] GRMN: Full fetch complete (59953 records). [2025-10-02T19:16:46.313591] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-02T19:16:46.512101] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-02T19:16:46.540622] [INFO ] [REMOTE ] GROV: Full fetch complete (14355 records). [2025-10-02T19:16:46.589621] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-02T19:16:46.695984] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-02T19:16:46.945292] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-02T19:16:46.960100] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-02T19:16:47.011075] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-02T19:16:47.041495] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-02T19:16:47.104742] [DEBUG] [LOCAL ] GRMN: Trimmed 59953 records to 41310 (keeping 200 days of data) [2025-10-02T19:16:47.232409] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-02T19:16:47.232924] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-02T19:16:47.233145] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-02T19:16:47.267972] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-02T19:16:47.270852] [DEBUG] [LOCAL ] GROV: Trimmed 14355 records to 8931 (keeping 200 days of data) [2025-10-02T19:16:47.350367] [DEBUG] [LOCAL ] GROV: Primary data saved (8931 records). [2025-10-02T19:16:47.351616] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-02T19:16:47.352084] [INFO ] [MAIN ] Update Progress: 970/2370 symbols completed. GROV took 27.4s. Estimated remaining: 3h 17m 20s. Rate: 7.1 symbols/min [2025-10-02T19:16:47.479700] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-10-02T19:16:47.689820] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:47.760308] [DEBUG] [LOCAL ] GS: Loaded 51875 existing records from primary storage. [2025-10-02T19:16:47.761500] [INFO ] [MAIN ] GS: Loaded 51875 existing records. [2025-10-02T19:16:47.950038] [DEBUG] [LOCAL ] GRMN: Primary data saved (41310 records). [2025-10-02T19:16:47.984946] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-02T19:16:47.984523] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:47.985151] [INFO ] [MAIN ] Update Progress: 971/2370 symbols completed. GRMN took 42.6s. Estimated remaining: 3h 17m 0s. Rate: 7.1 symbols/min [2025-10-02T19:16:47.985311] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-02T19:16:47.985436] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-02T19:16:48.047578] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-02T19:16:48.076932] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-02T19:16:48.299399] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:48.306830] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T19:16:48.315241] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-02T19:16:48.360767] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T19:16:48.669833] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:48.671353] [DEBUG] [LOCAL ] GSBD: Loaded 39140 existing records from primary storage. [2025-10-02T19:16:48.672171] [INFO ] [MAIN ] GSBD: Loaded 39140 existing records. [2025-10-02T19:16:48.861063] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:48.861341] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-02T19:16:48.861397] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-02T19:16:48.862618] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-02T19:16:48.862718] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-02T19:16:48.991898] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-02T19:16:49.078269] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-02T19:16:49.276027] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:49.873007] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-02T19:16:50.323782] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T19:16:50.325528] [INFO ] [REMOTE ] GRNT: Full fetch complete (48496 records). [2025-10-02T19:16:50.325627] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-02T19:16:50.449193] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-02T19:16:50.678101] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-02T19:16:50.770440] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-02T19:16:50.770536] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-02T19:16:50.771488] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-02T19:16:50.771559] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-02T19:16:50.772856] [DEBUG] [LOCAL ] GRNT: Trimmed 48496 records to 34012 (keeping 200 days of data) [2025-10-02T19:16:50.990243] [DEBUG] [LOCAL ] GRNT: Primary data saved (34012 records). [2025-10-02T19:16:50.990400] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-02T19:16:50.992353] [INFO ] [MAIN ] Update Progress: 972/2370 symbols completed. GRNT took 35.5s. Estimated remaining: 3h 16m 44s. Rate: 7.1 symbols/min [2025-10-02T19:16:51.183128] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:16:51.239491] [DEBUG] [LOCAL ] GSK: Loaded 53493 existing records from primary storage. [2025-10-02T19:16:51.239920] [INFO ] [MAIN ] GSK: Loaded 53493 existing records. [2025-10-02T19:16:51.362154] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-02T19:16:51.450538] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:16:51.450822] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-02T19:16:51.450874] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-02T19:16:51.452457] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-02T19:16:51.452522] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-02T19:16:51.483317] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-10-02T19:16:51.882288] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:16:52.272997] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-02T19:16:52.871170] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T19:16:53.073039] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-02T19:16:53.549374] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-10-02T19:16:53.713858] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T19:16:53.873001] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-02T19:16:54.673013] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-10-02T19:16:55.473003] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-10-02T19:16:56.151832] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-10-02T19:16:56.272996] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-02T19:16:56.340361] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-10-02T19:16:56.951241] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T19:16:57.073015] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-02T19:16:57.872985] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-02T19:16:58.190708] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-02T19:16:58.255378] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-02T19:16:58.673027] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-02T19:16:58.970633] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T19:16:59.473046] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-02T19:16:59.860060] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T19:16:59.902332] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-02T19:17:00.273056] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-02T19:17:01.073003] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-02T19:17:01.190505] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T19:17:01.873064] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-02T19:17:02.639817] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:17:02.672990] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-02T19:17:03.472998] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-02T19:17:03.648723] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-02T19:17:04.225197] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T19:17:04.256748] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T19:17:04.272946] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-02T19:17:05.073016] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-02T19:17:05.872965] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-02T19:17:05.975913] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T19:17:06.673015] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-02T19:17:07.395725] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-10-02T19:17:07.472994] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-02T19:17:07.834090] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T19:17:08.177698] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:17:08.176703] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T19:17:08.187054] [INFO ] [REMOTE ] GRX: Full fetch complete (6659 records). [2025-10-02T19:17:08.187552] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-02T19:17:08.278134] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-02T19:17:08.573212] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-02T19:17:08.573293] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-02T19:17:08.573489] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-02T19:17:08.573532] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-02T19:17:08.573972] [DEBUG] [LOCAL ] GRX: Trimmed 6659 records to 4740 (keeping 200 days of data) [2025-10-02T19:17:08.602125] [DEBUG] [LOCAL ] GRX: Primary data saved (4740 records). [2025-10-02T19:17:08.602214] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-02T19:17:08.602290] [INFO ] [MAIN ] Update Progress: 973/2370 symbols completed. GRX took 24.6s. Estimated remaining: 3h 16m 49s. Rate: 7.1 symbols/min [2025-10-02T19:17:08.780216] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:17:08.815248] [DEBUG] [LOCAL ] GSL: Loaded 33326 existing records from primary storage. [2025-10-02T19:17:08.815539] [INFO ] [MAIN ] GSL: Loaded 33326 existing records. [2025-10-02T19:17:09.012017] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:17:09.012224] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-02T19:17:09.012272] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-02T19:17:09.013440] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-02T19:17:09.013510] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-02T19:17:09.078105] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-02T19:17:09.430892] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:17:09.873053] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-02T19:17:10.032481] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T19:17:10.673006] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-02T19:17:11.337316] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T19:17:11.442882] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-10-02T19:17:11.472999] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-02T19:17:12.273004] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-02T19:17:12.391628] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T19:17:13.073015] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-02T19:17:13.262294] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-02T19:17:13.873046] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-10-02T19:17:14.404521] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-02T19:17:14.673121] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-02T19:17:14.909686] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-10-02T19:17:15.256529] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:17:15.473033] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-02T19:17:16.272971] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-02T19:17:16.768856] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-02T19:17:16.831426] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T19:17:17.073007] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-02T19:17:17.757540] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T19:17:17.873000] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-02T19:17:18.673024] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-02T19:17:19.265922] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-02T19:17:19.377506] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T19:17:19.472999] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-02T19:17:20.273010] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-02T19:17:20.719493] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-02T19:17:20.914055] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T19:17:20.916034] [INFO ] [REMOTE ] GSBD: Full fetch complete (58474 records). [2025-10-02T19:17:20.916163] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-02T19:17:21.078253] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-02T19:17:21.371471] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-02T19:17:21.371562] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-02T19:17:21.372516] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-02T19:17:21.372587] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-02T19:17:21.373984] [DEBUG] [LOCAL ] GSBD: Trimmed 58474 records to 39460 (keeping 200 days of data) [2025-10-02T19:17:21.632627] [DEBUG] [LOCAL ] GSBD: Primary data saved (39460 records). [2025-10-02T19:17:21.632883] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-02T19:17:21.633015] [INFO ] [MAIN ] Update Progress: 974/2370 symbols completed. GSBD took 33.6s. Estimated remaining: 3h 16m 47s. Rate: 7.1 symbols/min [2025-10-02T19:17:21.820932] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:17:21.872976] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-02T19:17:21.904583] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T19:17:21.916406] [DEBUG] [LOCAL ] GTES: Loaded 50520 existing records from primary storage. [2025-10-02T19:17:21.918029] [INFO ] [MAIN ] GTES: Loaded 50520 existing records. [2025-10-02T19:17:22.121714] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:17:22.121923] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-02T19:17:22.121972] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-02T19:17:22.123417] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-02T19:17:22.123480] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-02T19:17:22.547308] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:17:22.672970] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-02T19:17:22.946484] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-02T19:17:23.022595] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T19:17:23.473007] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-02T19:17:24.272992] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-02T19:17:24.427857] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T19:17:24.986178] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T19:17:25.072991] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-02T19:17:25.872990] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-10-02T19:17:26.182495] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T19:17:26.672997] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-02T19:17:26.805322] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-02T19:17:26.807323] [INFO ] [REMOTE ] GS: Full fetch complete (75689 records). [2025-10-02T19:17:26.807433] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-02T19:17:27.248007] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-02T19:17:27.248358] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-02T19:17:27.249991] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-02T19:17:27.250105] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-02T19:17:27.251849] [DEBUG] [LOCAL ] GS: Trimmed 75689 records to 52244 (keeping 200 days of data) [2025-10-02T19:17:27.486344] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-02T19:17:27.531816] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T19:17:27.653452] [DEBUG] [LOCAL ] GS: Primary data saved (52244 records). [2025-10-02T19:17:27.653619] [INFO ] [MAIN ] GS: Full history saved. [2025-10-02T19:17:27.653763] [INFO ] [MAIN ] Update Progress: 975/2370 symbols completed. GS took 40.3s. Estimated remaining: 3h 16m 35s. Rate: 7.1 symbols/min [2025-10-02T19:17:27.860151] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:17:27.906613] [DEBUG] [LOCAL ] GTLS: Loaded 42788 existing records from primary storage. [2025-10-02T19:17:27.906992] [INFO ] [MAIN ] GTLS: Loaded 42788 existing records. [2025-10-02T19:17:28.124544] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:17:28.125022] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-02T19:17:28.125097] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-02T19:17:28.133594] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-02T19:17:28.147541] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-02T19:17:28.155005] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T19:17:28.278968] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-02T19:17:28.579103] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:17:29.072992] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-02T19:17:29.166438] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-02T19:17:29.168736] [INFO ] [REMOTE ] GSK: Full fetch complete (77471 records). [2025-10-02T19:17:29.168921] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-02T19:17:29.637029] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-02T19:17:29.637263] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-02T19:17:29.638587] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-02T19:17:29.638757] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-02T19:17:29.640507] [DEBUG] [LOCAL ] GSK: Trimmed 77471 records to 53882 (keeping 200 days of data) [2025-10-02T19:17:29.880898] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-10-02T19:17:30.037288] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T19:17:30.054514] [DEBUG] [LOCAL ] GSK: Primary data saved (53882 records). [2025-10-02T19:17:30.055257] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-02T19:17:30.057818] [INFO ] [MAIN ] Update Progress: 976/2370 symbols completed. GSK took 39.1s. Estimated remaining: 3h 16m 18s. Rate: 7.1 symbols/min [2025-10-02T19:17:30.263232] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:17:30.308592] [DEBUG] [LOCAL ] GTN: Loaded 45476 existing records from primary storage. [2025-10-02T19:17:30.308919] [INFO ] [MAIN ] GTN: Loaded 45476 existing records. [2025-10-02T19:17:30.516460] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:17:30.516740] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-02T19:17:30.516809] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-02T19:17:30.528344] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-02T19:17:30.546427] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-02T19:17:30.622078] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T19:17:30.674434] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-02T19:17:30.979907] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:17:31.441413] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T19:17:31.472959] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-02T19:17:32.279820] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-10-02T19:17:32.306811] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T19:17:33.029067] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T19:17:33.072980] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-02T19:17:33.724945] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:17:33.873008] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-02T19:17:34.496969] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T19:17:34.673037] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-02T19:17:35.472967] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-02T19:17:35.567316] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T19:17:35.996676] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-02T19:17:36.273011] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-02T19:17:37.041498] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T19:17:37.072969] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-02T19:17:37.705690] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T19:17:37.873044] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-02T19:17:38.619015] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T19:17:38.672998] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-02T19:17:38.778337] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-02T19:17:39.473006] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-02T19:17:40.051146] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T19:17:40.272999] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-02T19:17:40.557234] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T19:17:41.073008] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-02T19:17:41.873008] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-02T19:17:41.915325] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T19:17:41.917141] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T19:17:41.930176] [INFO ] [REMOTE ] GSL: Full fetch complete (47911 records). [2025-10-02T19:17:41.930550] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-02T19:17:42.363548] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-02T19:17:42.363632] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-02T19:17:42.364420] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-02T19:17:42.364474] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-02T19:17:42.365598] [DEBUG] [LOCAL ] GSL: Trimmed 47911 records to 33513 (keeping 200 days of data) [2025-10-02T19:17:42.585362] [DEBUG] [LOCAL ] GSL: Primary data saved (33513 records). [2025-10-02T19:17:42.585534] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-02T19:17:42.585627] [INFO ] [MAIN ] Update Progress: 977/2370 symbols completed. GSL took 34.0s. Estimated remaining: 3h 16m 15s. Rate: 7.1 symbols/min [2025-10-02T19:17:42.678216] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-02T19:17:42.776800] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:17:42.818983] [DEBUG] [LOCAL ] GTY: Loaded 30286 existing records from primary storage. [2025-10-02T19:17:42.819331] [INFO ] [MAIN ] GTY: Loaded 30286 existing records. [2025-10-02T19:17:43.021460] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:17:43.022044] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-02T19:17:43.022197] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-02T19:17:43.023252] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-02T19:17:43.023332] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-02T19:17:43.414816] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:17:43.444266] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:17:43.472989] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-02T19:17:44.273010] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-10-02T19:17:44.495896] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:17:44.764955] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T19:17:45.073013] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-02T19:17:45.382032] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T19:17:45.873060] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-02T19:17:46.673009] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-02T19:17:46.770117] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T19:17:47.472989] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-02T19:17:47.533756] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T19:17:47.612259] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T19:17:48.273044] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-02T19:17:48.779188] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-02T19:17:49.073022] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-02T19:17:49.873009] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-02T19:17:49.921924] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-02T19:17:50.672977] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-02T19:17:50.729116] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T19:17:50.794947] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T19:17:51.473070] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-02T19:17:52.219846] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T19:17:52.272978] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-02T19:17:52.897052] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T19:17:53.073001] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-02T19:17:53.872981] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-02T19:17:53.940896] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T19:17:54.404168] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T19:17:54.673005] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-02T19:17:55.451426] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T19:17:55.472967] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-02T19:17:56.272992] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-02T19:17:56.374535] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T19:17:56.972970] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T19:17:57.073029] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-02T19:17:57.743223] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-02T19:17:57.873017] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-02T19:17:58.672976] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-02T19:17:58.728028] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T19:17:59.322898] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T19:17:59.324873] [INFO ] [REMOTE ] GTES: Full fetch complete (73892 records). [2025-10-02T19:17:59.325011] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-02T19:17:59.483180] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-02T19:17:59.774588] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-02T19:17:59.774715] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-02T19:17:59.775725] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-02T19:17:59.775796] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-02T19:17:59.777467] [DEBUG] [LOCAL ] GTES: Trimmed 73892 records to 50882 (keeping 200 days of data) [2025-10-02T19:18:00.106469] [DEBUG] [LOCAL ] GTES: Primary data saved (50882 records). [2025-10-02T19:18:00.106622] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-02T19:18:00.106780] [INFO ] [MAIN ] Update Progress: 978/2370 symbols completed. GTES took 38.5s. Estimated remaining: 3h 16m 20s. Rate: 7.1 symbols/min [2025-10-02T19:18:00.275755] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-02T19:18:00.313433] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:00.313803] [DEBUG] [LOCAL ] GUG: No existing data file found in primary storage. [2025-10-02T19:18:00.313919] [WARN ] [MAIN ] GUG: No existing data found, performing full refresh instead. [2025-10-02T19:18:00.314172] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-02T19:18:00.314235] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-02T19:18:00.314304] [DEBUG] [LOCAL ] GUG: No primary data file found to delete. [2025-10-02T19:18:00.314340] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-02T19:18:00.519169] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T19:18:00.767522] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:01.072995] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-02T19:18:01.388764] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-10-02T19:18:01.872976] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-10-02T19:18:01.950014] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-02T19:18:02.274377] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T19:18:02.433477] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-10-02T19:18:02.673018] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-02T19:18:03.472992] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-02T19:18:03.734064] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T19:18:04.273046] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-02T19:18:04.636264] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T19:18:05.073016] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-02T19:18:05.644682] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T19:18:05.646561] [INFO ] [REMOTE ] GTN: Full fetch complete (66415 records). [2025-10-02T19:18:05.646709] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-02T19:18:05.878145] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-02T19:18:06.095048] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-02T19:18:06.095141] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-02T19:18:06.096185] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-02T19:18:06.096254] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-02T19:18:06.097699] [DEBUG] [LOCAL ] GTN: Trimmed 66415 records to 45825 (keeping 200 days of data) [2025-10-02T19:18:06.386810] [DEBUG] [LOCAL ] GTN: Primary data saved (45825 records). [2025-10-02T19:18:06.386992] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-02T19:18:06.387632] [INFO ] [MAIN ] Update Progress: 979/2370 symbols completed. GTN took 36.3s. Estimated remaining: 3h 16m 8s. Rate: 7.1 symbols/min [2025-10-02T19:18:06.575217] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:06.594784] [DEBUG] [LOCAL ] GUT: Loaded 15316 existing records from primary storage. [2025-10-02T19:18:06.595041] [INFO ] [MAIN ] GUT: Loaded 15316 existing records. [2025-10-02T19:18:06.678064] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-02T19:18:06.798735] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:18:06.798967] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-02T19:18:06.799026] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-02T19:18:06.799631] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-02T19:18:06.799724] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-02T19:18:07.190359] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:07.296494] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-02T19:18:07.473003] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-02T19:18:07.571351] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-02T19:18:08.273007] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-10-02T19:18:08.858512] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T19:18:09.072966] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-02T19:18:09.217741] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (4.14 seconds). [2025-10-02T19:18:09.219261] [INFO ] [REMOTE ] GTLS: Full fetch complete (61089 records). [2025-10-02T19:18:09.219356] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-02T19:18:09.220105] [FATAL] [VALIDATOR ] GTLS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:18:09.220199] [FATAL] [MAIN ] GTLS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:18:09.220244] [WARN ] [MAIN ] GTLS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:18:09.220311] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-02T19:18:09.220394] [DEBUG] [LOCAL ] GTLS: No primary data file found to delete. [2025-10-02T19:18:09.220451] [INFO ] [LOCAL ] GTLS: Starting deletion of derivative data. [2025-10-02T19:18:09.220888] [DEBUG] [LOCAL ] GTLS: Deleted derivative data file. [2025-10-02T19:18:09.220987] [INFO ] [MAIN ] Update Progress: 980/2370 symbols completed. GTLS took 41.6s. Estimated remaining: 3h 15m 52s. Rate: 7.1 symbols/min [2025-10-02T19:18:09.422281] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:09.423520] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T19:18:09.470998] [DEBUG] [LOCAL ] GVA: Loaded 33140 existing records from primary storage. [2025-10-02T19:18:09.471282] [INFO ] [MAIN ] GVA: Loaded 33140 existing records. [2025-10-02T19:18:09.660138] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:18:09.660391] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-02T19:18:09.660447] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-02T19:18:09.661511] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-02T19:18:09.661583] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-02T19:18:09.878217] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-02T19:18:10.063385] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:10.388277] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T19:18:10.587463] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-02T19:18:10.673034] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-02T19:18:11.472999] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-02T19:18:11.495878] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T19:18:12.237826] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T19:18:12.272991] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-02T19:18:13.073031] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-02T19:18:13.188310] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-02T19:18:13.872966] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-02T19:18:13.957101] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T19:18:14.588605] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T19:18:14.673020] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-02T19:18:15.468299] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T19:18:15.472946] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-02T19:18:16.272988] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-02T19:18:16.353821] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-02T19:18:17.073035] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-10-02T19:18:17.167537] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-02T19:18:17.872968] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-02T19:18:18.199785] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-10-02T19:18:18.673024] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-02T19:18:18.948386] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T19:18:18.950216] [INFO ] [REMOTE ] GTY: Full fetch complete (43506 records). [2025-10-02T19:18:18.950317] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-02T19:18:19.367573] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-02T19:18:19.367686] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-02T19:18:19.368424] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-02T19:18:19.368490] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-02T19:18:19.369763] [DEBUG] [LOCAL ] GTY: Trimmed 43506 records to 30501 (keeping 200 days of data) [2025-10-02T19:18:19.480702] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-02T19:18:19.578965] [DEBUG] [LOCAL ] GTY: Primary data saved (30501 records). [2025-10-02T19:18:19.579118] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-02T19:18:19.579236] [INFO ] [MAIN ] Update Progress: 981/2370 symbols completed. GTY took 37.0s. Estimated remaining: 3h 15m 46s. Rate: 7.1 symbols/min [2025-10-02T19:18:19.731143] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T19:18:19.789079] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:19.808442] [DEBUG] [LOCAL ] GWH: Loaded 16083 existing records from primary storage. [2025-10-02T19:18:19.808828] [INFO ] [MAIN ] GWH: Loaded 16083 existing records. [2025-10-02T19:18:19.998845] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:18:19.999097] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-02T19:18:19.999145] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-02T19:18:19.999857] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-02T19:18:19.999918] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-02T19:18:20.277323] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-02T19:18:20.406785] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:20.418028] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T19:18:21.073034] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-02T19:18:21.287134] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-02T19:18:21.872995] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-10-02T19:18:22.034179] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-02T19:18:22.504312] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-10-02T19:18:22.672990] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-02T19:18:23.284242] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T19:18:23.473049] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-02T19:18:24.273004] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-02T19:18:24.758503] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-02T19:18:24.977130] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-02T19:18:25.072993] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-02T19:18:25.872992] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-02T19:18:26.672983] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-02T19:18:26.708756] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:18:26.855790] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T19:18:27.457015] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-02T19:18:27.472977] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-02T19:18:28.273018] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-02T19:18:28.287027] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T19:18:28.966173] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T19:18:28.967217] [INFO ] [REMOTE ] GUG: Full fetch complete (19848 records). [2025-10-02T19:18:28.967301] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-02T19:18:29.078074] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-02T19:18:29.376168] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-02T19:18:29.376284] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-02T19:18:29.376802] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-02T19:18:29.376869] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-02T19:18:29.377437] [DEBUG] [LOCAL ] GUG: Trimmed 19848 records to 12171 (keeping 200 days of data) [2025-10-02T19:18:29.455105] [DEBUG] [LOCAL ] GUG: Primary data saved (12171 records). [2025-10-02T19:18:29.455249] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-02T19:18:29.455340] [INFO ] [MAIN ] Update Progress: 982/2370 symbols completed. GUG took 29.3s. Estimated remaining: 3h 15m 40s. Rate: 7.1 symbols/min [2025-10-02T19:18:29.639274] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:29.639446] [DEBUG] [LOCAL ] GWRE: No existing data file found in primary storage. [2025-10-02T19:18:29.639487] [WARN ] [MAIN ] GWRE: No existing data found, performing full refresh instead. [2025-10-02T19:18:29.639603] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-02T19:18:29.639669] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-02T19:18:29.639738] [DEBUG] [LOCAL ] GWRE: No primary data file found to delete. [2025-10-02T19:18:29.639775] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-02T19:18:29.879564] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-02T19:18:29.909966] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T19:18:30.059204] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:30.673050] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-02T19:18:31.463125] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T19:18:31.472947] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-02T19:18:31.517092] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T19:18:32.273004] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-02T19:18:32.837661] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-02T19:18:32.838826] [INFO ] [REMOTE ] GUT: Full fetch complete (22725 records). [2025-10-02T19:18:32.838925] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-02T19:18:33.057702] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T19:18:33.081916] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-10-02T19:18:33.347943] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-02T19:18:33.348078] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-02T19:18:33.348611] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-02T19:18:33.348699] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-02T19:18:33.349515] [DEBUG] [LOCAL ] GUT: Trimmed 22725 records to 15401 (keeping 200 days of data) [2025-10-02T19:18:33.441937] [DEBUG] [LOCAL ] GUT: Primary data saved (15401 records). [2025-10-02T19:18:33.442086] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-02T19:18:33.442169] [INFO ] [MAIN ] Update Progress: 983/2370 symbols completed. GUT took 27.1s. Estimated remaining: 3h 15m 25s. Rate: 7.1 symbols/min [2025-10-02T19:18:33.629754] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:33.651350] [DEBUG] [LOCAL ] GWW: Loaded 19477 existing records from primary storage. [2025-10-02T19:18:33.651624] [INFO ] [MAIN ] GWW: Loaded 19477 existing records. [2025-10-02T19:18:33.845096] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:18:33.845315] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-02T19:18:33.845371] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-02T19:18:33.846352] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-02T19:18:33.846417] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-02T19:18:33.881169] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-02T19:18:34.234758] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:34.506618] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T19:18:34.673011] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-10-02T19:18:35.328504] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T19:18:35.472987] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-02T19:18:35.703252] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-10-02T19:18:36.273048] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-02T19:18:36.520606] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T19:18:37.072975] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-02T19:18:37.442453] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T19:18:37.840928] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-02T19:18:37.872999] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-02T19:18:38.673035] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-02T19:18:39.002757] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T19:18:39.473019] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-02T19:18:40.083256] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-02T19:18:40.273065] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-02T19:18:40.870693] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T19:18:41.073009] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-02T19:18:41.381291] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T19:18:41.873043] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-02T19:18:42.660494] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T19:18:42.672952] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-02T19:18:43.323720] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T19:18:43.473036] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-02T19:18:44.272973] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-02T19:18:44.480566] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T19:18:44.530180] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-02T19:18:45.072977] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-02T19:18:45.256207] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T19:18:45.873044] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-02T19:18:46.677041] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-02T19:18:46.683249] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T19:18:47.107724] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T19:18:47.376140] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-02T19:18:47.473011] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-02T19:18:48.273045] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-02T19:18:48.972495] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:18:49.072978] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-02T19:18:49.134782] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:18:49.135930] [INFO ] [REMOTE ] GWH: Full fetch complete (21261 records). [2025-10-02T19:18:49.136006] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-02T19:18:49.533393] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-02T19:18:49.533471] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-02T19:18:49.534027] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-02T19:18:49.534091] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-02T19:18:49.534723] [DEBUG] [LOCAL ] GWH: Trimmed 21261 records to 16198 (keeping 200 days of data) [2025-10-02T19:18:49.627768] [DEBUG] [LOCAL ] GWH: Primary data saved (16198 records). [2025-10-02T19:18:49.627911] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-02T19:18:49.628013] [INFO ] [MAIN ] Update Progress: 984/2370 symbols completed. GWH took 30.0s. Estimated remaining: 3h 15m 27s. Rate: 7.1 symbols/min [2025-10-02T19:18:49.816584] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:49.816830] [DEBUG] [LOCAL ] GXO: No existing data file found in primary storage. [2025-10-02T19:18:49.816882] [WARN ] [MAIN ] GXO: No existing data found, performing full refresh instead. [2025-10-02T19:18:49.817023] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-02T19:18:49.817097] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-02T19:18:49.817166] [DEBUG] [LOCAL ] GXO: No primary data file found to delete. [2025-10-02T19:18:49.817213] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-02T19:18:49.877762] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-02T19:18:50.249933] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:50.264908] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-02T19:18:50.673040] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-02T19:18:50.943356] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T19:18:50.945107] [INFO ] [REMOTE ] GVA: Full fetch complete (48584 records). [2025-10-02T19:18:50.945248] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-02T19:18:51.362218] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-02T19:18:51.362300] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-02T19:18:51.363155] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-02T19:18:51.363222] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-02T19:18:51.364277] [DEBUG] [LOCAL ] GVA: Trimmed 48584 records to 33350 (keeping 200 days of data) [2025-10-02T19:18:51.475066] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-02T19:18:51.590079] [DEBUG] [LOCAL ] GVA: Primary data saved (33350 records). [2025-10-02T19:18:51.590214] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-02T19:18:51.590302] [INFO ] [MAIN ] Update Progress: 985/2370 symbols completed. GVA took 42.4s. Estimated remaining: 3h 15m 10s. Rate: 7.1 symbols/min [2025-10-02T19:18:51.773020] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:18:51.773195] [DEBUG] [LOCAL ] GYLD: No existing data file found in primary storage. [2025-10-02T19:18:51.773234] [WARN ] [MAIN ] GYLD: No existing data found, performing full refresh instead. [2025-10-02T19:18:51.773353] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-02T19:18:51.773396] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-02T19:18:51.773438] [DEBUG] [LOCAL ] GYLD: No primary data file found to delete. [2025-10-02T19:18:51.773473] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-02T19:18:52.194710] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:18:52.228327] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T19:18:52.272973] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-02T19:18:52.711619] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T19:18:53.073025] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-10-02T19:18:53.593131] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T19:18:53.612011] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-10-02T19:18:53.873035] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-02T19:18:54.673047] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-02T19:18:55.160556] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T19:18:55.336597] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-02T19:18:55.473005] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-02T19:18:55.811778] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-02T19:18:56.273004] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-02T19:18:57.073027] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-02T19:18:57.767794] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T19:18:57.872980] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-02T19:18:58.064813] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T19:18:58.673025] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-02T19:18:59.473027] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-02T19:18:59.768387] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T19:18:59.821602] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-02T19:19:00.273048] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-02T19:19:00.770807] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-02T19:19:00.984282] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (3.11 seconds). [2025-10-02T19:19:00.985736] [INFO ] [REMOTE ] GWRE: Full fetch complete (60782 records). [2025-10-02T19:19:00.985837] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-02T19:19:00.986435] [FATAL] [VALIDATOR ] GWRE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:00.986524] [FATAL] [MAIN ] GWRE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:00.986569] [WARN ] [MAIN ] GWRE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:00.986636] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-02T19:19:00.986741] [DEBUG] [LOCAL ] GWRE: No primary data file found to delete. [2025-10-02T19:19:00.986782] [INFO ] [LOCAL ] GWRE: Starting deletion of derivative data. [2025-10-02T19:19:00.986824] [DEBUG] [LOCAL ] GWRE: No derivative data file found to delete. [2025-10-02T19:19:00.986881] [INFO ] [MAIN ] Update Progress: 986/2370 symbols completed. GWRE took 31.5s. Estimated remaining: 3h 15m 2s. Rate: 7.1 symbols/min [2025-10-02T19:19:01.078211] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-02T19:19:01.211037] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:01.211238] [DEBUG] [LOCAL ] H: No existing data file found in primary storage. [2025-10-02T19:19:01.211279] [WARN ] [MAIN ] H: No existing data found, performing full refresh instead. [2025-10-02T19:19:01.211425] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-02T19:19:01.211469] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-02T19:19:01.211512] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-10-02T19:19:01.211546] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-02T19:19:01.608901] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:01.873048] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-02T19:19:02.318761] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T19:19:02.327432] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-02T19:19:02.672990] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-02T19:19:03.027408] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-02T19:19:03.473008] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-02T19:19:03.924071] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T19:19:04.273055] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-10-02T19:19:05.073015] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-02T19:19:05.461503] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-10-02T19:19:05.872972] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-10-02T19:19:06.177914] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T19:19:06.673036] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-02T19:19:07.473045] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-02T19:19:07.518917] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T19:19:07.947245] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-02T19:19:08.113636] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:19:08.273014] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-02T19:19:08.635840] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-02T19:19:09.073023] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-02T19:19:09.873024] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-02T19:19:10.673001] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-02T19:19:11.420457] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T19:19:11.473062] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-02T19:19:11.772527] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (2.70 seconds). [2025-10-02T19:19:11.773743] [INFO ] [REMOTE ] GWW: Full fetch complete (29153 records). [2025-10-02T19:19:11.773836] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-02T19:19:11.774418] [FATAL] [VALIDATOR ] GWW: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:11.774509] [FATAL] [MAIN ] GWW: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:11.774589] [WARN ] [MAIN ] GWW: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:11.774668] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-02T19:19:11.774769] [DEBUG] [LOCAL ] GWW: No primary data file found to delete. [2025-10-02T19:19:11.774828] [INFO ] [LOCAL ] GWW: Starting deletion of derivative data. [2025-10-02T19:19:11.775419] [DEBUG] [LOCAL ] GWW: Deleted derivative data file. [2025-10-02T19:19:11.775518] [INFO ] [MAIN ] Update Progress: 987/2370 symbols completed. GWW took 38.3s. Estimated remaining: 3h 14m 57s. Rate: 7.1 symbols/min [2025-10-02T19:19:11.972043] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-02T19:19:11.976678] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:11.978596] [DEBUG] [LOCAL ] HAE: No existing data file found in primary storage. [2025-10-02T19:19:11.978767] [WARN ] [MAIN ] HAE: No existing data found, performing full refresh instead. [2025-10-02T19:19:11.979004] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-02T19:19:11.979132] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-02T19:19:11.979212] [DEBUG] [LOCAL ] HAE: No primary data file found to delete. [2025-10-02T19:19:11.979365] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-02T19:19:12.191375] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:19:12.278080] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-02T19:19:12.440789] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:13.073061] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-02T19:19:13.873033] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-02T19:19:14.673018] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-10-02T19:19:14.747322] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T19:19:15.174698] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T19:19:15.472999] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-02T19:19:15.707465] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (3.43 seconds). [2025-10-02T19:19:15.708401] [INFO ] [REMOTE ] GYLD: Full fetch complete (2068 records). [2025-10-02T19:19:15.708474] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-02T19:19:15.708921] [FATAL] [VALIDATOR ] GYLD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:15.709010] [FATAL] [MAIN ] GYLD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:15.709053] [WARN ] [MAIN ] GYLD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:15.709121] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-02T19:19:15.709193] [DEBUG] [LOCAL ] GYLD: No primary data file found to delete. [2025-10-02T19:19:15.709231] [INFO ] [LOCAL ] GYLD: Starting deletion of derivative data. [2025-10-02T19:19:15.709270] [DEBUG] [LOCAL ] GYLD: No derivative data file found to delete. [2025-10-02T19:19:15.709329] [INFO ] [MAIN ] Update Progress: 988/2370 symbols completed. GYLD took 24.1s. Estimated remaining: 3h 14m 43s. Rate: 7.1 symbols/min [2025-10-02T19:19:15.880720] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:15.881194] [DEBUG] [LOCAL ] HAFN: No existing data file found in primary storage. [2025-10-02T19:19:15.881327] [WARN ] [MAIN ] HAFN: No existing data found, performing full refresh instead. [2025-10-02T19:19:15.881468] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-02T19:19:15.881512] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-02T19:19:15.881556] [DEBUG] [LOCAL ] HAFN: No primary data file found to delete. [2025-10-02T19:19:15.881590] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-02T19:19:16.260667] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-10-02T19:19:16.286940] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:16.279841] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-02T19:19:17.042951] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T19:19:17.073071] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-02T19:19:17.873029] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-02T19:19:17.976279] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T19:19:18.481825] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T19:19:18.673016] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-02T19:19:19.351075] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T19:19:19.473053] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-10-02T19:19:19.854523] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T19:19:20.273072] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-02T19:19:21.073006] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-02T19:19:21.300264] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T19:19:21.873033] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-02T19:19:21.972503] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T19:19:22.637167] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:19:22.672950] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-02T19:19:23.473084] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-02T19:19:23.769530] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-02T19:19:24.128729] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-02T19:19:24.273008] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-02T19:19:24.974940] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:19:25.073039] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-02T19:19:25.873014] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-02T19:19:26.503587] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-10-02T19:19:26.673217] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-02T19:19:26.673300] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-02T19:19:26.907677] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-02T19:19:27.473009] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-02T19:19:28.273064] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-02T19:19:28.394254] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T19:19:28.856501] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T19:19:29.073050] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-02T19:19:29.609804] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T19:19:29.873029] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-02T19:19:30.678182] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-02T19:19:30.693130] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T19:19:31.276272] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T19:19:31.473017] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-02T19:19:32.131921] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T19:19:32.273024] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-02T19:19:32.800452] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T19:19:33.073037] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-02T19:19:33.651930] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T19:19:33.872994] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-02T19:19:34.283257] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-02T19:19:34.673020] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-02T19:19:35.084557] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T19:19:35.473032] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-02T19:19:36.273003] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-02T19:19:36.648452] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T19:19:37.072999] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-02T19:19:37.648964] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T19:19:37.809902] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (3.14 seconds). [2025-10-02T19:19:37.812058] [INFO ] [REMOTE ] H: Full fetch complete (61869 records). [2025-10-02T19:19:37.812209] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-02T19:19:37.813220] [FATAL] [VALIDATOR ] H: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:37.813343] [FATAL] [MAIN ] H: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:37.813400] [WARN ] [MAIN ] H: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:37.813483] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-02T19:19:37.813623] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-10-02T19:19:37.813728] [INFO ] [LOCAL ] H: Starting deletion of derivative data. [2025-10-02T19:19:37.813805] [DEBUG] [LOCAL ] H: No derivative data file found to delete. [2025-10-02T19:19:37.813899] [INFO ] [MAIN ] Update Progress: 989/2370 symbols completed. H took 36.8s. Estimated remaining: 3h 14m 53s. Rate: 7.1 symbols/min [2025-10-02T19:19:37.878173] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-02T19:19:38.027446] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:38.027664] [DEBUG] [LOCAL ] HAL: No existing data file found in primary storage. [2025-10-02T19:19:38.027724] [WARN ] [MAIN ] HAL: No existing data found, performing full refresh instead. [2025-10-02T19:19:38.027839] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-02T19:19:38.027883] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-02T19:19:38.027925] [DEBUG] [LOCAL ] HAL: No primary data file found to delete. [2025-10-02T19:19:38.027969] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-02T19:19:38.429438] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:38.460743] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T19:19:38.673037] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-02T19:19:39.123108] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T19:19:39.472985] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-02T19:19:40.273047] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-02T19:19:41.073050] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-10-02T19:19:41.452744] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T19:19:41.838868] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (3.17 seconds). [2025-10-02T19:19:41.840267] [INFO ] [REMOTE ] HAE: Full fetch complete (57935 records). [2025-10-02T19:19:41.840381] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-02T19:19:41.841246] [FATAL] [VALIDATOR ] HAE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:41.841337] [FATAL] [MAIN ] HAE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:41.841409] [WARN ] [MAIN ] HAE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:41.841485] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-02T19:19:41.841560] [DEBUG] [LOCAL ] HAE: No primary data file found to delete. [2025-10-02T19:19:41.841607] [INFO ] [LOCAL ] HAE: Starting deletion of derivative data. [2025-10-02T19:19:41.841697] [DEBUG] [LOCAL ] HAE: No derivative data file found to delete. [2025-10-02T19:19:41.841793] [INFO ] [MAIN ] Update Progress: 990/2370 symbols completed. HAE took 30.1s. Estimated remaining: 3h 14m 38s. Rate: 7.1 symbols/min [2025-10-02T19:19:41.878069] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-02T19:19:42.033829] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:42.033991] [DEBUG] [LOCAL ] HASI: No existing data file found in primary storage. [2025-10-02T19:19:42.034031] [WARN ] [MAIN ] HASI: No existing data found, performing full refresh instead. [2025-10-02T19:19:42.034144] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-02T19:19:42.034188] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-02T19:19:42.034231] [DEBUG] [LOCAL ] HASI: No primary data file found to delete. [2025-10-02T19:19:42.034265] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-02T19:19:42.420111] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:42.571432] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (3.10 seconds). [2025-10-02T19:19:42.574957] [INFO ] [REMOTE ] GXO: Full fetch complete (69638 records). [2025-10-02T19:19:42.575073] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-02T19:19:42.575895] [FATAL] [VALIDATOR ] GXO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:42.575983] [FATAL] [MAIN ] GXO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:42.576031] [WARN ] [MAIN ] GXO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:42.576122] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-02T19:19:42.576186] [DEBUG] [LOCAL ] GXO: No primary data file found to delete. [2025-10-02T19:19:42.576223] [INFO ] [LOCAL ] GXO: Starting deletion of derivative data. [2025-10-02T19:19:42.576263] [DEBUG] [LOCAL ] GXO: No derivative data file found to delete. [2025-10-02T19:19:42.576320] [INFO ] [MAIN ] Update Progress: 991/2370 symbols completed. GXO took 52.9s. Estimated remaining: 3h 14m 19s. Rate: 7.1 symbols/min [2025-10-02T19:19:42.679789] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-10-02T19:19:42.762798] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:42.763020] [DEBUG] [LOCAL ] HAYW: No existing data file found in primary storage. [2025-10-02T19:19:42.763066] [WARN ] [MAIN ] HAYW: No existing data found, performing full refresh instead. [2025-10-02T19:19:42.763174] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-02T19:19:42.763216] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-02T19:19:42.763257] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-10-02T19:19:42.763308] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-02T19:19:43.159812] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:43.196511] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-10-02T19:19:43.451942] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T19:19:43.473010] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-10-02T19:19:44.272990] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-02T19:19:44.452400] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T19:19:44.822955] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T19:19:45.072999] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-02T19:19:45.872982] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-02T19:19:46.255352] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-02T19:19:46.328893] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T19:19:46.673006] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-02T19:19:47.457188] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:19:47.472954] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-02T19:19:48.272987] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-02T19:19:48.350496] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T19:19:49.069475] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T19:19:49.077921] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-02T19:19:49.873007] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-02T19:19:50.146983] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T19:19:50.672996] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-02T19:19:50.786010] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-02T19:19:51.473033] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-02T19:19:52.157848] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T19:19:52.272999] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-02T19:19:53.032628] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (3.16 seconds). [2025-10-02T19:19:53.034285] [INFO ] [REMOTE ] HAFN: Full fetch complete (65183 records). [2025-10-02T19:19:53.034383] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-02T19:19:53.035361] [FATAL] [VALIDATOR ] HAFN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:19:53.035459] [FATAL] [MAIN ] HAFN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:19:53.035503] [WARN ] [MAIN ] HAFN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:19:53.035567] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-02T19:19:53.035739] [DEBUG] [LOCAL ] HAFN: No primary data file found to delete. [2025-10-02T19:19:53.035784] [INFO ] [LOCAL ] HAFN: Starting deletion of derivative data. [2025-10-02T19:19:53.035827] [DEBUG] [LOCAL ] HAFN: No derivative data file found to delete. [2025-10-02T19:19:53.035886] [INFO ] [MAIN ] Update Progress: 992/2370 symbols completed. HAFN took 37.3s. Estimated remaining: 3h 14m 14s. Rate: 7.1 symbols/min [2025-10-02T19:19:53.082084] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-02T19:19:53.230590] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:19:53.231016] [DEBUG] [LOCAL ] HBB: No existing data file found in primary storage. [2025-10-02T19:19:53.231076] [WARN ] [MAIN ] HBB: No existing data found, performing full refresh instead. [2025-10-02T19:19:53.231243] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-02T19:19:53.231284] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-02T19:19:53.231325] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-10-02T19:19:53.231357] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-02T19:19:53.679066] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:19:53.682010] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-02T19:19:53.872968] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-10-02T19:19:53.913496] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:19:54.672979] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-02T19:19:54.861574] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T19:19:54.879364] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T19:19:55.473015] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-02T19:19:56.146373] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T19:19:56.278262] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-02T19:19:56.292459] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T19:19:57.073052] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-02T19:19:57.873010] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-02T19:19:58.333128] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T19:19:58.494998] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T19:19:58.672989] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-02T19:19:58.850045] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-02T19:19:59.473030] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-02T19:20:00.273004] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-02T19:20:00.310578] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:20:00.935062] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-02T19:20:01.048126] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T19:20:01.073021] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-02T19:20:01.872999] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-02T19:20:02.673047] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-02T19:20:03.473232] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-02T19:20:03.611461] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-02T19:20:03.701748] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T19:20:04.273042] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-02T19:20:05.073048] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-02T19:20:06.005839] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T19:20:06.008399] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-02T19:20:06.212374] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-02T19:20:06.552213] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (3.88 seconds). [2025-10-02T19:20:06.672987] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-02T19:20:06.739241] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-10-02T19:20:06.878036] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T19:20:07.473012] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-02T19:20:08.273009] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-02T19:20:08.398533] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T19:20:08.909058] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T19:20:09.073067] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-02T19:20:09.484433] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T19:20:09.598622] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-02T19:20:09.873048] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-02T19:20:10.673016] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-02T19:20:11.472998] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-02T19:20:11.792892] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T19:20:12.030446] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T19:20:12.272997] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-02T19:20:12.778751] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-10-02T19:20:13.073019] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-02T19:20:13.568387] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:20:13.872994] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-02T19:20:14.671162] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T19:20:14.682466] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-02T19:20:15.473007] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-02T19:20:15.904295] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T19:20:16.272996] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-02T19:20:17.072971] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-02T19:20:17.171212] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-02T19:20:17.789011] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (3.11 seconds). [2025-10-02T19:20:17.789792] [INFO ] [REMOTE ] HBB: Full fetch complete (9524 records). [2025-10-02T19:20:17.789883] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-02T19:20:17.790335] [FATAL] [VALIDATOR ] HBB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:17.790426] [FATAL] [MAIN ] HBB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:17.790472] [WARN ] [MAIN ] HBB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:17.790515] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-02T19:20:17.790579] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-10-02T19:20:17.790638] [INFO ] [LOCAL ] HBB: Starting deletion of derivative data. [2025-10-02T19:20:17.790738] [DEBUG] [LOCAL ] HBB: No derivative data file found to delete. [2025-10-02T19:20:17.790799] [INFO ] [MAIN ] Update Progress: 993/2370 symbols completed. HBB took 24.8s. Estimated remaining: 3h 14m 28s. Rate: 7.1 symbols/min [2025-10-02T19:20:17.873637] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-02T19:20:17.984738] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:17.984935] [DEBUG] [LOCAL ] HBI: No existing data file found in primary storage. [2025-10-02T19:20:17.985072] [WARN ] [MAIN ] HBI: No existing data found, performing full refresh instead. [2025-10-02T19:20:17.985277] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-02T19:20:17.985351] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-02T19:20:17.985434] [DEBUG] [LOCAL ] HBI: No primary data file found to delete. [2025-10-02T19:20:17.985481] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-02T19:20:18.216249] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T19:20:18.436127] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:18.672989] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-02T19:20:19.473045] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-10-02T19:20:21.084087] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (3.21 seconds). [2025-10-02T19:20:21.085881] [INFO ] [REMOTE ] HASI: Full fetch complete (67766 records). [2025-10-02T19:20:21.085992] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-02T19:20:21.086826] [FATAL] [VALIDATOR ] HASI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:21.086931] [FATAL] [MAIN ] HASI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:21.086978] [WARN ] [MAIN ] HASI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:21.087049] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-02T19:20:21.087114] [DEBUG] [LOCAL ] HASI: No primary data file found to delete. [2025-10-02T19:20:21.087150] [INFO ] [LOCAL ] HASI: Starting deletion of derivative data. [2025-10-02T19:20:21.087189] [DEBUG] [LOCAL ] HASI: No derivative data file found to delete. [2025-10-02T19:20:21.087247] [INFO ] [MAIN ] Update Progress: 994/2370 symbols completed. HASI took 39.2s. Estimated remaining: 3h 14m 12s. Rate: 7.1 symbols/min [2025-10-02T19:20:21.307350] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-10-02T19:20:21.311629] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:21.322721] [DEBUG] [LOCAL ] HBM: No existing data file found in primary storage. [2025-10-02T19:20:21.323025] [WARN ] [MAIN ] HBM: No existing data found, performing full refresh instead. [2025-10-02T19:20:21.323728] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-02T19:20:21.323581] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-02T19:20:21.324619] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-02T19:20:21.324714] [DEBUG] [LOCAL ] HBM: No primary data file found to delete. [2025-10-02T19:20:21.324759] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-02T19:20:21.512103] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (4.44 seconds). [2025-10-02T19:20:21.570017] [INFO ] [REMOTE ] HAYW: Full fetch complete (70520 records). [2025-10-02T19:20:21.570214] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-02T19:20:21.613137] [FATAL] [VALIDATOR ] HAYW: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:21.651053] [FATAL] [MAIN ] HAYW: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:21.655520] [WARN ] [MAIN ] HAYW: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:21.656032] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-02T19:20:21.666745] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-10-02T19:20:21.687453] [INFO ] [LOCAL ] HAYW: Starting deletion of derivative data. [2025-10-02T19:20:21.706486] [DEBUG] [LOCAL ] HAYW: No derivative data file found to delete. [2025-10-02T19:20:21.723564] [INFO ] [MAIN ] Update Progress: 995/2370 symbols completed. HAYW took 39.1s. Estimated remaining: 3h 13m 53s. Rate: 7.1 symbols/min [2025-10-02T19:20:21.781753] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:21.809300] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-10-02T19:20:21.934355] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:21.934528] [DEBUG] [LOCAL ] HCA: No existing data file found in primary storage. [2025-10-02T19:20:21.934567] [WARN ] [MAIN ] HCA: No existing data found, performing full refresh instead. [2025-10-02T19:20:21.934737] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-02T19:20:21.934789] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-02T19:20:21.934833] [DEBUG] [LOCAL ] HCA: No primary data file found to delete. [2025-10-02T19:20:21.934868] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-02T19:20:22.027190] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (3.35 seconds). [2025-10-02T19:20:22.059495] [INFO ] [REMOTE ] HAL: Full fetch complete (77376 records). [2025-10-02T19:20:22.080259] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-02T19:20:22.112918] [FATAL] [VALIDATOR ] HAL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:22.146268] [FATAL] [MAIN ] HAL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:22.213444] [WARN ] [MAIN ] HAL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:22.239786] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-02T19:20:22.257785] [DEBUG] [LOCAL ] HAL: No primary data file found to delete. [2025-10-02T19:20:22.274101] [INFO ] [LOCAL ] HAL: Starting deletion of derivative data. [2025-10-02T19:20:22.321590] [DEBUG] [LOCAL ] HAL: No derivative data file found to delete. [2025-10-02T19:20:22.344822] [INFO ] [MAIN ] Update Progress: 996/2370 symbols completed. HAL took 44.5s. Estimated remaining: 3h 13m 34s. Rate: 7.1 symbols/min [2025-10-02T19:20:22.344614] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:22.345261] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-10-02T19:20:22.556161] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:22.556342] [DEBUG] [LOCAL ] HCC: No existing data file found in primary storage. [2025-10-02T19:20:22.556385] [WARN ] [MAIN ] HCC: No existing data found, performing full refresh instead. [2025-10-02T19:20:22.556528] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-02T19:20:22.556598] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-02T19:20:22.556686] [DEBUG] [LOCAL ] HCC: No primary data file found to delete. [2025-10-02T19:20:22.556752] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-02T19:20:22.941525] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:22.942446] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-10-02T19:20:23.065376] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T19:20:23.439231] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T19:20:23.472956] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-02T19:20:23.793077] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:20:24.025282] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T19:20:24.273032] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-02T19:20:25.072978] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-02T19:20:25.164998] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-02T19:20:25.798582] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T19:20:25.873006] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-02T19:20:26.355042] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T19:20:26.673043] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-02T19:20:27.472978] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-02T19:20:27.683141] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-02T19:20:28.273009] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-02T19:20:28.323258] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T19:20:29.068879] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T19:20:29.076971] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-02T19:20:29.872990] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-02T19:20:30.191392] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T19:20:30.485996] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T19:20:30.673018] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-02T19:20:31.301049] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:20:31.473006] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-02T19:20:32.273049] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-02T19:20:32.794833] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-02T19:20:33.073025] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-02T19:20:33.794041] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (3.12 seconds). [2025-10-02T19:20:33.873000] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-02T19:20:34.380463] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-02T19:20:34.673002] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-02T19:20:34.966572] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T19:20:35.472981] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-02T19:20:35.648600] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T19:20:36.081496] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T19:20:36.272991] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-02T19:20:36.819722] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T19:20:37.073047] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-02T19:20:37.563683] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T19:20:37.873008] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-02T19:20:38.672994] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-02T19:20:38.769799] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T19:20:39.473005] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-02T19:20:39.523489] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-02T19:20:40.272974] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-02T19:20:40.407345] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T19:20:40.842193] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:20:41.073043] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-02T19:20:41.619356] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T19:20:41.873002] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-02T19:20:42.405391] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:20:42.672994] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-02T19:20:43.472990] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-02T19:20:43.576357] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T19:20:44.121575] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T19:20:44.273001] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-02T19:20:44.768803] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:20:45.073003] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-02T19:20:45.679064] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:20:45.873011] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-02T19:20:46.606031] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T19:20:46.673008] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-02T19:20:47.472990] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-02T19:20:47.516842] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T19:20:48.034628] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T19:20:48.273029] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-02T19:20:48.996409] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T19:20:49.073049] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-02T19:20:49.872979] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-02T19:20:50.673032] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-02T19:20:50.848159] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-02T19:20:51.285281] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (3.01 seconds). [2025-10-02T19:20:51.287008] [INFO ] [REMOTE ] HCC: Full fetch complete (64221 records). [2025-10-02T19:20:51.287127] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-02T19:20:51.288044] [FATAL] [VALIDATOR ] HCC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:51.288185] [FATAL] [MAIN ] HCC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:51.288242] [WARN ] [MAIN ] HCC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:51.288436] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-02T19:20:51.288524] [DEBUG] [LOCAL ] HCC: No primary data file found to delete. [2025-10-02T19:20:51.288582] [INFO ] [LOCAL ] HCC: Starting deletion of derivative data. [2025-10-02T19:20:51.288663] [DEBUG] [LOCAL ] HCC: No derivative data file found to delete. [2025-10-02T19:20:51.288751] [INFO ] [MAIN ] Update Progress: 997/2370 symbols completed. HCC took 28.9s. Estimated remaining: 3h 13m 53s. Rate: 7.1 symbols/min [2025-10-02T19:20:51.473042] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-02T19:20:51.689684] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T19:20:52.273089] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-02T19:20:53.334513] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T19:20:53.346923] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-02T19:20:53.642587] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-02T19:20:53.873056] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-02T19:20:53.942915] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (3.27 seconds). [2025-10-02T19:20:53.944761] [INFO ] [REMOTE ] HCA: Full fetch complete (68591 records). [2025-10-02T19:20:53.944932] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-02T19:20:53.946373] [FATAL] [VALIDATOR ] HCA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:53.946534] [FATAL] [MAIN ] HCA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:53.946623] [WARN ] [MAIN ] HCA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:53.946748] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-02T19:20:53.946827] [DEBUG] [LOCAL ] HCA: No primary data file found to delete. [2025-10-02T19:20:53.946867] [INFO ] [LOCAL ] HCA: Starting deletion of derivative data. [2025-10-02T19:20:53.946962] [DEBUG] [LOCAL ] HCA: No derivative data file found to delete. [2025-10-02T19:20:53.947076] [INFO ] [MAIN ] Update Progress: 998/2370 symbols completed. HCA took 32.2s. Estimated remaining: 3h 13m 37s. Rate: 7.1 symbols/min [2025-10-02T19:20:56.660263] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (3.31 seconds). [2025-10-02T19:20:56.661828] [INFO ] [REMOTE ] HBM: Full fetch complete (75848 records). [2025-10-02T19:20:56.661928] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-02T19:20:56.662734] [FATAL] [VALIDATOR ] HBM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:56.662826] [FATAL] [MAIN ] HBM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:56.662871] [WARN ] [MAIN ] HBM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:56.662941] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-02T19:20:56.663036] [DEBUG] [LOCAL ] HBM: No primary data file found to delete. [2025-10-02T19:20:56.663093] [INFO ] [LOCAL ] HBM: Starting deletion of derivative data. [2025-10-02T19:20:56.663138] [DEBUG] [LOCAL ] HBM: No derivative data file found to delete. [2025-10-02T19:20:56.663196] [INFO ] [MAIN ] Update Progress: 999/2370 symbols completed. HBM took 35.6s. Estimated remaining: 3h 13m 20s. Rate: 7.1 symbols/min [2025-10-02T19:20:57.062012] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (3.19 seconds). [2025-10-02T19:20:57.063873] [INFO ] [REMOTE ] HBI: Full fetch complete (76506 records). [2025-10-02T19:20:57.064052] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-02T19:20:57.065011] [FATAL] [VALIDATOR ] HBI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:20:57.065115] [FATAL] [MAIN ] HBI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:20:57.065160] [WARN ] [MAIN ] HBI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:20:57.065200] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-02T19:20:57.065257] [DEBUG] [LOCAL ] HBI: No primary data file found to delete. [2025-10-02T19:20:57.065352] [INFO ] [LOCAL ] HBI: Starting deletion of derivative data. [2025-10-02T19:20:57.065417] [DEBUG] [LOCAL ] HBI: No derivative data file found to delete. [2025-10-02T19:20:57.065480] [INFO ] [MAIN ] Update Progress: 1000/2370 symbols completed. HBI took 39.3s. Estimated remaining: 3h 13m 1s. Rate: 7.1 symbols/min [2025-10-02T19:20:57.837762] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:57.906777] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:57.891628] [DEBUG] [LOCAL ] HDB: No existing data file found in primary storage. [2025-10-02T19:20:57.914053] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:57.963198] [DEBUG] [LOCAL ] HCI: No existing data file found in primary storage. [2025-10-02T19:20:57.968474] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:20:57.968788] [WARN ] [MAIN ] HDB: No existing data found, performing full refresh instead. [2025-10-02T19:20:57.969248] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-02T19:20:57.969618] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-02T19:20:57.968984] [DEBUG] [LOCAL ] HD: No existing data file found in primary storage. [2025-10-02T19:20:57.970156] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-02T19:20:57.969887] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-02T19:20:57.969530] [WARN ] [MAIN ] HCI: No existing data found, performing full refresh instead. [2025-10-02T19:20:57.970568] [DEBUG] [LOCAL ] HDB: No primary data file found to delete. [2025-10-02T19:20:57.970699] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-02T19:20:57.970882] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-02T19:20:57.970060] [WARN ] [MAIN ] HD: No existing data found, performing full refresh instead. [2025-10-02T19:20:57.983866] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-02T19:20:57.989295] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-02T19:20:57.989115] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-02T19:20:57.995371] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-02T19:20:58.006558] [DEBUG] [LOCAL ] HD: No primary data file found to delete. [2025-10-02T19:20:58.012034] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-02T19:20:58.012261] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-02T19:20:58.022811] [DEBUG] [LOCAL ] HCI: No primary data file found to delete. [2025-10-02T19:20:58.023316] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-02T19:20:58.023041] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-02T19:20:58.093057] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-02T19:20:59.527528] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:59.613275] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:59.603456] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-10-02T19:20:59.629032] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-10-02T19:20:59.643939] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:59.640102] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:20:59.644427] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-10-02T19:20:59.645183] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-10-02T19:21:00.073802] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-10-02T19:21:00.075061] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-02T19:21:00.391886] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-02T19:21:00.392811] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-02T19:21:00.730279] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-10-02T19:21:00.733820] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-02T19:21:01.506264] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T19:21:01.519564] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-02T19:21:01.882048] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-10-02T19:21:01.896065] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-02T19:21:04.832460] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (4.44 seconds). [2025-10-02T19:21:04.833685] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-02T19:21:05.140673] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-02T19:21:05.141585] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-02T19:21:05.335863] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (4.60 seconds). [2025-10-02T19:21:05.339932] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-02T19:21:05.378166] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-02T19:21:05.379087] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-02T19:21:05.628768] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-02T19:21:05.629704] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-02T19:21:05.672291] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (3.78 seconds). [2025-10-02T19:21:05.873029] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-02T19:21:05.949730] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-02T19:21:06.129323] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-02T19:21:06.672992] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-02T19:21:06.837187] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (5.32 seconds). [2025-10-02T19:21:07.472988] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-02T19:21:07.779869] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-02T19:21:08.164247] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T19:21:08.273016] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-02T19:21:08.509053] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-02T19:21:09.073025] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-02T19:21:09.353280] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-02T19:21:09.581906] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-02T19:21:09.873002] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-02T19:21:10.672990] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-02T19:21:11.472999] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-02T19:21:12.057111] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-10-02T19:21:12.273175] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-02T19:21:12.965677] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-02T19:21:13.073027] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-02T19:21:13.873036] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-02T19:21:13.923621] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (2.45 seconds). [2025-10-02T19:21:13.924344] [INFO ] [REMOTE ] HCXY: Full fetch complete (569 records). [2025-10-02T19:21:13.924418] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-02T19:21:13.924912] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:21:13.925003] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:21:13.925048] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:21:13.925121] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-02T19:21:13.925198] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-02T19:21:13.925254] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-02T19:21:13.925298] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-02T19:21:13.925367] [INFO ] [MAIN ] Update Progress: 1001/2370 symbols completed. HCXY took 16.8s. Estimated remaining: 3h 13m 4s. Rate: 7.1 symbols/min [2025-10-02T19:21:14.136890] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-02T19:21:14.138563] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:21:14.141868] [DEBUG] [LOCAL ] HE: No existing data file found in primary storage. [2025-10-02T19:21:14.142180] [WARN ] [MAIN ] HE: No existing data found, performing full refresh instead. [2025-10-02T19:21:14.142298] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-02T19:21:14.142342] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-02T19:21:14.142386] [DEBUG] [LOCAL ] HE: No primary data file found to delete. [2025-10-02T19:21:14.142420] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-02T19:21:14.565694] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:21:14.599438] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (3.93 seconds). [2025-10-02T19:21:14.673002] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-10-02T19:21:15.408871] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T19:21:15.472998] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-02T19:21:16.272974] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-02T19:21:16.473789] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T19:21:17.072997] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-02T19:21:17.253434] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T19:21:17.872982] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-02T19:21:18.027353] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T19:21:18.414902] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-10-02T19:21:18.673009] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-02T19:21:19.282409] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T19:21:19.473044] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-02T19:21:20.272971] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-02T19:21:20.473598] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:21:20.926323] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T19:21:21.072954] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-02T19:21:21.873026] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-02T19:21:22.123159] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T19:21:22.673024] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-02T19:21:22.765287] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T19:21:22.875873] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T19:21:23.473009] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-02T19:21:24.273040] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-02T19:21:24.409757] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T19:21:25.072954] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-02T19:21:25.569431] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-02T19:21:25.873014] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-02T19:21:26.450692] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-10-02T19:21:26.673086] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-02T19:21:26.832888] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T19:21:27.327957] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T19:21:27.473016] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-02T19:21:28.273028] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-02T19:21:28.853322] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T19:21:28.924093] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-02T19:21:29.073053] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-02T19:21:29.873023] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-02T19:21:30.614698] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-10-02T19:21:30.673059] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-02T19:21:30.846344] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T19:21:31.474223] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-02T19:21:31.474093] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-02T19:21:32.086611] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:21:32.273029] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-02T19:21:33.073011] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-02T19:21:33.873017] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-02T19:21:34.231744] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-10-02T19:21:34.673021] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-02T19:21:34.678203] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (3.20 seconds). [2025-10-02T19:21:34.679973] [INFO ] [REMOTE ] HDB: Full fetch complete (74924 records). [2025-10-02T19:21:34.680161] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-02T19:21:34.681245] [FATAL] [VALIDATOR ] HDB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:21:34.681350] [FATAL] [MAIN ] HDB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:21:34.681406] [WARN ] [MAIN ] HDB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:21:34.681519] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-02T19:21:34.681810] [DEBUG] [LOCAL ] HDB: No primary data file found to delete. [2025-10-02T19:21:34.681914] [INFO ] [LOCAL ] HDB: Starting deletion of derivative data. [2025-10-02T19:21:34.681990] [DEBUG] [LOCAL ] HDB: No derivative data file found to delete. [2025-10-02T19:21:34.682129] [INFO ] [MAIN ] Update Progress: 1002/2370 symbols completed. HDB took 37.6s. Estimated remaining: 3h 13m 12s. Rate: 7.1 symbols/min [2025-10-02T19:21:34.880856] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:21:34.881231] [DEBUG] [LOCAL ] HEI: No existing data file found in primary storage. [2025-10-02T19:21:34.881383] [WARN ] [MAIN ] HEI: No existing data found, performing full refresh instead. [2025-10-02T19:21:34.881617] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-02T19:21:34.881707] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-02T19:21:34.881765] [DEBUG] [LOCAL ] HEI: No primary data file found to delete. [2025-10-02T19:21:34.881802] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-02T19:21:35.327302] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:21:35.331559] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T19:21:35.423767] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-02T19:21:35.472966] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-02T19:21:36.273072] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-10-02T19:21:37.073028] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-02T19:21:37.226737] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T19:21:37.287552] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (2.61 seconds). [2025-10-02T19:21:37.288744] [INFO ] [REMOTE ] HCI: Full fetch complete (19351 records). [2025-10-02T19:21:37.288887] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-02T19:21:37.289331] [FATAL] [VALIDATOR ] HCI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:21:37.289453] [FATAL] [MAIN ] HCI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:21:37.289498] [WARN ] [MAIN ] HCI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:21:37.289570] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-02T19:21:37.289720] [DEBUG] [LOCAL ] HCI: No primary data file found to delete. [2025-10-02T19:21:37.289779] [INFO ] [LOCAL ] HCI: Starting deletion of derivative data. [2025-10-02T19:21:37.289880] [DEBUG] [LOCAL ] HCI: No derivative data file found to delete. [2025-10-02T19:21:37.289947] [INFO ] [MAIN ] Update Progress: 1003/2370 symbols completed. HCI took 40.2s. Estimated remaining: 3h 12m 56s. Rate: 7.1 symbols/min [2025-10-02T19:21:37.493725] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T19:21:37.512438] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:21:37.520105] [DEBUG] [LOCAL ] HEQ: No existing data file found in primary storage. [2025-10-02T19:21:37.520159] [WARN ] [MAIN ] HEQ: No existing data found, performing full refresh instead. [2025-10-02T19:21:37.520300] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-02T19:21:37.520360] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-02T19:21:37.520415] [DEBUG] [LOCAL ] HEQ: No primary data file found to delete. [2025-10-02T19:21:37.520476] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-02T19:21:37.877797] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-02T19:21:37.910119] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:21:38.673015] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-02T19:21:39.074804] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T19:21:39.473043] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-10-02T19:21:40.124771] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-10-02T19:21:40.127422] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T19:21:40.273008] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-02T19:21:40.669803] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (3.60 seconds). [2025-10-02T19:21:40.671438] [INFO ] [REMOTE ] HD: Full fetch complete (77054 records). [2025-10-02T19:21:40.671547] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-02T19:21:40.672290] [FATAL] [VALIDATOR ] HD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:21:40.672382] [FATAL] [MAIN ] HD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:21:40.672487] [WARN ] [MAIN ] HD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:21:40.672564] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-02T19:21:40.672703] [DEBUG] [LOCAL ] HD: No primary data file found to delete. [2025-10-02T19:21:40.672761] [INFO ] [LOCAL ] HD: Starting deletion of derivative data. [2025-10-02T19:21:40.672808] [DEBUG] [LOCAL ] HD: No derivative data file found to delete. [2025-10-02T19:21:40.672871] [INFO ] [MAIN ] Update Progress: 1004/2370 symbols completed. HD took 43.6s. Estimated remaining: 3h 12m 40s. Rate: 7.1 symbols/min [2025-10-02T19:21:40.789612] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-02T19:21:40.874714] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:21:40.874929] [DEBUG] [LOCAL ] HESM: No existing data file found in primary storage. [2025-10-02T19:21:40.874985] [WARN ] [MAIN ] HESM: No existing data found, performing full refresh instead. [2025-10-02T19:21:40.875098] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-02T19:21:40.875151] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-02T19:21:40.875220] [DEBUG] [LOCAL ] HESM: No primary data file found to delete. [2025-10-02T19:21:40.875256] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-02T19:21:41.078622] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-02T19:21:41.274506] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:21:41.872981] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-02T19:21:42.673013] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-02T19:21:43.228429] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-02T19:21:43.267620] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T19:21:43.472991] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-02T19:21:44.056580] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-02T19:21:44.273064] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-02T19:21:44.466118] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (3.39 seconds). [2025-10-02T19:21:44.471168] [INFO ] [REMOTE ] HE: Full fetch complete (72020 records). [2025-10-02T19:21:44.471317] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-02T19:21:44.476353] [FATAL] [VALIDATOR ] HE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:21:44.476496] [FATAL] [MAIN ] HE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:21:44.476542] [WARN ] [MAIN ] HE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:21:44.476588] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-02T19:21:44.476682] [DEBUG] [LOCAL ] HE: No primary data file found to delete. [2025-10-02T19:21:44.476742] [INFO ] [LOCAL ] HE: Starting deletion of derivative data. [2025-10-02T19:21:44.476789] [DEBUG] [LOCAL ] HE: No derivative data file found to delete. [2025-10-02T19:21:44.476870] [INFO ] [MAIN ] Update Progress: 1005/2370 symbols completed. HE took 30.6s. Estimated remaining: 3h 12m 26s. Rate: 7.1 symbols/min [2025-10-02T19:21:44.694488] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:21:44.694931] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-02T19:21:44.694988] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-02T19:21:44.695110] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-02T19:21:44.695153] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-02T19:21:44.695196] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-02T19:21:44.695229] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-02T19:21:45.078189] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-10-02T19:21:45.128937] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:21:45.880272] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-02T19:21:45.906401] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T19:21:46.630390] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T19:21:46.673012] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-02T19:21:47.114130] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T19:21:47.473030] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-02T19:21:48.200084] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T19:21:48.254049] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T19:21:48.272995] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-02T19:21:48.834027] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-02T19:21:49.073005] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-02T19:21:49.873017] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-02T19:21:50.656404] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-02T19:21:50.672943] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-02T19:21:51.369786] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:21:51.473036] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-10-02T19:21:51.805390] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-10-02T19:21:52.251240] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T19:21:52.272895] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-02T19:21:53.073001] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-02T19:21:53.404094] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-02T19:21:53.873002] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-02T19:21:53.940076] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-02T19:21:54.604299] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-02T19:21:54.673000] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-02T19:21:55.260816] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T19:21:55.473041] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-02T19:21:55.816675] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-02T19:21:56.273019] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-02T19:21:56.461214] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.19 seconds). [2025-10-02T19:21:57.073027] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-02T19:21:57.873013] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-02T19:21:58.656289] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T19:21:58.672974] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-02T19:21:59.476223] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-02T19:21:59.481138] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T19:21:59.713052] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-02T19:21:59.944153] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T19:22:00.273014] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-02T19:22:01.073015] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-02T19:22:01.584365] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T19:22:01.873015] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-02T19:22:02.614927] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-02T19:22:02.673016] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-02T19:22:03.237967] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T19:22:03.473020] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-02T19:22:04.273013] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-02T19:22:04.779910] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T19:22:05.072970] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-02T19:22:05.160921] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-02T19:22:05.161804] [INFO ] [REMOTE ] HEQ: Full fetch complete (9222 records). [2025-10-02T19:22:05.161881] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-02T19:22:05.162495] [FATAL] [VALIDATOR ] HEQ: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:22:05.162587] [FATAL] [MAIN ] HEQ: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:22:05.162638] [WARN ] [MAIN ] HEQ: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:22:05.162747] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-02T19:22:05.162997] [DEBUG] [LOCAL ] HEQ: No primary data file found to delete. [2025-10-02T19:22:05.163058] [INFO ] [LOCAL ] HEQ: Starting deletion of derivative data. [2025-10-02T19:22:05.163111] [DEBUG] [LOCAL ] HEQ: No derivative data file found to delete. [2025-10-02T19:22:05.163201] [INFO ] [MAIN ] Update Progress: 1006/2370 symbols completed. HEQ took 27.9s. Estimated remaining: 3h 12m 34s. Rate: 7.1 symbols/min [2025-10-02T19:22:05.361402] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:22:05.361720] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-02T19:22:05.361781] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-02T19:22:05.361932] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-02T19:22:05.361990] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-02T19:22:05.362066] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-02T19:22:05.362119] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-02T19:22:05.736190] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T19:22:05.815085] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:22:05.873018] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-02T19:22:06.672983] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-02T19:22:06.852770] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-02T19:22:06.931512] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-02T19:22:07.473003] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-02T19:22:08.273010] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-10-02T19:22:08.657909] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (2.78 seconds). [2025-10-02T19:22:08.659255] [INFO ] [REMOTE ] HEI: Full fetch complete (48563 records). [2025-10-02T19:22:08.659376] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-02T19:22:08.660059] [FATAL] [VALIDATOR ] HEI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:22:08.660145] [FATAL] [MAIN ] HEI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:22:08.660211] [WARN ] [MAIN ] HEI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:22:08.660286] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-02T19:22:08.660351] [DEBUG] [LOCAL ] HEI: No primary data file found to delete. [2025-10-02T19:22:08.660388] [INFO ] [LOCAL ] HEI: Starting deletion of derivative data. [2025-10-02T19:22:08.660430] [DEBUG] [LOCAL ] HEI: No derivative data file found to delete. [2025-10-02T19:22:08.660502] [INFO ] [MAIN ] Update Progress: 1007/2370 symbols completed. HEI took 34.0s. Estimated remaining: 3h 12m 19s. Rate: 7.1 symbols/min [2025-10-02T19:22:08.752570] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-02T19:22:08.865008] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:22:08.865197] [DEBUG] [LOCAL ] HFRO: No existing data file found in primary storage. [2025-10-02T19:22:08.865244] [WARN ] [MAIN ] HFRO: No existing data found, performing full refresh instead. [2025-10-02T19:22:08.865364] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-02T19:22:08.865406] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-02T19:22:08.865448] [DEBUG] [LOCAL ] HFRO: No primary data file found to delete. [2025-10-02T19:22:08.865482] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-02T19:22:09.074142] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-02T19:22:09.299622] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:22:09.331392] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-02T19:22:09.364278] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-02T19:22:09.873041] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-02T19:22:10.131885] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-02T19:22:10.673004] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-02T19:22:11.473001] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-10-02T19:22:12.272995] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-02T19:22:12.366672] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T19:22:12.757753] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-02T19:22:12.836379] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T19:22:13.072994] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-02T19:22:13.298607] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-02T19:22:13.873003] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-02T19:22:14.151238] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-02T19:22:14.673012] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-02T19:22:15.473023] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-02T19:22:15.948026] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-02T19:22:16.273012] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-02T19:22:16.730706] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-02T19:22:16.937302] [DEBUG] [REMOTE ] HF: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:22:16.937624] [WARN ] [REMOTE ] HF: No data returned for month 2025-10 [2025-10-02T19:22:16.937744] [FATAL] [REMOTE ] HF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:22:16.937822] [FATAL] [MAIN ] HF: Failed to fetch primary data. [2025-10-02T19:22:16.937891] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:22:16.937966] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-02T19:22:16.938046] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-02T19:22:16.938105] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-02T19:22:16.938196] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-02T19:22:16.938268] [INFO ] [MAIN ] Update Progress: 1008/2370 symbols completed. HF took 32.5s. Estimated remaining: 3h 12m 10s. Rate: 7.1 symbols/min [2025-10-02T19:22:17.078109] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-02T19:22:17.139003] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:22:17.139235] [DEBUG] [LOCAL ] HGER: No existing data file found in primary storage. [2025-10-02T19:22:17.139282] [WARN ] [MAIN ] HGER: No existing data found, performing full refresh instead. [2025-10-02T19:22:17.139411] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-02T19:22:17.139462] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-02T19:22:17.139508] [DEBUG] [LOCAL ] HGER: No primary data file found to delete. [2025-10-02T19:22:17.139546] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-02T19:22:17.549609] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:22:17.553271] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-02T19:22:17.872997] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-02T19:22:18.673026] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-02T19:22:19.473015] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-02T19:22:19.818270] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-02T19:22:19.868464] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T19:22:20.273024] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-02T19:22:20.596581] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-02T19:22:20.992689] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (3.12 seconds). [2025-10-02T19:22:20.997046] [INFO ] [REMOTE ] HESM: Full fetch complete (68911 records). [2025-10-02T19:22:20.997167] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-02T19:22:20.998052] [FATAL] [VALIDATOR ] HESM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:22:20.998207] [FATAL] [MAIN ] HESM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:22:20.998310] [WARN ] [MAIN ] HESM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:22:20.998387] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-02T19:22:20.998454] [DEBUG] [LOCAL ] HESM: No primary data file found to delete. [2025-10-02T19:22:20.998490] [INFO ] [LOCAL ] HESM: Starting deletion of derivative data. [2025-10-02T19:22:20.998531] [DEBUG] [LOCAL ] HESM: No derivative data file found to delete. [2025-10-02T19:22:20.998590] [INFO ] [MAIN ] Update Progress: 1009/2370 symbols completed. HESM took 40.3s. Estimated remaining: 3h 11m 55s. Rate: 7.1 symbols/min [2025-10-02T19:22:21.078228] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-02T19:22:21.206243] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:22:21.206479] [DEBUG] [LOCAL ] HGLB: No existing data file found in primary storage. [2025-10-02T19:22:21.206541] [WARN ] [MAIN ] HGLB: No existing data found, performing full refresh instead. [2025-10-02T19:22:21.206682] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-02T19:22:21.206739] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-02T19:22:21.206787] [DEBUG] [LOCAL ] HGLB: No primary data file found to delete. [2025-10-02T19:22:21.206822] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-02T19:22:21.568493] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-02T19:22:21.603267] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:22:21.873000] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-02T19:22:22.672976] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-10-02T19:22:22.905084] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T19:22:23.472988] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-02T19:22:23.515873] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-10-02T19:22:24.237522] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T19:22:24.272995] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-02T19:22:25.041104] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-02T19:22:25.072975] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-02T19:22:25.873015] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-02T19:22:25.924763] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T19:22:26.300556] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-02T19:22:26.673074] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-02T19:22:27.473001] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-02T19:22:27.512909] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-02T19:22:27.950727] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-02T19:22:28.273014] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-02T19:22:29.073034] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-02T19:22:29.086526] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T19:22:29.870156] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T19:22:29.873928] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-02T19:22:30.673010] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-10-02T19:22:31.226133] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-10-02T19:22:31.473027] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-02T19:22:32.162077] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T19:22:32.161356] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-02T19:22:32.163055] [INFO ] [REMOTE ] HFND: Full fetch complete (1777 records). [2025-10-02T19:22:32.165026] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-02T19:22:32.166371] [FATAL] [VALIDATOR ] HFND: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:22:32.166461] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:22:32.166539] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:22:32.166616] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-02T19:22:32.166748] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-02T19:22:32.166835] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-02T19:22:32.166890] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-02T19:22:32.166947] [INFO ] [MAIN ] Update Progress: 1010/2370 symbols completed. HFND took 27.0s. Estimated remaining: 3h 11m 51s. Rate: 7.1 symbols/min [2025-10-02T19:22:32.278131] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-02T19:22:32.421874] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:22:32.422053] [DEBUG] [LOCAL ] HGTY: No existing data file found in primary storage. [2025-10-02T19:22:32.422092] [WARN ] [MAIN ] HGTY: No existing data found, performing full refresh instead. [2025-10-02T19:22:32.422208] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-02T19:22:32.422252] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-02T19:22:32.422297] [DEBUG] [LOCAL ] HGTY: No primary data file found to delete. [2025-10-02T19:22:32.422332] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-02T19:22:32.823896] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:22:32.862614] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-02T19:22:33.073026] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-10-02T19:22:33.528348] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-02T19:22:33.873005] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-02T19:22:34.580470] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-02T19:22:34.673046] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-02T19:22:35.472989] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-02T19:22:35.684469] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:22:36.272972] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-02T19:22:36.319316] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T19:22:37.062674] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-02T19:22:37.072952] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-02T19:22:37.873005] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-02T19:22:38.149920] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T19:22:38.561355] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T19:22:38.673052] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-02T19:22:39.473006] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-02T19:22:39.515072] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-02T19:22:40.183149] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-02T19:22:40.273001] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-02T19:22:40.766117] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-02T19:22:41.073196] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-02T19:22:41.834846] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T19:22:41.872975] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-02T19:22:42.470177] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-02T19:22:42.673031] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-02T19:22:43.436018] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T19:22:43.473024] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-02T19:22:44.273214] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-02T19:22:44.284918] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T19:22:45.072986] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-02T19:22:45.308054] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-02T19:22:45.841534] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-02T19:22:45.873044] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-02T19:22:46.601798] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T19:22:46.672992] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-02T19:22:47.473010] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-02T19:22:48.164423] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-02T19:22:48.273021] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-02T19:22:49.073069] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-02T19:22:49.167822] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-02T19:22:49.331479] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-02T19:22:49.332530] [INFO ] [REMOTE ] HFRO: Full fetch complete (28882 records). [2025-10-02T19:22:49.332611] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-02T19:22:49.333196] [FATAL] [VALIDATOR ] HFRO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:22:49.333296] [FATAL] [MAIN ] HFRO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:22:49.333373] [WARN ] [MAIN ] HFRO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:22:49.333507] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-02T19:22:49.333611] [DEBUG] [LOCAL ] HFRO: No primary data file found to delete. [2025-10-02T19:22:49.333700] [INFO ] [LOCAL ] HFRO: Starting deletion of derivative data. [2025-10-02T19:22:49.333761] [DEBUG] [LOCAL ] HFRO: No derivative data file found to delete. [2025-10-02T19:22:49.333820] [INFO ] [MAIN ] Update Progress: 1011/2370 symbols completed. HFRO took 40.7s. Estimated remaining: 3h 11m 54s. Rate: 7.1 symbols/min [2025-10-02T19:22:49.520613] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:22:49.520863] [DEBUG] [LOCAL ] HGV: No existing data file found in primary storage. [2025-10-02T19:22:49.520920] [WARN ] [MAIN ] HGV: No existing data found, performing full refresh instead. [2025-10-02T19:22:49.521086] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-02T19:22:49.521160] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-02T19:22:49.521223] [DEBUG] [LOCAL ] HGV: No primary data file found to delete. [2025-10-02T19:22:49.521258] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-02T19:22:49.890689] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-02T19:22:49.942570] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:22:49.951312] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T19:22:50.673038] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-02T19:22:50.751302] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T19:22:51.473000] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-10-02T19:22:52.273033] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-02T19:22:53.073003] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-02T19:23:05.927888] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (12.85 seconds). [2025-10-02T19:23:05.932754] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-02T19:23:06.595028] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (14.32 seconds). [2025-10-02T19:23:06.601394] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-02T19:23:08.099708] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (16.63 seconds). [2025-10-02T19:23:08.108450] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-02T19:23:08.656075] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (17.98 seconds). [2025-10-02T19:23:08.656919] [INFO ] [REMOTE ] HGLB: Full fetch complete (14514 records). [2025-10-02T19:23:08.656996] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-02T19:23:08.657403] [FATAL] [VALIDATOR ] HGLB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:08.657490] [FATAL] [MAIN ] HGLB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:08.657537] [WARN ] [MAIN ] HGLB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:08.657606] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-02T19:23:08.657705] [DEBUG] [LOCAL ] HGLB: No primary data file found to delete. [2025-10-02T19:23:08.657796] [INFO ] [LOCAL ] HGLB: Starting deletion of derivative data. [2025-10-02T19:23:08.657860] [DEBUG] [LOCAL ] HGLB: No derivative data file found to delete. [2025-10-02T19:23:08.657919] [INFO ] [MAIN ] Update Progress: 1012/2370 symbols completed. HGLB took 47.7s. Estimated remaining: 3h 11m 60s. Rate: 7.1 symbols/min [2025-10-02T19:23:08.853917] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (2.92 seconds). [2025-10-02T19:23:08.857489] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:08.860528] [DEBUG] [LOCAL ] HHH: No existing data file found in primary storage. [2025-10-02T19:23:08.860907] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-02T19:23:08.860969] [WARN ] [MAIN ] HHH: No existing data found, performing full refresh instead. [2025-10-02T19:23:08.861960] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-02T19:23:08.862011] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-02T19:23:08.862057] [DEBUG] [LOCAL ] HHH: No primary data file found to delete. [2025-10-02T19:23:08.862092] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-02T19:23:09.255214] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:09.255562] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-10-02T19:23:09.506301] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-02T19:23:09.509554] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-02T19:23:09.900208] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T19:23:09.909827] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-02T19:23:10.554692] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-02T19:23:10.559626] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-02T19:23:10.704583] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:23:10.704763] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (4.10 seconds). [2025-10-02T19:23:10.712134] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-02T19:23:10.711428] [INFO ] [REMOTE ] HGER: Full fetch complete (16772 records). [2025-10-02T19:23:10.712334] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-02T19:23:10.713902] [FATAL] [VALIDATOR ] HGER: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:10.714008] [FATAL] [MAIN ] HGER: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:10.714213] [WARN ] [MAIN ] HGER: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:10.714309] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-02T19:23:10.714393] [DEBUG] [LOCAL ] HGER: No primary data file found to delete. [2025-10-02T19:23:10.714440] [INFO ] [LOCAL ] HGER: Starting deletion of derivative data. [2025-10-02T19:23:10.714484] [DEBUG] [LOCAL ] HGER: No derivative data file found to delete. [2025-10-02T19:23:10.714545] [INFO ] [MAIN ] Update Progress: 1013/2370 symbols completed. HGER took 53.8s. Estimated remaining: 3h 11m 43s. Rate: 7.1 symbols/min [2025-10-02T19:23:10.911960] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:10.912127] [DEBUG] [LOCAL ] HI: No existing data file found in primary storage. [2025-10-02T19:23:10.912168] [WARN ] [MAIN ] HI: No existing data found, performing full refresh instead. [2025-10-02T19:23:10.912317] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-02T19:23:10.912387] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-02T19:23:10.912440] [DEBUG] [LOCAL ] HI: No primary data file found to delete. [2025-10-02T19:23:10.912478] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-02T19:23:11.327326] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:11.327864] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-10-02T19:23:11.342530] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T19:23:11.348425] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-02T19:23:11.423204] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T19:23:11.432148] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-02T19:23:12.228296] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:23:12.234795] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-02T19:23:12.709893] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:23:12.718136] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-02T19:23:13.236769] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T19:23:13.258253] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-02T19:23:13.270942] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T19:23:13.278412] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-02T19:23:13.894119] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T19:23:13.901424] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-02T19:23:13.990859] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (2.64 seconds). [2025-10-02T19:23:13.991769] [INFO ] [REMOTE ] HGTY: Full fetch complete (17158 records). [2025-10-02T19:23:13.991843] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-02T19:23:13.992304] [FATAL] [VALIDATOR ] HGTY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:13.992400] [FATAL] [MAIN ] HGTY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:13.992470] [WARN ] [MAIN ] HGTY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:13.992578] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-02T19:23:13.992673] [DEBUG] [LOCAL ] HGTY: No primary data file found to delete. [2025-10-02T19:23:13.992733] [INFO ] [LOCAL ] HGTY: Starting deletion of derivative data. [2025-10-02T19:23:13.992792] [DEBUG] [LOCAL ] HGTY: No derivative data file found to delete. [2025-10-02T19:23:13.992868] [INFO ] [MAIN ] Update Progress: 1014/2370 symbols completed. HGTY took 41.8s. Estimated remaining: 3h 11m 27s. Rate: 7.1 symbols/min [2025-10-02T19:23:14.182263] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:14.182471] [DEBUG] [LOCAL ] HIG: No existing data file found in primary storage. [2025-10-02T19:23:14.182521] [WARN ] [MAIN ] HIG: No existing data found, performing full refresh instead. [2025-10-02T19:23:14.182633] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-02T19:23:14.182761] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-02T19:23:14.182814] [DEBUG] [LOCAL ] HIG: No primary data file found to delete. [2025-10-02T19:23:14.182849] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-02T19:23:14.609510] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:14.610034] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-10-02T19:23:14.631094] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-02T19:23:14.638534] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-02T19:23:14.674933] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T19:23:14.686786] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-02T19:23:15.305713] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T19:23:15.313847] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-02T19:23:15.657126] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T19:23:15.663828] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-02T19:23:16.162528] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T19:23:16.173922] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-02T19:23:16.460486] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-10-02T19:23:16.471355] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-02T19:23:16.557113] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-02T19:23:16.564607] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-02T19:23:16.890270] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T19:23:16.903119] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-02T19:23:17.706606] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T19:23:17.718191] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-02T19:23:18.100565] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T19:23:18.109398] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-02T19:23:18.137136] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T19:23:18.146562] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-02T19:23:18.218721] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T19:23:18.229063] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-02T19:23:19.423175] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T19:23:19.441911] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-02T19:23:19.554539] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T19:23:19.563571] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-02T19:23:19.612612] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T19:23:19.622484] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-02T19:23:19.807080] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T19:23:20.273035] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-02T19:23:20.556417] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-02T19:23:20.643489] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T19:23:21.032922] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-02T19:23:21.073044] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-02T19:23:21.873019] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-02T19:23:22.007697] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T19:23:22.119743] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T19:23:22.673042] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-02T19:23:22.983683] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T19:23:23.473039] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-02T19:23:24.273051] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-02T19:23:25.072990] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-02T19:23:25.328538] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T19:23:25.704400] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (3.03 seconds). [2025-10-02T19:23:25.705782] [INFO ] [REMOTE ] HHH: Full fetch complete (45405 records). [2025-10-02T19:23:25.705873] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-02T19:23:25.706482] [FATAL] [VALIDATOR ] HHH: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:25.706569] [FATAL] [MAIN ] HHH: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:25.706626] [WARN ] [MAIN ] HHH: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:25.706838] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-02T19:23:25.706921] [DEBUG] [LOCAL ] HHH: No primary data file found to delete. [2025-10-02T19:23:25.706960] [INFO ] [LOCAL ] HHH: Starting deletion of derivative data. [2025-10-02T19:23:25.707001] [DEBUG] [LOCAL ] HHH: No derivative data file found to delete. [2025-10-02T19:23:25.707061] [INFO ] [MAIN ] Update Progress: 1015/2370 symbols completed. HHH took 17.0s. Estimated remaining: 3h 11m 23s. Rate: 7.1 symbols/min [2025-10-02T19:23:25.881837] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-02T19:23:25.913706] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:25.913994] [DEBUG] [LOCAL ] HII: No existing data file found in primary storage. [2025-10-02T19:23:25.914069] [WARN ] [MAIN ] HII: No existing data found, performing full refresh instead. [2025-10-02T19:23:25.914228] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-02T19:23:25.914306] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-02T19:23:25.914399] [DEBUG] [LOCAL ] HII: No primary data file found to delete. [2025-10-02T19:23:25.914470] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-02T19:23:26.344743] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:26.370398] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T19:23:26.673023] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-10-02T19:23:27.326273] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (3.05 seconds). [2025-10-02T19:23:27.327940] [INFO ] [REMOTE ] HGV: Full fetch complete (65632 records). [2025-10-02T19:23:27.328062] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-02T19:23:27.329318] [FATAL] [VALIDATOR ] HGV: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:27.329408] [FATAL] [MAIN ] HGV: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:27.329453] [WARN ] [MAIN ] HGV: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:27.329524] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-02T19:23:27.329594] [DEBUG] [LOCAL ] HGV: No primary data file found to delete. [2025-10-02T19:23:27.329632] [INFO ] [LOCAL ] HGV: Starting deletion of derivative data. [2025-10-02T19:23:27.329725] [DEBUG] [LOCAL ] HGV: No derivative data file found to delete. [2025-10-02T19:23:27.329846] [INFO ] [MAIN ] Update Progress: 1016/2370 symbols completed. HGV took 38.0s. Estimated remaining: 3h 11m 6s. Rate: 7.1 symbols/min [2025-10-02T19:23:27.477817] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-02T19:23:27.536746] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:27.537184] [DEBUG] [LOCAL ] HIMS: No existing data file found in primary storage. [2025-10-02T19:23:27.537451] [WARN ] [MAIN ] HIMS: No existing data found, performing full refresh instead. [2025-10-02T19:23:27.537818] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-02T19:23:27.537974] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-02T19:23:27.538091] [DEBUG] [LOCAL ] HIMS: No primary data file found to delete. [2025-10-02T19:23:27.538227] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-02T19:23:28.010895] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-10-02T19:23:28.137473] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:28.189909] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T19:23:28.273008] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-02T19:23:28.705391] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-02T19:23:29.073000] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-10-02T19:23:29.723235] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:23:29.873005] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-02T19:23:30.673015] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-02T19:23:31.184993] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T19:23:31.473055] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-02T19:23:31.547801] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-10-02T19:23:31.768601] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T19:23:32.273051] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-02T19:23:33.073224] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-02T19:23:33.100748] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T19:23:33.873003] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-02T19:23:34.596770] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-10-02T19:23:34.673049] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-02T19:23:35.472992] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-02T19:23:35.554230] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T19:23:36.272994] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-02T19:23:36.521387] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (3.45 seconds). [2025-10-02T19:23:36.522703] [INFO ] [REMOTE ] HI: Full fetch complete (49754 records). [2025-10-02T19:23:36.522785] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-02T19:23:36.523358] [FATAL] [VALIDATOR ] HI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:36.523442] [FATAL] [MAIN ] HI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:36.523486] [WARN ] [MAIN ] HI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:36.523553] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-02T19:23:36.523615] [DEBUG] [LOCAL ] HI: No primary data file found to delete. [2025-10-02T19:23:36.523680] [INFO ] [LOCAL ] HI: Starting deletion of derivative data. [2025-10-02T19:23:36.523743] [DEBUG] [LOCAL ] HI: No derivative data file found to delete. [2025-10-02T19:23:36.523814] [INFO ] [MAIN ] Update Progress: 1017/2370 symbols completed. HI took 25.8s. Estimated remaining: 3h 10m 58s. Rate: 7.1 symbols/min [2025-10-02T19:23:36.708567] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:36.708760] [DEBUG] [LOCAL ] HIO: No existing data file found in primary storage. [2025-10-02T19:23:36.708866] [WARN ] [MAIN ] HIO: No existing data found, performing full refresh instead. [2025-10-02T19:23:36.708987] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-02T19:23:36.709030] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-02T19:23:36.709073] [DEBUG] [LOCAL ] HIO: No primary data file found to delete. [2025-10-02T19:23:36.709106] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-02T19:23:37.109446] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:37.110186] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-10-02T19:23:37.319463] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T19:23:37.363717] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-10-02T19:23:37.856093] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T19:23:37.880993] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-02T19:23:37.886854] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T19:23:38.673009] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-02T19:23:39.473017] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-02T19:23:39.867777] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T19:23:40.272975] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-02T19:23:40.616405] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-10-02T19:23:40.759105] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T19:23:41.073019] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-02T19:23:41.450280] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T19:23:41.873047] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-02T19:23:42.672981] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-02T19:23:42.789976] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T19:23:43.473054] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-02T19:23:44.231623] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-02T19:23:44.273067] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-02T19:23:44.477551] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-02T19:23:44.510618] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T19:23:45.073005] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-02T19:23:45.873038] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-02T19:23:46.673074] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-02T19:23:47.093390] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-02T19:23:47.473013] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-02T19:23:47.585225] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (3.31 seconds). [2025-10-02T19:23:47.587116] [INFO ] [REMOTE ] HIG: Full fetch complete (72859 records). [2025-10-02T19:23:47.587271] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-02T19:23:47.588081] [FATAL] [VALIDATOR ] HIG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:47.588230] [FATAL] [MAIN ] HIG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:47.588305] [WARN ] [MAIN ] HIG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:47.588381] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-02T19:23:47.588489] [DEBUG] [LOCAL ] HIG: No primary data file found to delete. [2025-10-02T19:23:47.588544] [INFO ] [LOCAL ] HIG: Starting deletion of derivative data. [2025-10-02T19:23:47.588590] [DEBUG] [LOCAL ] HIG: No derivative data file found to delete. [2025-10-02T19:23:47.588683] [INFO ] [MAIN ] Update Progress: 1018/2370 symbols completed. HIG took 33.6s. Estimated remaining: 3h 10m 53s. Rate: 7.1 symbols/min [2025-10-02T19:23:47.797923] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:47.798524] [DEBUG] [LOCAL ] HIPO: No existing data file found in primary storage. [2025-10-02T19:23:47.798608] [WARN ] [MAIN ] HIPO: No existing data found, performing full refresh instead. [2025-10-02T19:23:47.799258] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-02T19:23:47.799515] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-02T19:23:47.824303] [DEBUG] [LOCAL ] HIPO: No primary data file found to delete. [2025-10-02T19:23:47.854017] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-02T19:23:47.856456] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T19:23:47.863850] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-10-02T19:23:48.276101] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-02T19:23:48.276010] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:23:48.550984] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-02T19:23:49.073015] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-02T19:23:49.698855] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-02T19:23:49.798945] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T19:23:49.873043] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-02T19:23:50.673012] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-02T19:23:51.473006] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-10-02T19:23:51.715434] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-02T19:23:52.272991] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-02T19:23:52.510105] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-10-02T19:23:52.571785] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-02T19:23:53.072967] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-02T19:23:53.388853] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-02T19:23:53.873004] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-02T19:23:54.673008] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-02T19:23:55.277255] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-02T19:23:55.473066] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-02T19:23:55.860706] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-10-02T19:23:55.910967] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T19:23:56.273059] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-02T19:23:56.461180] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-02T19:23:57.073003] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-02T19:23:57.873055] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-02T19:23:58.161455] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T19:23:58.673010] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-02T19:23:59.142047] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (2.87 seconds). [2025-10-02T19:23:59.143386] [INFO ] [REMOTE ] HIO: Full fetch complete (37119 records). [2025-10-02T19:23:59.143474] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-02T19:23:59.144043] [FATAL] [VALIDATOR ] HIO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:23:59.144127] [FATAL] [MAIN ] HIO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:23:59.144171] [WARN ] [MAIN ] HIO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:23:59.144212] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-02T19:23:59.144267] [DEBUG] [LOCAL ] HIO: No primary data file found to delete. [2025-10-02T19:23:59.144304] [INFO ] [LOCAL ] HIO: Starting deletion of derivative data. [2025-10-02T19:23:59.144344] [DEBUG] [LOCAL ] HIO: No derivative data file found to delete. [2025-10-02T19:23:59.144397] [INFO ] [MAIN ] Update Progress: 1019/2370 symbols completed. HIO took 22.6s. Estimated remaining: 3h 10m 49s. Rate: 7.1 symbols/min [2025-10-02T19:23:59.328726] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:23:59.328908] [DEBUG] [LOCAL ] HIW: No existing data file found in primary storage. [2025-10-02T19:23:59.328947] [WARN ] [MAIN ] HIW: No existing data found, performing full refresh instead. [2025-10-02T19:23:59.329068] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-02T19:23:59.329111] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-02T19:23:59.329202] [DEBUG] [LOCAL ] HIW: No primary data file found to delete. [2025-10-02T19:23:59.329289] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-02T19:23:59.478174] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-02T19:23:59.749310] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:00.118222] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-10-02T19:24:00.272983] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-02T19:24:00.633714] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T19:24:01.073000] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-02T19:24:01.741102] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (3.07 seconds). [2025-10-02T19:24:01.743032] [INFO ] [REMOTE ] HII: Full fetch complete (52789 records). [2025-10-02T19:24:01.743191] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-02T19:24:01.744352] [FATAL] [VALIDATOR ] HII: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:24:01.744460] [FATAL] [MAIN ] HII: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:24:01.744545] [WARN ] [MAIN ] HII: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:24:01.744630] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-02T19:24:01.744808] [DEBUG] [LOCAL ] HII: No primary data file found to delete. [2025-10-02T19:24:01.744868] [INFO ] [LOCAL ] HII: Starting deletion of derivative data. [2025-10-02T19:24:01.744930] [DEBUG] [LOCAL ] HII: No derivative data file found to delete. [2025-10-02T19:24:01.745013] [INFO ] [MAIN ] Update Progress: 1020/2370 symbols completed. HII took 36.0s. Estimated remaining: 3h 10m 33s. Rate: 7.1 symbols/min [2025-10-02T19:24:01.878411] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-10-02T19:24:01.958853] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:24:01.959257] [DEBUG] [LOCAL ] HIX: No existing data file found in primary storage. [2025-10-02T19:24:01.959338] [WARN ] [MAIN ] HIX: No existing data found, performing full refresh instead. [2025-10-02T19:24:01.959533] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-02T19:24:01.959609] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-02T19:24:01.959729] [DEBUG] [LOCAL ] HIX: No primary data file found to delete. [2025-10-02T19:24:01.959773] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-02T19:24:02.373019] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:02.384409] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T19:24:02.672983] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-10-02T19:24:03.029008] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-10-02T19:24:03.372764] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T19:24:03.472975] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-02T19:24:03.843721] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T19:24:04.272989] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-02T19:24:05.019186] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T19:24:05.072976] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-02T19:24:05.873009] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-02T19:24:05.956963] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-02T19:24:06.673016] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-02T19:24:07.466952] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T19:24:07.476101] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-02T19:24:07.525516] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T19:24:08.272982] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-02T19:24:08.308712] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T19:24:08.515319] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (4.24 seconds). [2025-10-02T19:24:08.517019] [INFO ] [REMOTE ] HIMS: Full fetch complete (77545 records). [2025-10-02T19:24:08.517136] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-02T19:24:08.518017] [FATAL] [VALIDATOR ] HIMS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:24:08.518117] [FATAL] [MAIN ] HIMS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:24:08.518207] [WARN ] [MAIN ] HIMS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:24:08.518283] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-02T19:24:08.518350] [DEBUG] [LOCAL ] HIMS: No primary data file found to delete. [2025-10-02T19:24:08.518388] [INFO ] [LOCAL ] HIMS: Starting deletion of derivative data. [2025-10-02T19:24:08.518429] [DEBUG] [LOCAL ] HIMS: No derivative data file found to delete. [2025-10-02T19:24:08.518488] [INFO ] [MAIN ] Update Progress: 1021/2370 symbols completed. HIMS took 41.2s. Estimated remaining: 3h 10m 22s. Rate: 7.1 symbols/min [2025-10-02T19:24:08.718592] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:24:08.718778] [DEBUG] [LOCAL ] HKD: No existing data file found in primary storage. [2025-10-02T19:24:08.718824] [WARN ] [MAIN ] HKD: No existing data found, performing full refresh instead. [2025-10-02T19:24:08.718984] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-02T19:24:08.719033] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-02T19:24:08.719076] [DEBUG] [LOCAL ] HKD: No primary data file found to delete. [2025-10-02T19:24:08.719107] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-02T19:24:09.078125] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-02T19:24:09.142583] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:09.333944] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T19:24:09.873006] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-02T19:24:10.371614] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T19:24:10.672976] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-02T19:24:10.917796] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T19:24:11.473013] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-10-02T19:24:12.273009] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-02T19:24:12.352893] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-02T19:24:12.773873] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T19:24:13.072998] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-02T19:24:13.417146] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T19:24:13.873005] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-02T19:24:14.092149] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T19:24:14.673034] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-02T19:24:15.285484] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T19:24:15.472973] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-02T19:24:15.789003] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T19:24:16.272973] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-02T19:24:16.298792] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T19:24:17.073018] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-02T19:24:17.436751] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-02T19:24:17.872992] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-02T19:24:18.477683] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:24:18.673048] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-02T19:24:18.961320] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T19:24:19.473010] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-02T19:24:19.727458] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T19:24:20.273031] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-02T19:24:21.011990] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:24:21.072985] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-02T19:24:21.332220] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T19:24:21.873008] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-02T19:24:22.632027] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-02T19:24:22.672989] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-02T19:24:22.816573] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-02T19:24:23.473027] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-02T19:24:24.280901] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-02T19:24:24.286876] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T19:24:24.584234] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T19:24:25.073014] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-02T19:24:25.390015] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T19:24:25.873009] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-02T19:24:26.678680] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-02T19:24:26.683158] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-02T19:24:27.473030] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-02T19:24:27.733320] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-02T19:24:27.734318] [INFO ] [REMOTE ] HIPO: Full fetch complete (31457 records). [2025-10-02T19:24:27.734397] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-02T19:24:27.735015] [FATAL] [VALIDATOR ] HIPO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:24:27.735104] [FATAL] [MAIN ] HIPO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:24:27.735149] [WARN ] [MAIN ] HIPO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:24:27.735221] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-02T19:24:27.735301] [DEBUG] [LOCAL ] HIPO: No primary data file found to delete. [2025-10-02T19:24:27.735359] [INFO ] [LOCAL ] HIPO: Starting deletion of derivative data. [2025-10-02T19:24:27.735422] [DEBUG] [LOCAL ] HIPO: No derivative data file found to delete. [2025-10-02T19:24:27.735499] [INFO ] [MAIN ] Update Progress: 1022/2370 symbols completed. HIPO took 40.1s. Estimated remaining: 3h 10m 28s. Rate: 7.1 symbols/min [2025-10-02T19:24:27.921251] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:24:27.921430] [DEBUG] [LOCAL ] HL: No existing data file found in primary storage. [2025-10-02T19:24:27.921486] [WARN ] [MAIN ] HL: No existing data found, performing full refresh instead. [2025-10-02T19:24:27.921604] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-02T19:24:27.921676] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-02T19:24:27.921774] [DEBUG] [LOCAL ] HL: No primary data file found to delete. [2025-10-02T19:24:27.921829] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-02T19:24:28.273867] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-02T19:24:28.339606] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:28.385941] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T19:24:28.397348] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-02T19:24:29.073019] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-02T19:24:29.561879] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T19:24:29.873029] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-02T19:24:30.673009] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-10-02T19:24:31.027759] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T19:24:31.473055] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-02T19:24:32.193820] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (3.12 seconds). [2025-10-02T19:24:32.195544] [INFO ] [REMOTE ] HIW: Full fetch complete (64425 records). [2025-10-02T19:24:32.195715] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-02T19:24:32.196502] [FATAL] [VALIDATOR ] HIW: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:24:32.196596] [FATAL] [MAIN ] HIW: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:24:32.196667] [WARN ] [MAIN ] HIW: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:24:32.196734] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-02T19:24:32.196826] [DEBUG] [LOCAL ] HIW: No primary data file found to delete. [2025-10-02T19:24:32.196889] [INFO ] [LOCAL ] HIW: Starting deletion of derivative data. [2025-10-02T19:24:32.196980] [DEBUG] [LOCAL ] HIW: No derivative data file found to delete. [2025-10-02T19:24:32.197059] [INFO ] [MAIN ] Update Progress: 1023/2370 symbols completed. HIW took 33.1s. Estimated remaining: 3h 10m 14s. Rate: 7.1 symbols/min [2025-10-02T19:24:32.275803] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-02T19:24:32.378588] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-10-02T19:24:32.454743] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:24:32.432684] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-02T19:24:32.455721] [DEBUG] [LOCAL ] HLF: No existing data file found in primary storage. [2025-10-02T19:24:32.455875] [WARN ] [MAIN ] HLF: No existing data found, performing full refresh instead. [2025-10-02T19:24:32.456032] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-02T19:24:32.459406] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-02T19:24:32.459996] [DEBUG] [LOCAL ] HLF: No primary data file found to delete. [2025-10-02T19:24:32.460053] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-02T19:24:32.854262] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:33.078514] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-10-02T19:24:33.086216] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-02T19:24:33.873000] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-02T19:24:34.482027] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T19:24:34.673033] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-02T19:24:35.473049] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-02T19:24:35.805554] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T19:24:35.951000] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T19:24:36.273038] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-02T19:24:36.996084] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:24:37.073049] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-02T19:24:37.813683] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T19:24:37.873005] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-02T19:24:38.673004] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-02T19:24:39.474701] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-02T19:24:39.484167] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T19:24:39.991058] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (2.92 seconds). [2025-10-02T19:24:39.992091] [INFO ] [REMOTE ] HKD: Full fetch complete (28325 records). [2025-10-02T19:24:39.992166] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-02T19:24:39.992637] [FATAL] [VALIDATOR ] HKD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:24:39.992760] [FATAL] [MAIN ] HKD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:24:39.992806] [WARN ] [MAIN ] HKD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:24:39.992847] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-02T19:24:39.992918] [DEBUG] [LOCAL ] HKD: No primary data file found to delete. [2025-10-02T19:24:39.992976] [INFO ] [LOCAL ] HKD: Starting deletion of derivative data. [2025-10-02T19:24:39.993023] [DEBUG] [LOCAL ] HKD: No derivative data file found to delete. [2025-10-02T19:24:39.993090] [INFO ] [MAIN ] Update Progress: 1024/2370 symbols completed. HKD took 31.5s. Estimated remaining: 3h 10m 4s. Rate: 7.1 symbols/min [2025-10-02T19:24:40.181350] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:24:40.181615] [DEBUG] [LOCAL ] HLI: No existing data file found in primary storage. [2025-10-02T19:24:40.181690] [WARN ] [MAIN ] HLI: No existing data found, performing full refresh instead. [2025-10-02T19:24:40.181782] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-02T19:24:40.181822] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-02T19:24:40.181865] [DEBUG] [LOCAL ] HLI: No primary data file found to delete. [2025-10-02T19:24:40.181901] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-02T19:24:40.276303] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-02T19:24:40.575302] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:40.656552] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-10-02T19:24:41.073023] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-02T19:24:41.848666] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:24:41.872959] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-02T19:24:42.417048] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-02T19:24:42.418368] [INFO ] [REMOTE ] HIX: Full fetch complete (30623 records). [2025-10-02T19:24:42.418456] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-02T19:24:42.419014] [FATAL] [VALIDATOR ] HIX: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:24:42.419102] [FATAL] [MAIN ] HIX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:24:42.419148] [WARN ] [MAIN ] HIX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:24:42.419190] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-02T19:24:42.419249] [DEBUG] [LOCAL ] HIX: No primary data file found to delete. [2025-10-02T19:24:42.419287] [INFO ] [LOCAL ] HIX: Starting deletion of derivative data. [2025-10-02T19:24:42.419329] [DEBUG] [LOCAL ] HIX: No derivative data file found to delete. [2025-10-02T19:24:42.419384] [INFO ] [MAIN ] Update Progress: 1025/2370 symbols completed. HIX took 40.7s. Estimated remaining: 3h 9m 48s. Rate: 7.1 symbols/min [2025-10-02T19:24:42.630000] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:24:42.630174] [DEBUG] [LOCAL ] HLIO: No existing data file found in primary storage. [2025-10-02T19:24:42.630212] [WARN ] [MAIN ] HLIO: No existing data found, performing full refresh instead. [2025-10-02T19:24:42.630370] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-02T19:24:42.630428] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-02T19:24:42.630481] [DEBUG] [LOCAL ] HLIO: No primary data file found to delete. [2025-10-02T19:24:42.630523] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-02T19:24:42.675501] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-10-02T19:24:43.027956] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:24:43.189491] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-02T19:24:43.303588] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-02T19:24:43.473021] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-10-02T19:24:44.115755] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T19:24:44.278001] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-02T19:24:44.283621] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-10-02T19:24:45.073002] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-02T19:24:45.730505] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:24:45.873006] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-02T19:24:46.680043] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-02T19:24:46.701026] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T19:24:46.878502] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T19:24:47.473043] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-02T19:24:48.273037] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-02T19:24:48.563461] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T19:24:48.637558] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-10-02T19:24:49.073029] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-02T19:24:49.502342] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T19:24:49.873019] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-02T19:24:50.660533] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T19:24:50.672960] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-02T19:24:51.023413] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:24:51.473039] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-02T19:24:52.273022] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-02T19:24:52.455012] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T19:24:52.506448] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T19:24:53.073021] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-02T19:24:53.565938] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-02T19:24:53.873007] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-02T19:24:54.672966] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-02T19:24:55.119325] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T19:24:55.253116] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-02T19:24:55.473003] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-02T19:24:55.765485] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T19:24:56.273000] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-02T19:24:56.827514] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T19:24:57.073001] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-02T19:24:57.871417] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T19:24:57.881206] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-02T19:24:58.506242] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T19:24:58.673011] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-02T19:24:59.308405] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T19:24:59.473017] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-02T19:24:59.985507] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T19:25:00.272989] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-02T19:25:01.073005] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-02T19:25:01.875884] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-02T19:25:01.884153] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-10-02T19:25:02.069735] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T19:25:02.673015] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-02T19:25:03.106787] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-02T19:25:03.473006] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-02T19:25:03.578470] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T19:25:04.272995] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-02T19:25:04.558715] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T19:25:05.073036] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-02T19:25:05.873026] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-02T19:25:05.968666] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (3.30 seconds). [2025-10-02T19:25:05.973321] [INFO ] [REMOTE ] HLF: Full fetch complete (70862 records). [2025-10-02T19:25:05.973536] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-02T19:25:05.978930] [FATAL] [VALIDATOR ] HLF: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:05.979158] [FATAL] [MAIN ] HLF: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:05.979262] [WARN ] [MAIN ] HLF: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:05.979422] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-02T19:25:05.979546] [DEBUG] [LOCAL ] HLF: No primary data file found to delete. [2025-10-02T19:25:05.979664] [INFO ] [LOCAL ] HLF: Starting deletion of derivative data. [2025-10-02T19:25:05.979739] [DEBUG] [LOCAL ] HLF: No derivative data file found to delete. [2025-10-02T19:25:05.979846] [INFO ] [MAIN ] Update Progress: 1026/2370 symbols completed. HLF took 33.8s. Estimated remaining: 3h 9m 59s. Rate: 7.1 symbols/min [2025-10-02T19:25:06.193271] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:06.193577] [DEBUG] [LOCAL ] HLLY: No existing data file found in primary storage. [2025-10-02T19:25:06.193723] [WARN ] [MAIN ] HLLY: No existing data found, performing full refresh instead. [2025-10-02T19:25:06.193969] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-02T19:25:06.194042] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-02T19:25:06.194132] [DEBUG] [LOCAL ] HLLY: No primary data file found to delete. [2025-10-02T19:25:06.194220] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-02T19:25:06.614369] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:06.667865] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T19:25:06.670178] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-02T19:25:06.677462] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-10-02T19:25:07.473048] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-02T19:25:07.926793] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T19:25:08.273047] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-02T19:25:08.728450] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (2.86 seconds). [2025-10-02T19:25:08.730599] [INFO ] [REMOTE ] HLIO: Full fetch complete (36082 records). [2025-10-02T19:25:08.730857] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-02T19:25:08.755048] [FATAL] [VALIDATOR ] HLIO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:08.758483] [FATAL] [MAIN ] HLIO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:08.760309] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-02T19:25:08.759013] [WARN ] [MAIN ] HLIO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:08.769526] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-02T19:25:08.769959] [DEBUG] [LOCAL ] HLIO: No primary data file found to delete. [2025-10-02T19:25:08.770009] [INFO ] [LOCAL ] HLIO: Starting deletion of derivative data. [2025-10-02T19:25:08.770072] [DEBUG] [LOCAL ] HLIO: No derivative data file found to delete. [2025-10-02T19:25:08.770169] [INFO ] [MAIN ] Update Progress: 1027/2370 symbols completed. HLIO took 26.4s. Estimated remaining: 3h 9m 43s. Rate: 7.1 symbols/min [2025-10-02T19:25:08.964422] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:08.964668] [DEBUG] [LOCAL ] HLN: No existing data file found in primary storage. [2025-10-02T19:25:08.964727] [WARN ] [MAIN ] HLN: No existing data found, performing full refresh instead. [2025-10-02T19:25:08.964846] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-02T19:25:08.964913] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-02T19:25:08.964988] [DEBUG] [LOCAL ] HLN: No primary data file found to delete. [2025-10-02T19:25:08.965047] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-02T19:25:09.082521] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-02T19:25:09.388631] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:09.443450] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T19:25:09.872968] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-02T19:25:10.673008] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-02T19:25:10.729622] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-02T19:25:11.473064] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-10-02T19:25:12.002127] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T19:25:12.272999] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-02T19:25:12.848050] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (3.77 seconds). [2025-10-02T19:25:12.849958] [INFO ] [REMOTE ] HL: Full fetch complete (77267 records). [2025-10-02T19:25:12.850155] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-02T19:25:12.851267] [FATAL] [VALIDATOR ] HL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:12.851371] [FATAL] [MAIN ] HL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:12.851417] [WARN ] [MAIN ] HL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:12.851461] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-02T19:25:12.851544] [DEBUG] [LOCAL ] HL: No primary data file found to delete. [2025-10-02T19:25:12.851600] [INFO ] [LOCAL ] HL: Starting deletion of derivative data. [2025-10-02T19:25:12.851675] [DEBUG] [LOCAL ] HL: No derivative data file found to delete. [2025-10-02T19:25:12.851756] [INFO ] [MAIN ] Update Progress: 1028/2370 symbols completed. HL took 45.1s. Estimated remaining: 3h 9m 29s. Rate: 7.1 symbols/min [2025-10-02T19:25:13.051367] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:13.051562] [DEBUG] [LOCAL ] HLT: No existing data file found in primary storage. [2025-10-02T19:25:13.051627] [WARN ] [MAIN ] HLT: No existing data found, performing full refresh instead. [2025-10-02T19:25:13.051795] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-02T19:25:13.051857] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-02T19:25:13.051923] [DEBUG] [LOCAL ] HLT: No primary data file found to delete. [2025-10-02T19:25:13.052007] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-02T19:25:13.079693] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-02T19:25:13.458237] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-02T19:25:13.536544] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:13.873033] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-10-02T19:25:14.509055] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T19:25:14.673056] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-02T19:25:15.365589] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (3.09 seconds). [2025-10-02T19:25:15.368207] [INFO ] [REMOTE ] HLI: Full fetch complete (45164 records). [2025-10-02T19:25:15.368327] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-02T19:25:15.369190] [FATAL] [VALIDATOR ] HLI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:15.369281] [FATAL] [MAIN ] HLI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:15.369353] [WARN ] [MAIN ] HLI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:15.369441] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-02T19:25:15.369560] [DEBUG] [LOCAL ] HLI: No primary data file found to delete. [2025-10-02T19:25:15.369639] [INFO ] [LOCAL ] HLI: Starting deletion of derivative data. [2025-10-02T19:25:15.369738] [DEBUG] [LOCAL ] HLI: No derivative data file found to delete. [2025-10-02T19:25:15.369806] [INFO ] [MAIN ] Update Progress: 1029/2370 symbols completed. HLI took 35.4s. Estimated remaining: 3h 9m 13s. Rate: 7.1 symbols/min [2025-10-02T19:25:15.475555] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-02T19:25:15.570616] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:15.571083] [DEBUG] [LOCAL ] HLX: No existing data file found in primary storage. [2025-10-02T19:25:15.571259] [WARN ] [MAIN ] HLX: No existing data found, performing full refresh instead. [2025-10-02T19:25:15.571596] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-02T19:25:15.571699] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-02T19:25:15.571869] [DEBUG] [LOCAL ] HLX: No primary data file found to delete. [2025-10-02T19:25:15.571927] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-02T19:25:15.993738] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:16.023397] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-02T19:25:16.121256] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T19:25:16.273000] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-02T19:25:17.072981] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-02T19:25:17.278455] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T19:25:17.574615] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-02T19:25:17.872995] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-02T19:25:18.672984] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-10-02T19:25:18.819983] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T19:25:19.059593] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T19:25:19.472998] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-02T19:25:20.019334] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-10-02T19:25:20.272994] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-02T19:25:20.534161] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-02T19:25:21.073009] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-02T19:25:21.872287] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T19:25:21.875910] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-02T19:25:22.202912] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-02T19:25:22.673018] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-02T19:25:23.481767] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-02T19:25:23.484910] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T19:25:24.272985] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-02T19:25:24.392686] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T19:25:24.982276] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:25:25.073025] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-02T19:25:25.872968] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-02T19:25:26.071630] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T19:25:26.673017] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-02T19:25:26.880897] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T19:25:27.472966] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-02T19:25:27.512185] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:25:28.275827] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-02T19:25:28.282569] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-02T19:25:29.073016] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-02T19:25:29.310723] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T19:25:29.407359] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T19:25:29.873082] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-02T19:25:30.663111] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-02T19:25:30.674639] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-02T19:25:31.473029] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-02T19:25:31.516057] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:25:32.273005] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-02T19:25:32.477518] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:25:33.073025] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-02T19:25:33.933875] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-02T19:25:33.956225] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T19:25:34.381677] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (2.91 seconds). [2025-10-02T19:25:34.383334] [INFO ] [REMOTE ] HLLY: Full fetch complete (45982 records). [2025-10-02T19:25:34.383443] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-02T19:25:34.384162] [FATAL] [VALIDATOR ] HLLY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:34.384253] [FATAL] [MAIN ] HLLY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:34.384302] [WARN ] [MAIN ] HLLY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:34.384373] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-02T19:25:34.384447] [DEBUG] [LOCAL ] HLLY: No primary data file found to delete. [2025-10-02T19:25:34.384484] [INFO ] [LOCAL ] HLLY: Starting deletion of derivative data. [2025-10-02T19:25:34.384738] [DEBUG] [LOCAL ] HLLY: No derivative data file found to delete. [2025-10-02T19:25:34.384854] [INFO ] [MAIN ] Update Progress: 1030/2370 symbols completed. HLLY took 28.4s. Estimated remaining: 3h 9m 18s. Rate: 7.1 symbols/min [2025-10-02T19:25:34.582092] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:34.582356] [DEBUG] [LOCAL ] HMC: No existing data file found in primary storage. [2025-10-02T19:25:34.582457] [WARN ] [MAIN ] HMC: No existing data found, performing full refresh instead. [2025-10-02T19:25:34.582723] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-02T19:25:34.582906] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-02T19:25:34.583022] [DEBUG] [LOCAL ] HMC: No primary data file found to delete. [2025-10-02T19:25:34.583197] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-02T19:25:34.680912] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-02T19:25:34.976131] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:35.004235] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-02T19:25:35.472985] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-10-02T19:25:35.645810] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T19:25:36.279271] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-02T19:25:36.298596] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:25:37.072997] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-02T19:25:37.518058] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-10-02T19:25:37.873407] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-02T19:25:37.880447] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T19:25:38.673041] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-02T19:25:38.813515] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-02T19:25:39.473002] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-02T19:25:39.706033] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T19:25:40.244754] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T19:25:40.272963] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-02T19:25:40.860731] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T19:25:41.072999] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-02T19:25:41.872975] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-02T19:25:41.919141] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T19:25:42.326415] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T19:25:42.673012] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-02T19:25:43.473002] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-02T19:25:43.616459] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-10-02T19:25:44.272971] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-02T19:25:44.548252] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-02T19:25:45.073014] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-02T19:25:45.706135] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-02T19:25:45.872999] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-02T19:25:46.599161] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (3.13 seconds). [2025-10-02T19:25:46.600828] [INFO ] [REMOTE ] HLX: Full fetch complete (68917 records). [2025-10-02T19:25:46.600961] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-02T19:25:46.602264] [FATAL] [VALIDATOR ] HLX: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:46.602395] [FATAL] [MAIN ] HLX: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:46.602441] [WARN ] [MAIN ] HLX: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:46.602495] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-02T19:25:46.602580] [DEBUG] [LOCAL ] HLX: No primary data file found to delete. [2025-10-02T19:25:46.602625] [INFO ] [LOCAL ] HLX: Starting deletion of derivative data. [2025-10-02T19:25:46.602725] [DEBUG] [LOCAL ] HLX: No derivative data file found to delete. [2025-10-02T19:25:46.602812] [INFO ] [MAIN ] Update Progress: 1031/2370 symbols completed. HLX took 31.2s. Estimated remaining: 3h 9m 15s. Rate: 7.1 symbols/min [2025-10-02T19:25:46.678822] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-02T19:25:46.803991] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:46.804223] [DEBUG] [LOCAL ] HMN: No existing data file found in primary storage. [2025-10-02T19:25:46.804362] [WARN ] [MAIN ] HMN: No existing data found, performing full refresh instead. [2025-10-02T19:25:46.804533] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-02T19:25:46.804675] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-02T19:25:46.804788] [DEBUG] [LOCAL ] HMN: No primary data file found to delete. [2025-10-02T19:25:46.804858] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-02T19:25:47.149466] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-02T19:25:47.274038] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:47.473066] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-02T19:25:47.601124] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T19:25:48.272986] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-10-02T19:25:48.364286] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T19:25:49.072985] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-02T19:25:49.129164] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T19:25:49.873000] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-02T19:25:50.673048] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-02T19:25:50.743308] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (3.27 seconds). [2025-10-02T19:25:50.744890] [INFO ] [REMOTE ] HLN: Full fetch complete (76390 records). [2025-10-02T19:25:50.745019] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-02T19:25:50.746033] [FATAL] [VALIDATOR ] HLN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:50.746152] [FATAL] [MAIN ] HLN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:50.746230] [WARN ] [MAIN ] HLN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:50.746292] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-02T19:25:50.746362] [DEBUG] [LOCAL ] HLN: No primary data file found to delete. [2025-10-02T19:25:50.746405] [INFO ] [LOCAL ] HLN: Starting deletion of derivative data. [2025-10-02T19:25:50.746452] [DEBUG] [LOCAL ] HLN: No derivative data file found to delete. [2025-10-02T19:25:50.746514] [INFO ] [MAIN ] Update Progress: 1032/2370 symbols completed. HLN took 42.0s. Estimated remaining: 3h 9m 0s. Rate: 7.1 symbols/min [2025-10-02T19:25:50.929961] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:50.930154] [DEBUG] [LOCAL ] HMY: No existing data file found in primary storage. [2025-10-02T19:25:50.930210] [WARN ] [MAIN ] HMY: No existing data found, performing full refresh instead. [2025-10-02T19:25:50.930330] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-02T19:25:50.930373] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-02T19:25:50.930414] [DEBUG] [LOCAL ] HMY: No primary data file found to delete. [2025-10-02T19:25:50.930447] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-02T19:25:51.336344] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:51.484761] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-10-02T19:25:51.503236] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T19:25:51.640368] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T19:25:52.199067] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (3.13 seconds). [2025-10-02T19:25:52.200763] [INFO ] [REMOTE ] HLT: Full fetch complete (73057 records). [2025-10-02T19:25:52.200911] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-02T19:25:52.201814] [FATAL] [VALIDATOR ] HLT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:25:52.201904] [FATAL] [MAIN ] HLT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:25:52.201951] [WARN ] [MAIN ] HLT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:25:52.202067] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-02T19:25:52.202149] [DEBUG] [LOCAL ] HLT: No primary data file found to delete. [2025-10-02T19:25:52.202187] [INFO ] [LOCAL ] HLT: Starting deletion of derivative data. [2025-10-02T19:25:52.202228] [DEBUG] [LOCAL ] HLT: No derivative data file found to delete. [2025-10-02T19:25:52.202287] [INFO ] [MAIN ] Update Progress: 1033/2370 symbols completed. HLT took 39.4s. Estimated remaining: 3h 8m 43s. Rate: 7.1 symbols/min [2025-10-02T19:25:52.278205] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-02T19:25:52.397056] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:52.397231] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-02T19:25:52.397281] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-02T19:25:52.397428] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-02T19:25:52.397477] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-02T19:25:52.397534] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-02T19:25:52.397574] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-02T19:25:52.808709] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:53.073035] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-10-02T19:25:53.210563] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T19:25:53.261335] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:25:53.261630] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-10-02T19:25:53.261740] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:25:53.261794] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-02T19:25:53.261835] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:25:53.261875] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-02T19:25:53.261931] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-02T19:25:53.261966] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-02T19:25:53.262016] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-02T19:25:53.262064] [INFO ] [MAIN ] Update Progress: 1034/2370 symbols completed. HNGE took 1.1s. Estimated remaining: 3h 8m 25s. Rate: 7.1 symbols/min [2025-10-02T19:25:53.448284] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:25:53.448461] [DEBUG] [LOCAL ] HNI: No existing data file found in primary storage. [2025-10-02T19:25:53.448501] [WARN ] [MAIN ] HNI: No existing data found, performing full refresh instead. [2025-10-02T19:25:53.448615] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-02T19:25:53.448691] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-02T19:25:53.448753] [DEBUG] [LOCAL ] HNI: No primary data file found to delete. [2025-10-02T19:25:53.448787] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-02T19:25:53.878603] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-02T19:25:53.885803] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:25:53.990415] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T19:25:54.672972] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-02T19:25:54.973408] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T19:25:55.473010] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-02T19:25:56.272979] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-10-02T19:25:56.507244] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T19:25:56.532422] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T19:25:57.073018] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-02T19:25:57.604101] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T19:25:57.873179] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-02T19:25:58.200815] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-02T19:25:58.673019] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-02T19:25:59.472977] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-02T19:25:59.566440] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T19:25:59.827903] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T19:26:00.272993] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-02T19:26:00.993205] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T19:26:01.073018] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-02T19:26:01.808137] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T19:26:01.872989] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-02T19:26:02.099985] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T19:26:02.672278] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T19:26:02.677365] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-02T19:26:03.473039] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-02T19:26:04.273004] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-02T19:26:04.573114] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-02T19:26:04.675551] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T19:26:05.072997] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-02T19:26:05.629507] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T19:26:05.875279] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-02T19:26:05.882750] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-02T19:26:06.672995] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-02T19:26:07.472982] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-02T19:26:07.543253] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-02T19:26:08.272970] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-02T19:26:08.586639] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-02T19:26:09.073013] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-02T19:26:09.104954] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (3.23 seconds). [2025-10-02T19:26:09.106488] [INFO ] [REMOTE ] HMC: Full fetch complete (69074 records). [2025-10-02T19:26:09.106630] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-02T19:26:09.107589] [FATAL] [VALIDATOR ] HMC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:26:09.107836] [FATAL] [MAIN ] HMC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:26:09.107925] [WARN ] [MAIN ] HMC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:26:09.108003] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-02T19:26:09.108104] [DEBUG] [LOCAL ] HMC: No primary data file found to delete. [2025-10-02T19:26:09.108188] [INFO ] [LOCAL ] HMC: Starting deletion of derivative data. [2025-10-02T19:26:09.108264] [DEBUG] [LOCAL ] HMC: No derivative data file found to delete. [2025-10-02T19:26:09.108330] [INFO ] [MAIN ] Update Progress: 1035/2370 symbols completed. HMC took 34.7s. Estimated remaining: 3h 8m 26s. Rate: 7.1 symbols/min [2025-10-02T19:26:09.306434] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:26:09.306635] [DEBUG] [LOCAL ] HOG: No existing data file found in primary storage. [2025-10-02T19:26:09.306773] [WARN ] [MAIN ] HOG: No existing data found, performing full refresh instead. [2025-10-02T19:26:09.306901] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-02T19:26:09.306944] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-02T19:26:09.306987] [DEBUG] [LOCAL ] HOG: No primary data file found to delete. [2025-10-02T19:26:09.307058] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-02T19:26:09.527862] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T19:26:09.726017] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:26:09.873072] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-02T19:26:10.672975] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-02T19:26:10.869077] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T19:26:11.473065] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-10-02T19:26:12.110275] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T19:26:12.272995] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-02T19:26:12.472743] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-02T19:26:12.473773] [INFO ] [REMOTE ] HMN: Full fetch complete (31459 records). [2025-10-02T19:26:12.473849] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-02T19:26:12.474413] [FATAL] [VALIDATOR ] HMN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:26:12.474500] [FATAL] [MAIN ] HMN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:26:12.474549] [WARN ] [MAIN ] HMN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:26:12.474629] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-02T19:26:12.474757] [DEBUG] [LOCAL ] HMN: No primary data file found to delete. [2025-10-02T19:26:12.474806] [INFO ] [LOCAL ] HMN: Starting deletion of derivative data. [2025-10-02T19:26:12.474854] [DEBUG] [LOCAL ] HMN: No derivative data file found to delete. [2025-10-02T19:26:12.474913] [INFO ] [MAIN ] Update Progress: 1036/2370 symbols completed. HMN took 25.9s. Estimated remaining: 3h 8m 11s. Rate: 7.1 symbols/min [2025-10-02T19:26:12.669289] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:26:12.669490] [DEBUG] [LOCAL ] HOMB: No existing data file found in primary storage. [2025-10-02T19:26:12.669532] [WARN ] [MAIN ] HOMB: No existing data found, performing full refresh instead. [2025-10-02T19:26:12.669671] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-02T19:26:12.669731] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-02T19:26:12.669781] [DEBUG] [LOCAL ] HOMB: No primary data file found to delete. [2025-10-02T19:26:12.669868] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-02T19:26:13.083681] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-02T19:26:13.090542] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:26:13.125156] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T19:26:13.398760] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T19:26:13.873004] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-02T19:26:14.673006] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-02T19:26:15.185336] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-02T19:26:15.395614] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T19:26:15.473045] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-02T19:26:16.094587] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T19:26:16.273034] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-02T19:26:16.922537] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-02T19:26:17.073010] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-10-02T19:26:17.873046] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-02T19:26:18.568018] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T19:26:18.586853] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-02T19:26:18.673000] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-02T19:26:19.472988] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-02T19:26:19.635707] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T19:26:20.228973] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T19:26:20.272966] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-02T19:26:21.072984] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-02T19:26:21.417616] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T19:26:21.591375] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-10-02T19:26:21.873019] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-02T19:26:22.480499] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T19:26:22.672994] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-02T19:26:23.181393] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T19:26:23.473046] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-02T19:26:24.272991] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-02T19:26:24.492870] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T19:26:25.073002] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-02T19:26:25.873064] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-02T19:26:26.283293] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T19:26:26.421187] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (2.95 seconds). [2025-10-02T19:26:26.423622] [INFO ] [REMOTE ] HNI: Full fetch complete (41637 records). [2025-10-02T19:26:26.423967] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-02T19:26:26.425121] [FATAL] [VALIDATOR ] HNI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:26:26.425254] [FATAL] [MAIN ] HNI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:26:26.425353] [WARN ] [MAIN ] HNI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:26:26.425434] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-02T19:26:26.425503] [DEBUG] [LOCAL ] HNI: No primary data file found to delete. [2025-10-02T19:26:26.425540] [INFO ] [LOCAL ] HNI: Starting deletion of derivative data. [2025-10-02T19:26:26.425695] [DEBUG] [LOCAL ] HNI: No derivative data file found to delete. [2025-10-02T19:26:26.425789] [INFO ] [MAIN ] Update Progress: 1037/2370 symbols completed. HNI took 33.2s. Estimated remaining: 3h 8m 10s. Rate: 7.1 symbols/min [2025-10-02T19:26:26.673040] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-02T19:26:26.927910] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T19:26:27.200516] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-02T19:26:27.473018] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-02T19:26:28.273049] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-02T19:26:28.400320] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T19:26:28.615139] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-02T19:26:29.073038] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-02T19:26:29.677478] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:26:29.873030] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-02T19:26:30.673009] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-02T19:26:30.869222] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-02T19:26:31.473115] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-02T19:26:31.624995] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T19:26:31.901155] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T19:26:32.273013] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-02T19:26:33.073034] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-02T19:26:33.662019] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-10-02T19:26:33.872987] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-02T19:26:33.953213] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-02T19:26:34.673000] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-02T19:26:34.926688] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-02T19:26:35.473000] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-02T19:26:36.290289] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T19:26:36.299714] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-02T19:26:37.106194] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-02T19:26:37.117327] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-02T19:26:37.416136] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (3.54 seconds). [2025-10-02T19:26:37.417639] [INFO ] [REMOTE ] HMY: Full fetch complete (76341 records). [2025-10-02T19:26:37.417767] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-02T19:26:37.418582] [FATAL] [VALIDATOR ] HMY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:26:37.418695] [FATAL] [MAIN ] HMY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:26:37.418746] [WARN ] [MAIN ] HMY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:26:37.418854] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-02T19:26:37.418934] [DEBUG] [LOCAL ] HMY: No primary data file found to delete. [2025-10-02T19:26:37.418971] [INFO ] [LOCAL ] HMY: Starting deletion of derivative data. [2025-10-02T19:26:37.419016] [DEBUG] [LOCAL ] HMY: No derivative data file found to delete. [2025-10-02T19:26:37.419077] [INFO ] [MAIN ] Update Progress: 1038/2370 symbols completed. HMY took 46.7s. Estimated remaining: 3h 8m 4s. Rate: 7.1 symbols/min [2025-10-02T19:26:37.487349] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T19:26:37.873002] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-02T19:26:40.325106] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (3.21 seconds). [2025-10-02T19:26:40.327177] [INFO ] [REMOTE ] HOG: Full fetch complete (73808 records). [2025-10-02T19:26:40.327314] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-02T19:26:40.328524] [FATAL] [VALIDATOR ] HOG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:26:40.328619] [FATAL] [MAIN ] HOG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:26:40.328702] [WARN ] [MAIN ] HOG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:26:40.328755] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-02T19:26:40.328815] [DEBUG] [LOCAL ] HOG: No primary data file found to delete. [2025-10-02T19:26:40.328852] [INFO ] [LOCAL ] HOG: Starting deletion of derivative data. [2025-10-02T19:26:40.328895] [DEBUG] [LOCAL ] HOG: No derivative data file found to delete. [2025-10-02T19:26:40.328956] [INFO ] [MAIN ] Update Progress: 1039/2370 symbols completed. HOG took 31.2s. Estimated remaining: 3h 7m 49s. Rate: 7.1 symbols/min [2025-10-02T19:26:41.015278] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (3.14 seconds). [2025-10-02T19:26:41.016800] [INFO ] [REMOTE ] HOMB: Full fetch complete (63614 records). [2025-10-02T19:26:41.016905] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-02T19:26:41.017639] [FATAL] [VALIDATOR ] HOMB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:26:41.017760] [FATAL] [MAIN ] HOMB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:26:41.017807] [WARN ] [MAIN ] HOMB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:26:41.017889] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-02T19:26:41.017956] [DEBUG] [LOCAL ] HOMB: No primary data file found to delete. [2025-10-02T19:26:41.017994] [INFO ] [LOCAL ] HOMB: Starting deletion of derivative data. [2025-10-02T19:26:41.018037] [DEBUG] [LOCAL ] HOMB: No derivative data file found to delete. [2025-10-02T19:26:41.018222] [INFO ] [MAIN ] Update Progress: 1040/2370 symbols completed. HOMB took 28.5s. Estimated remaining: 3h 7m 30s. Rate: 7.1 symbols/min [2025-10-02T19:26:41.632732] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:26:41.692699] [DEBUG] [LOCAL ] HPE: No existing data file found in primary storage. [2025-10-02T19:26:41.717566] [WARN ] [MAIN ] HPE: No existing data found, performing full refresh instead. [2025-10-02T19:26:41.811732] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-02T19:26:41.811418] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:26:41.812847] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:26:41.818288] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-02T19:26:41.818387] [DEBUG] [LOCAL ] HOV: No existing data file found in primary storage. [2025-10-02T19:26:41.813017] [DEBUG] [LOCAL ] HP: No existing data file found in primary storage. [2025-10-02T19:26:41.854374] [DEBUG] [LOCAL ] HPE: No primary data file found to delete. [2025-10-02T19:26:41.854215] [WARN ] [MAIN ] HOV: No existing data found, performing full refresh instead. [2025-10-02T19:26:41.856964] [WARN ] [MAIN ] HP: No existing data found, performing full refresh instead. [2025-10-02T19:26:41.858524] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:26:41.858918] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-02T19:26:41.857230] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-02T19:26:41.864344] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-02T19:26:41.864585] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-02T19:26:41.876688] [DEBUG] [LOCAL ] HOUS: No existing data file found in primary storage. [2025-10-02T19:26:41.888581] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-02T19:26:41.876822] [DEBUG] [LOCAL ] HOV: No primary data file found to delete. [2025-10-02T19:26:41.894143] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-02T19:26:41.894324] [DEBUG] [LOCAL ] HP: No primary data file found to delete. [2025-10-02T19:26:41.894267] [WARN ] [MAIN ] HOUS: No existing data found, performing full refresh instead. [2025-10-02T19:26:41.939581] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-02T19:26:42.004343] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-02T19:26:42.089229] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-02T19:26:42.171545] [DEBUG] [LOCAL ] HOUS: No primary data file found to delete. [2025-10-02T19:26:42.213273] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-02T19:26:43.223886] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:26:43.251937] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-10-02T19:26:43.277374] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:26:43.303067] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-10-02T19:26:43.480553] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:26:43.491223] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-10-02T19:26:43.555285] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:26:43.555621] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-10-02T19:26:44.389598] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-10-02T19:26:44.393203] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-02T19:26:45.000867] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:26:45.010089] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-02T19:26:45.195255] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T19:26:45.209372] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-02T19:26:45.236844] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-02T19:26:45.240102] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-02T19:26:45.501554] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-02T19:26:45.512721] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-02T19:26:46.093892] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T19:26:46.110769] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-02T19:26:46.111733] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-02T19:26:46.672996] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-02T19:26:46.934332] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-02T19:26:47.441285] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T19:26:47.472985] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-02T19:26:47.627848] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:26:47.645047] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-02T19:26:48.272999] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-02T19:26:49.072983] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-02T19:26:49.122049] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T19:26:49.192866] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-02T19:26:49.873095] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-02T19:26:50.662045] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T19:26:50.672950] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-02T19:26:50.804541] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T19:26:51.472995] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-02T19:26:52.272996] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-02T19:26:52.428870] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-02T19:26:52.472288] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T19:26:53.072979] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-02T19:26:53.873000] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-02T19:26:54.150852] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T19:26:54.366992] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T19:26:54.672999] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-02T19:26:55.472988] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-02T19:26:55.534933] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T19:26:56.272964] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-02T19:26:56.824429] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-02T19:26:56.975996] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T19:26:57.073033] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-02T19:26:57.701029] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T19:26:57.873018] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-02T19:26:58.672974] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-02T19:26:58.713105] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:26:59.473043] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-02T19:26:59.851734] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-10-02T19:27:00.060041] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T19:27:00.273009] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-02T19:27:00.423500] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-02T19:27:01.073024] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-02T19:27:01.764251] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T19:27:01.816857] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T19:27:01.873036] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-02T19:27:02.673000] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-02T19:27:03.473012] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-02T19:27:04.272976] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-02T19:27:04.489507] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-02T19:27:04.602612] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (2.73 seconds). [2025-10-02T19:27:04.603538] [INFO ] [REMOTE ] HOV: Full fetch complete (19194 records). [2025-10-02T19:27:04.603680] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-02T19:27:04.604204] [FATAL] [VALIDATOR ] HOV: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:04.604284] [FATAL] [MAIN ] HOV: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:04.604351] [WARN ] [MAIN ] HOV: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:04.604427] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-02T19:27:04.604493] [DEBUG] [LOCAL ] HOV: No primary data file found to delete. [2025-10-02T19:27:04.604529] [INFO ] [LOCAL ] HOV: Starting deletion of derivative data. [2025-10-02T19:27:04.604569] [DEBUG] [LOCAL ] HOV: No derivative data file found to delete. [2025-10-02T19:27:04.604624] [INFO ] [MAIN ] Update Progress: 1041/2370 symbols completed. HOV took 23.6s. Estimated remaining: 3h 7m 41s. Rate: 7.1 symbols/min [2025-10-02T19:27:04.793563] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:04.793817] [DEBUG] [LOCAL ] HPF: No existing data file found in primary storage. [2025-10-02T19:27:04.793874] [WARN ] [MAIN ] HPF: No existing data found, performing full refresh instead. [2025-10-02T19:27:04.793987] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-02T19:27:04.794030] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-02T19:27:04.794073] [DEBUG] [LOCAL ] HPF: No primary data file found to delete. [2025-10-02T19:27:04.794113] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-02T19:27:05.076092] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-02T19:27:05.194123] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:05.414007] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-02T19:27:05.773986] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-02T19:27:05.873019] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-10-02T19:27:06.582282] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T19:27:06.641357] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T19:27:06.672984] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-02T19:27:07.274565] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T19:27:07.473005] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-02T19:27:08.133582] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-02T19:27:08.273045] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-02T19:27:09.073004] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-02T19:27:09.872998] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-02T19:27:09.920864] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T19:27:10.522521] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T19:27:10.672984] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-02T19:27:10.722259] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-02T19:27:11.364310] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-02T19:27:11.472985] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-02T19:27:12.273042] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-02T19:27:12.967635] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-02T19:27:13.004206] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T19:27:13.073017] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-02T19:27:13.872997] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-02T19:27:14.672995] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-02T19:27:15.214207] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-02T19:27:15.279851] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-02T19:27:15.477787] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-02T19:27:15.483933] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T19:27:16.273039] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-02T19:27:16.769766] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:27:16.771337] [INFO ] [REMOTE ] HP: Full fetch complete (73624 records). [2025-10-02T19:27:16.771453] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-02T19:27:16.772431] [FATAL] [VALIDATOR ] HP: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:16.772544] [FATAL] [MAIN ] HP: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:16.772756] [WARN ] [MAIN ] HP: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:16.772833] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-02T19:27:16.772901] [DEBUG] [LOCAL ] HP: No primary data file found to delete. [2025-10-02T19:27:16.772939] [INFO ] [LOCAL ] HP: Starting deletion of derivative data. [2025-10-02T19:27:16.772998] [DEBUG] [LOCAL ] HP: No derivative data file found to delete. [2025-10-02T19:27:16.773082] [INFO ] [MAIN ] Update Progress: 1042/2370 symbols completed. HP took 35.8s. Estimated remaining: 3h 7m 37s. Rate: 7.1 symbols/min [2025-10-02T19:27:16.954742] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:16.954911] [DEBUG] [LOCAL ] HPI: No existing data file found in primary storage. [2025-10-02T19:27:16.954950] [WARN ] [MAIN ] HPI: No existing data found, performing full refresh instead. [2025-10-02T19:27:16.955066] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-02T19:27:16.955112] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-02T19:27:16.955155] [DEBUG] [LOCAL ] HPI: No primary data file found to delete. [2025-10-02T19:27:16.955189] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-02T19:27:17.078154] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-02T19:27:17.356596] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:17.873040] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-02T19:27:17.949285] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-02T19:27:18.632247] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T19:27:18.673013] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-02T19:27:18.906967] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-02T19:27:19.387371] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-02T19:27:19.472990] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-02T19:27:20.273010] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-10-02T19:27:21.072490] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-10-02T19:27:21.074895] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-02T19:27:21.873047] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-02T19:27:22.260568] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T19:27:22.262839] [INFO ] [REMOTE ] HOUS: Full fetch complete (63152 records). [2025-10-02T19:27:22.262942] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-02T19:27:22.263771] [FATAL] [VALIDATOR ] HOUS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:22.263878] [FATAL] [MAIN ] HOUS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:22.263932] [WARN ] [MAIN ] HOUS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:22.264014] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-02T19:27:22.264096] [DEBUG] [LOCAL ] HOUS: No primary data file found to delete. [2025-10-02T19:27:22.264191] [INFO ] [LOCAL ] HOUS: Starting deletion of derivative data. [2025-10-02T19:27:22.264257] [DEBUG] [LOCAL ] HOUS: No derivative data file found to delete. [2025-10-02T19:27:22.264339] [INFO ] [MAIN ] Update Progress: 1043/2370 symbols completed. HOUS took 41.2s. Estimated remaining: 3h 7m 25s. Rate: 7.1 symbols/min [2025-10-02T19:27:22.470816] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-02T19:27:22.472927] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:22.475948] [DEBUG] [LOCAL ] HPP: No existing data file found in primary storage. [2025-10-02T19:27:22.476018] [WARN ] [MAIN ] HPP: No existing data found, performing full refresh instead. [2025-10-02T19:27:22.476143] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-02T19:27:22.476188] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-02T19:27:22.476233] [DEBUG] [LOCAL ] HPP: No primary data file found to delete. [2025-10-02T19:27:22.476268] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-02T19:27:22.680967] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-02T19:27:22.881975] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:23.091548] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (3.62 seconds). [2025-10-02T19:27:23.093130] [INFO ] [REMOTE ] HPE: Full fetch complete (77342 records). [2025-10-02T19:27:23.093227] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-02T19:27:23.094313] [FATAL] [VALIDATOR ] HPE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:23.094415] [FATAL] [MAIN ] HPE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:23.094469] [WARN ] [MAIN ] HPE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:23.094540] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-02T19:27:23.094687] [DEBUG] [LOCAL ] HPE: No primary data file found to delete. [2025-10-02T19:27:23.094776] [INFO ] [LOCAL ] HPE: Starting deletion of derivative data. [2025-10-02T19:27:23.094833] [DEBUG] [LOCAL ] HPE: No derivative data file found to delete. [2025-10-02T19:27:23.094901] [INFO ] [MAIN ] Update Progress: 1044/2370 symbols completed. HPE took 42.1s. Estimated remaining: 3h 7m 7s. Rate: 7.1 symbols/min [2025-10-02T19:27:23.288844] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:23.289128] [DEBUG] [LOCAL ] HPQ: No existing data file found in primary storage. [2025-10-02T19:27:23.289180] [WARN ] [MAIN ] HPQ: No existing data found, performing full refresh instead. [2025-10-02T19:27:23.289299] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-02T19:27:23.289341] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-02T19:27:23.289384] [DEBUG] [LOCAL ] HPQ: No primary data file found to delete. [2025-10-02T19:27:23.289418] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-02T19:27:23.474959] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-10-02T19:27:23.605744] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T19:27:23.747294] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:24.273017] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-02T19:27:24.871929] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T19:27:25.072993] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-02T19:27:25.232051] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T19:27:25.508979] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-02T19:27:25.509925] [INFO ] [REMOTE ] HPF: Full fetch complete (10762 records). [2025-10-02T19:27:25.510061] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-02T19:27:25.510599] [FATAL] [VALIDATOR ] HPF: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:25.510725] [FATAL] [MAIN ] HPF: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:25.510792] [WARN ] [MAIN ] HPF: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:25.510879] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-02T19:27:25.510958] [DEBUG] [LOCAL ] HPF: No primary data file found to delete. [2025-10-02T19:27:25.511031] [INFO ] [LOCAL ] HPF: Starting deletion of derivative data. [2025-10-02T19:27:25.511114] [DEBUG] [LOCAL ] HPF: No derivative data file found to delete. [2025-10-02T19:27:25.511188] [INFO ] [MAIN ] Update Progress: 1045/2370 symbols completed. HPF took 20.9s. Estimated remaining: 3h 6m 51s. Rate: 7.1 symbols/min [2025-10-02T19:27:25.706540] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:25.706771] [DEBUG] [LOCAL ] HPS: No existing data file found in primary storage. [2025-10-02T19:27:25.706829] [WARN ] [MAIN ] HPS: No existing data found, performing full refresh instead. [2025-10-02T19:27:25.706948] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-02T19:27:25.706991] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-02T19:27:25.707034] [DEBUG] [LOCAL ] HPS: No primary data file found to delete. [2025-10-02T19:27:25.707070] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-02T19:27:25.882676] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-02T19:27:26.089166] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:26.672991] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-10-02T19:27:26.704557] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T19:27:27.472987] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-02T19:27:28.264598] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-02T19:27:28.272946] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-02T19:27:28.568022] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T19:27:28.989389] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-02T19:27:29.073005] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-02T19:27:29.875219] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T19:27:29.873490] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-02T19:27:30.673022] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-02T19:27:31.438826] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T19:27:31.470473] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-02T19:27:31.480722] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-02T19:27:32.274121] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-02T19:27:32.277285] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T19:27:33.073221] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-02T19:27:33.754473] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T19:27:33.873013] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-02T19:27:34.043028] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T19:27:34.673023] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-10-02T19:27:35.376757] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T19:27:35.473009] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-02T19:27:35.559864] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T19:27:36.273010] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-02T19:27:36.921290] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T19:27:36.922178] [INFO ] [REMOTE ] HPI: Full fetch complete (13756 records). [2025-10-02T19:27:36.922251] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-02T19:27:36.922761] [FATAL] [VALIDATOR ] HPI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:36.922849] [FATAL] [MAIN ] HPI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:36.922893] [WARN ] [MAIN ] HPI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:36.922935] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-02T19:27:36.923006] [DEBUG] [LOCAL ] HPI: No primary data file found to delete. [2025-10-02T19:27:36.923060] [INFO ] [LOCAL ] HPI: Starting deletion of derivative data. [2025-10-02T19:27:36.923104] [DEBUG] [LOCAL ] HPI: No derivative data file found to delete. [2025-10-02T19:27:36.923159] [INFO ] [MAIN ] Update Progress: 1046/2370 symbols completed. HPI took 20.1s. Estimated remaining: 3h 6m 46s. Rate: 7.1 symbols/min [2025-10-02T19:27:37.084251] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-02T19:27:37.123342] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:37.123820] [DEBUG] [LOCAL ] HQH: No existing data file found in primary storage. [2025-10-02T19:27:37.123927] [WARN ] [MAIN ] HQH: No existing data found, performing full refresh instead. [2025-10-02T19:27:37.124115] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-02T19:27:37.124257] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-02T19:27:37.124459] [DEBUG] [LOCAL ] HQH: No primary data file found to delete. [2025-10-02T19:27:37.124523] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-02T19:27:37.478714] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-10-02T19:27:37.563139] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:37.873005] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-02T19:27:37.884044] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T19:27:38.673033] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-02T19:27:39.473000] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-10-02T19:27:39.908234] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-02T19:27:40.273052] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-02T19:27:40.360953] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T19:27:40.447345] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T19:27:41.055717] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T19:27:41.073000] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-02T19:27:41.873032] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-02T19:27:42.266000] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T19:27:42.427169] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-02T19:27:42.673055] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-02T19:27:43.417439] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-02T19:27:43.473006] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-02T19:27:44.271699] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-02T19:27:44.273966] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-02T19:27:45.073014] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-02T19:27:45.872974] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-02T19:27:45.970590] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T19:27:46.673016] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-02T19:27:46.747799] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T19:27:46.949676] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T19:27:47.473014] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-02T19:27:47.492466] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T19:27:48.272986] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-02T19:27:48.543252] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T19:27:49.073027] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-02T19:27:49.257542] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-02T19:27:49.872989] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-02T19:27:50.214537] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T19:27:50.646178] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-02T19:27:50.672998] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-02T19:27:51.480325] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-02T19:27:51.486429] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T19:27:52.272968] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-02T19:27:53.071097] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T19:27:53.073556] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-02T19:27:53.323214] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T19:27:53.872994] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-02T19:27:54.018599] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T19:27:54.673030] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-02T19:27:55.472981] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-02T19:27:55.662527] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-02T19:27:55.997511] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T19:27:55.998600] [INFO ] [REMOTE ] HPS: Full fetch complete (15218 records). [2025-10-02T19:27:56.022839] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-02T19:27:56.025172] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-02T19:27:56.025986] [FATAL] [VALIDATOR ] HPS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:27:56.033414] [FATAL] [MAIN ] HPS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:27:56.033708] [WARN ] [MAIN ] HPS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:27:56.033816] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-02T19:27:56.034323] [DEBUG] [LOCAL ] HPS: No primary data file found to delete. [2025-10-02T19:27:56.034396] [INFO ] [LOCAL ] HPS: Starting deletion of derivative data. [2025-10-02T19:27:56.034472] [DEBUG] [LOCAL ] HPS: No derivative data file found to delete. [2025-10-02T19:27:56.034609] [INFO ] [MAIN ] Update Progress: 1047/2370 symbols completed. HPS took 30.5s. Estimated remaining: 3h 6m 51s. Rate: 7.1 symbols/min [2025-10-02T19:27:56.228757] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:27:56.228962] [DEBUG] [LOCAL ] HQL: No existing data file found in primary storage. [2025-10-02T19:27:56.229006] [WARN ] [MAIN ] HQL: No existing data found, performing full refresh instead. [2025-10-02T19:27:56.229120] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-02T19:27:56.229175] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-02T19:27:56.229218] [DEBUG] [LOCAL ] HQL: No primary data file found to delete. [2025-10-02T19:27:56.229251] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-02T19:27:56.278217] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-02T19:27:56.622527] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:27:57.073019] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-10-02T19:27:57.873008] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-02T19:27:57.888559] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T19:27:58.461362] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-02T19:27:58.672998] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-02T19:27:59.087460] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T19:27:59.472999] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-02T19:28:00.273045] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-02T19:28:00.567136] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-02T19:28:01.076317] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-02T19:28:01.082224] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T19:28:01.502196] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T19:28:01.737116] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-02T19:28:01.873009] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-02T19:28:02.673019] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-02T19:28:02.748626] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T19:28:02.749865] [INFO ] [REMOTE ] HQH: Full fetch complete (37297 records). [2025-10-02T19:28:02.749945] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-02T19:28:02.750431] [FATAL] [VALIDATOR ] HQH: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:02.750517] [FATAL] [MAIN ] HQH: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:02.750562] [WARN ] [MAIN ] HQH: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:02.750601] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-02T19:28:02.750690] [DEBUG] [LOCAL ] HQH: No primary data file found to delete. [2025-10-02T19:28:02.750747] [INFO ] [LOCAL ] HQH: Starting deletion of derivative data. [2025-10-02T19:28:02.750792] [DEBUG] [LOCAL ] HQH: No derivative data file found to delete. [2025-10-02T19:28:02.751000] [INFO ] [MAIN ] Update Progress: 1048/2370 symbols completed. HQH took 25.8s. Estimated remaining: 3h 6m 40s. Rate: 7.1 symbols/min [2025-10-02T19:28:02.929616] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:02.929817] [DEBUG] [LOCAL ] HR: No existing data file found in primary storage. [2025-10-02T19:28:02.929873] [WARN ] [MAIN ] HR: No existing data found, performing full refresh instead. [2025-10-02T19:28:02.929987] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-02T19:28:02.930029] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-02T19:28:02.930081] [DEBUG] [LOCAL ] HR: No primary data file found to delete. [2025-10-02T19:28:02.930124] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-02T19:28:03.309979] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:03.473019] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-02T19:28:03.784759] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-02T19:28:04.273072] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-10-02T19:28:05.072985] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-02T19:28:05.218597] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-02T19:28:05.724914] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:28:05.873039] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-02T19:28:06.421124] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T19:28:06.673001] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-02T19:28:07.307147] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T19:28:07.473047] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-02T19:28:08.273013] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-02T19:28:08.485745] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-10-02T19:28:09.073015] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-02T19:28:09.264488] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T19:28:09.873015] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-02T19:28:10.673026] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-02T19:28:10.757493] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T19:28:10.829989] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-02T19:28:10.981259] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (3.51 seconds). [2025-10-02T19:28:10.982978] [INFO ] [REMOTE ] HPQ: Full fetch complete (77279 records). [2025-10-02T19:28:10.983117] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-02T19:28:10.984103] [FATAL] [VALIDATOR ] HPQ: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:10.984226] [FATAL] [MAIN ] HPQ: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:10.984272] [WARN ] [MAIN ] HPQ: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:10.984340] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-02T19:28:10.984414] [DEBUG] [LOCAL ] HPQ: No primary data file found to delete. [2025-10-02T19:28:10.984453] [INFO ] [LOCAL ] HPQ: Starting deletion of derivative data. [2025-10-02T19:28:10.984494] [DEBUG] [LOCAL ] HPQ: No derivative data file found to delete. [2025-10-02T19:28:10.984554] [INFO ] [MAIN ] Update Progress: 1049/2370 symbols completed. HPQ took 47.9s. Estimated remaining: 3h 6m 32s. Rate: 7.1 symbols/min [2025-10-02T19:28:11.172033] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:11.172217] [DEBUG] [LOCAL ] HRB: No existing data file found in primary storage. [2025-10-02T19:28:11.172257] [WARN ] [MAIN ] HRB: No existing data found, performing full refresh instead. [2025-10-02T19:28:11.172382] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-02T19:28:11.172424] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-02T19:28:11.172465] [DEBUG] [LOCAL ] HRB: No primary data file found to delete. [2025-10-02T19:28:11.172499] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-02T19:28:11.478093] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-02T19:28:11.568776] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:12.273041] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-02T19:28:12.344127] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T19:28:12.479032] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T19:28:13.073016] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-02T19:28:13.872960] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-10-02T19:28:13.964612] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-02T19:28:14.004578] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T19:28:14.673108] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-02T19:28:15.472962] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-02T19:28:15.577696] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-10-02T19:28:16.273031] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-02T19:28:16.411969] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T19:28:16.888308] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T19:28:16.990847] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T19:28:17.072969] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-02T19:28:17.872980] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-02T19:28:18.094681] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T19:28:18.673038] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-02T19:28:19.338694] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-02T19:28:19.473010] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-02T19:28:20.272996] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-02T19:28:20.357817] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T19:28:20.487375] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-02T19:28:21.073018] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-02T19:28:21.873094] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-02T19:28:21.930123] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T19:28:22.673062] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-02T19:28:23.473049] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-02T19:28:23.610894] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T19:28:23.825892] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (2.75 seconds). [2025-10-02T19:28:23.827171] [INFO ] [REMOTE ] HQL: Full fetch complete (24671 records). [2025-10-02T19:28:23.827289] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-02T19:28:23.828106] [FATAL] [VALIDATOR ] HQL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:23.828236] [FATAL] [MAIN ] HQL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:23.828294] [WARN ] [MAIN ] HQL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:23.828379] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-02T19:28:23.828476] [DEBUG] [LOCAL ] HQL: No primary data file found to delete. [2025-10-02T19:28:23.828557] [INFO ] [LOCAL ] HQL: Starting deletion of derivative data. [2025-10-02T19:28:23.828629] [DEBUG] [LOCAL ] HQL: No derivative data file found to delete. [2025-10-02T19:28:23.828769] [INFO ] [MAIN ] Update Progress: 1050/2370 symbols completed. HQL took 27.8s. Estimated remaining: 3h 6m 29s. Rate: 7.1 symbols/min [2025-10-02T19:28:24.028319] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:24.028510] [DEBUG] [LOCAL ] HRI: No existing data file found in primary storage. [2025-10-02T19:28:24.028565] [WARN ] [MAIN ] HRI: No existing data found, performing full refresh instead. [2025-10-02T19:28:24.028707] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-02T19:28:24.028760] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-02T19:28:24.028804] [DEBUG] [LOCAL ] HRI: No primary data file found to delete. [2025-10-02T19:28:24.028841] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-02T19:28:24.275589] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-02T19:28:24.463958] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:24.497491] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:28:24.666902] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T19:28:24.668809] [INFO ] [REMOTE ] HPP: Full fetch complete (73003 records). [2025-10-02T19:28:24.668924] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-02T19:28:24.669949] [FATAL] [VALIDATOR ] HPP: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:24.670048] [FATAL] [MAIN ] HPP: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:24.670093] [WARN ] [MAIN ] HPP: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:24.670135] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-02T19:28:24.670194] [DEBUG] [LOCAL ] HPP: No primary data file found to delete. [2025-10-02T19:28:24.670230] [INFO ] [LOCAL ] HPP: Starting deletion of derivative data. [2025-10-02T19:28:24.670313] [DEBUG] [LOCAL ] HPP: No derivative data file found to delete. [2025-10-02T19:28:24.670417] [INFO ] [MAIN ] Update Progress: 1051/2370 symbols completed. HPP took 1m 2s. Estimated remaining: 3h 6m 11s. Rate: 7.1 symbols/min [2025-10-02T19:28:24.874838] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:24.875028] [DEBUG] [LOCAL ] HRL: No existing data file found in primary storage. [2025-10-02T19:28:24.875066] [WARN ] [MAIN ] HRL: No existing data found, performing full refresh instead. [2025-10-02T19:28:24.875182] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-02T19:28:24.875223] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-02T19:28:24.875267] [DEBUG] [LOCAL ] HRL: No primary data file found to delete. [2025-10-02T19:28:24.875299] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-02T19:28:25.078157] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-02T19:28:25.269734] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:25.701705] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T19:28:25.872984] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-02T19:28:26.673055] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-10-02T19:28:26.965245] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T19:28:27.424141] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T19:28:27.472986] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-02T19:28:28.244605] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T19:28:28.273024] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-02T19:28:28.904994] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T19:28:29.073010] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-02T19:28:29.873070] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-10-02T19:28:29.936722] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-02T19:28:30.469856] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-02T19:28:30.475274] [INFO ] [REMOTE ] HR: Full fetch complete (74459 records). [2025-10-02T19:28:30.475397] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-02T19:28:30.480846] [FATAL] [VALIDATOR ] HR: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:30.481001] [FATAL] [MAIN ] HR: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:30.481048] [WARN ] [MAIN ] HR: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:30.481134] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-02T19:28:30.481241] [DEBUG] [LOCAL ] HR: No primary data file found to delete. [2025-10-02T19:28:30.481330] [INFO ] [LOCAL ] HR: Starting deletion of derivative data. [2025-10-02T19:28:30.481384] [DEBUG] [LOCAL ] HR: No derivative data file found to delete. [2025-10-02T19:28:30.481454] [INFO ] [MAIN ] Update Progress: 1052/2370 symbols completed. HR took 27.7s. Estimated remaining: 3h 5m 59s. Rate: 7.1 symbols/min [2025-10-02T19:28:30.665733] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:30.665911] [DEBUG] [LOCAL ] HRTG: No existing data file found in primary storage. [2025-10-02T19:28:30.665968] [WARN ] [MAIN ] HRTG: No existing data found, performing full refresh instead. [2025-10-02T19:28:30.666084] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-02T19:28:30.666129] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-02T19:28:30.666173] [DEBUG] [LOCAL ] HRTG: No primary data file found to delete. [2025-10-02T19:28:30.666220] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-02T19:28:30.678158] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-02T19:28:31.051827] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:31.068506] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-10-02T19:28:31.473002] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-02T19:28:32.273039] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-02T19:28:32.493609] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T19:28:32.728112] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T19:28:33.073005] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-02T19:28:33.769767] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:28:33.873001] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-02T19:28:34.479629] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T19:28:34.673066] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-02T19:28:35.482991] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-02T19:28:35.510103] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T19:28:36.130141] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T19:28:36.273048] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-02T19:28:37.074711] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-02T19:28:37.073026] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-02T19:28:37.461766] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T19:28:37.872993] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-02T19:28:38.303132] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T19:28:38.672994] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-02T19:28:39.227953] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T19:28:39.472994] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-10-02T19:28:40.272981] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-02T19:28:40.365343] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T19:28:40.544885] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T19:28:41.073013] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-02T19:28:41.872997] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-02T19:28:42.093044] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T19:28:42.409629] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T19:28:42.672992] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-02T19:28:42.978420] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-02T19:28:43.472985] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-02T19:28:44.200083] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T19:28:44.247046] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T19:28:44.273004] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-02T19:28:45.073000] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-02T19:28:45.680452] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T19:28:45.872999] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-02T19:28:46.487089] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:28:46.672996] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-02T19:28:47.478101] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-02T19:28:47.495268] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T19:28:47.826134] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:28:48.272986] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-02T19:28:49.072970] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-02T19:28:49.316495] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T19:28:49.652955] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T19:28:49.873041] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-02T19:28:50.673016] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-02T19:28:51.081978] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-02T19:28:51.473009] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-02T19:28:52.002278] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-02T19:28:52.093774] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (3.02 seconds). [2025-10-02T19:28:52.095308] [INFO ] [REMOTE ] HRB: Full fetch complete (69466 records). [2025-10-02T19:28:52.095413] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-02T19:28:52.096488] [FATAL] [VALIDATOR ] HRB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:52.096584] [FATAL] [MAIN ] HRB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:52.096631] [WARN ] [MAIN ] HRB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:52.096739] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-02T19:28:52.096823] [DEBUG] [LOCAL ] HRB: No primary data file found to delete. [2025-10-02T19:28:52.096863] [INFO ] [LOCAL ] HRB: Starting deletion of derivative data. [2025-10-02T19:28:52.096907] [DEBUG] [LOCAL ] HRB: No derivative data file found to delete. [2025-10-02T19:28:52.097037] [INFO ] [MAIN ] Update Progress: 1053/2370 symbols completed. HRB took 41.1s. Estimated remaining: 3h 6m 7s. Rate: 7.1 symbols/min [2025-10-02T19:28:52.278374] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-02T19:28:52.281257] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:52.282145] [DEBUG] [LOCAL ] HSBC: No existing data file found in primary storage. [2025-10-02T19:28:52.282229] [WARN ] [MAIN ] HSBC: No existing data found, performing full refresh instead. [2025-10-02T19:28:52.282316] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-02T19:28:52.282355] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-02T19:28:52.282400] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-10-02T19:28:52.282496] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-02T19:28:52.680938] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:52.702301] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T19:28:53.072984] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-02T19:28:53.830338] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T19:28:53.872965] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-02T19:28:54.438989] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T19:28:54.673044] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-02T19:28:55.479609] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-02T19:28:55.486513] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T19:28:56.054073] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T19:28:56.273046] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-02T19:28:56.832052] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T19:28:57.073008] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-10-02T19:28:57.684470] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:28:57.686192] [INFO ] [REMOTE ] HRL: Full fetch complete (76294 records). [2025-10-02T19:28:57.686330] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-02T19:28:57.687377] [FATAL] [VALIDATOR ] HRL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:28:57.687474] [FATAL] [MAIN ] HRL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:28:57.687539] [WARN ] [MAIN ] HRL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:28:57.687615] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-02T19:28:57.687715] [DEBUG] [LOCAL ] HRL: No primary data file found to delete. [2025-10-02T19:28:57.687764] [INFO ] [LOCAL ] HRL: Starting deletion of derivative data. [2025-10-02T19:28:57.687808] [DEBUG] [LOCAL ] HRL: No derivative data file found to delete. [2025-10-02T19:28:57.687881] [INFO ] [MAIN ] Update Progress: 1054/2370 symbols completed. HRL took 33.0s. Estimated remaining: 3h 5m 55s. Rate: 7.1 symbols/min [2025-10-02T19:28:57.885678] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-02T19:28:57.889619] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:28:57.890601] [DEBUG] [LOCAL ] HSHP: No existing data file found in primary storage. [2025-10-02T19:28:57.890702] [WARN ] [MAIN ] HSHP: No existing data found, performing full refresh instead. [2025-10-02T19:28:57.890876] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-02T19:28:57.890921] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-02T19:28:57.890965] [DEBUG] [LOCAL ] HSHP: No primary data file found to delete. [2025-10-02T19:28:57.890999] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-02T19:28:58.275526] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:28:58.673016] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-10-02T19:28:58.731546] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T19:28:59.472998] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-02T19:28:59.729268] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-10-02T19:29:00.273050] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-02T19:29:00.851837] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (2.97 seconds). [2025-10-02T19:29:00.853141] [INFO ] [REMOTE ] HRI: Full fetch complete (46046 records). [2025-10-02T19:29:00.853225] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-02T19:29:00.853937] [FATAL] [VALIDATOR ] HRI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:29:00.854026] [FATAL] [MAIN ] HRI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:29:00.854092] [WARN ] [MAIN ] HRI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:29:00.854185] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-02T19:29:00.854263] [DEBUG] [LOCAL ] HRI: No primary data file found to delete. [2025-10-02T19:29:00.854303] [INFO ] [LOCAL ] HRI: Starting deletion of derivative data. [2025-10-02T19:29:00.854346] [DEBUG] [LOCAL ] HRI: No derivative data file found to delete. [2025-10-02T19:29:00.854405] [INFO ] [MAIN ] Update Progress: 1055/2370 symbols completed. HRI took 37.0s. Estimated remaining: 3h 5m 40s. Rate: 7.1 symbols/min [2025-10-02T19:29:01.059068] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:01.059728] [DEBUG] [LOCAL ] HSY: No existing data file found in primary storage. [2025-10-02T19:29:01.059794] [WARN ] [MAIN ] HSY: No existing data found, performing full refresh instead. [2025-10-02T19:29:01.059916] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-02T19:29:01.059970] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-02T19:29:01.060028] [DEBUG] [LOCAL ] HSY: No primary data file found to delete. [2025-10-02T19:29:01.060088] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-02T19:29:01.093576] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-02T19:29:01.282168] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-02T19:29:01.521907] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:01.553235] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-02T19:29:01.873020] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-02T19:29:02.519822] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T19:29:02.673048] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-10-02T19:29:03.473037] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-02T19:29:03.725768] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-10-02T19:29:04.081125] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-02T19:29:04.272981] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-02T19:29:04.473798] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T19:29:05.072982] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-02T19:29:05.377977] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T19:29:05.873013] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-02T19:29:06.672973] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-02T19:29:06.711382] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T19:29:07.473034] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-02T19:29:07.653879] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T19:29:07.655631] [INFO ] [REMOTE ] HRTG: Full fetch complete (42773 records). [2025-10-02T19:29:07.655748] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-02T19:29:07.656322] [FATAL] [VALIDATOR ] HRTG: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:29:07.656420] [FATAL] [MAIN ] HRTG: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:29:07.656464] [WARN ] [MAIN ] HRTG: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:29:07.656504] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-02T19:29:07.656602] [DEBUG] [LOCAL ] HRTG: No primary data file found to delete. [2025-10-02T19:29:07.656701] [INFO ] [LOCAL ] HRTG: Starting deletion of derivative data. [2025-10-02T19:29:07.656933] [DEBUG] [LOCAL ] HRTG: No derivative data file found to delete. [2025-10-02T19:29:07.657110] [INFO ] [MAIN ] Update Progress: 1056/2370 symbols completed. HRTG took 37.2s. Estimated remaining: 3h 5m 29s. Rate: 7.1 symbols/min [2025-10-02T19:29:07.847168] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:07.847466] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-02T19:29:07.847538] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-02T19:29:07.847804] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-02T19:29:07.847866] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-02T19:29:07.847928] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-02T19:29:07.848074] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-02T19:29:08.091192] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-02T19:29:08.280387] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-02T19:29:08.326718] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:08.499068] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T19:29:09.073006] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-02T19:29:09.718703] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-02T19:29:09.873054] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-10-02T19:29:10.073478] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:29:10.074704] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-10-02T19:29:10.074826] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:29:10.074875] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-02T19:29:10.074910] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:29:10.074949] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-02T19:29:10.075021] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-02T19:29:10.075103] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-02T19:29:10.075209] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-02T19:29:10.075491] [INFO ] [MAIN ] Update Progress: 1057/2370 symbols completed. HTB took 2.4s. Estimated remaining: 3h 5m 13s. Rate: 7.1 symbols/min [2025-10-02T19:29:10.266199] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:10.266447] [DEBUG] [LOCAL ] HTD: No existing data file found in primary storage. [2025-10-02T19:29:10.266505] [WARN ] [MAIN ] HTD: No existing data found, performing full refresh instead. [2025-10-02T19:29:10.266665] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-02T19:29:10.266740] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-02T19:29:10.266806] [DEBUG] [LOCAL ] HTD: No primary data file found to delete. [2025-10-02T19:29:10.266843] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-02T19:29:10.654930] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:10.681832] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-02T19:29:10.687839] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-10-02T19:29:11.472972] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-10-02T19:29:11.690911] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:29:12.273001] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-02T19:29:12.361614] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-10-02T19:29:13.073011] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-02T19:29:13.872979] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-02T19:29:14.198443] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T19:29:14.199145] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T19:29:14.673052] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-02T19:29:14.761774] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-02T19:29:15.472994] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-02T19:29:15.500519] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T19:29:16.273043] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-02T19:29:16.871881] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T19:29:17.072994] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-02T19:29:17.381303] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-02T19:29:17.873049] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-02T19:29:18.003428] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-02T19:29:18.638020] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-02T19:29:18.673009] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-02T19:29:19.473011] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-02T19:29:19.576397] [DEBUG] [REMOTE ] HSY: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-10-02T19:29:19.576763] [WARN ] [REMOTE ] HSY: No data returned for month 2025-02 [2025-10-02T19:29:19.576876] [FATAL] [REMOTE ] HSY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:29:19.576965] [FATAL] [MAIN ] HSY: Failed to fetch primary data. [2025-10-02T19:29:19.577028] [WARN ] [MAIN ] HSY: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:29:19.577103] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-02T19:29:19.577167] [DEBUG] [LOCAL ] HSY: No primary data file found to delete. [2025-10-02T19:29:19.577205] [INFO ] [LOCAL ] HSY: Starting deletion of derivative data. [2025-10-02T19:29:19.577302] [DEBUG] [LOCAL ] HSY: No derivative data file found to delete. [2025-10-02T19:29:19.577369] [INFO ] [MAIN ] Update Progress: 1058/2370 symbols completed. HSY took 18.7s. Estimated remaining: 3h 5m 6s. Rate: 7.1 symbols/min [2025-10-02T19:29:19.839318] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:19.835609] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-02T19:29:19.843046] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-02T19:29:19.843148] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-02T19:29:19.843764] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-02T19:29:19.843855] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-02T19:29:19.843909] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-02T19:29:19.843944] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-02T19:29:20.242539] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:20.272996] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-02T19:29:21.009544] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T19:29:21.072979] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-02T19:29:21.873845] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T19:29:21.873599] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-02T19:29:21.876094] [INFO ] [REMOTE ] HSHP: Full fetch complete (23269 records). [2025-10-02T19:29:21.876203] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-02T19:29:21.876930] [FATAL] [VALIDATOR ] HSHP: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:29:21.877039] [FATAL] [MAIN ] HSHP: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:29:21.877127] [WARN ] [MAIN ] HSHP: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:29:21.877225] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-02T19:29:21.877455] [DEBUG] [LOCAL ] HSHP: No primary data file found to delete. [2025-10-02T19:29:21.877583] [INFO ] [LOCAL ] HSHP: Starting deletion of derivative data. [2025-10-02T19:29:21.877696] [DEBUG] [LOCAL ] HSHP: No derivative data file found to delete. [2025-10-02T19:29:21.877804] [INFO ] [MAIN ] Update Progress: 1059/2370 symbols completed. HSHP took 24.2s. Estimated remaining: 3h 4m 50s. Rate: 7.1 symbols/min [2025-10-02T19:29:22.061117] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:22.061279] [DEBUG] [LOCAL ] HTGC: No existing data file found in primary storage. [2025-10-02T19:29:22.061319] [WARN ] [MAIN ] HTGC: No existing data found, performing full refresh instead. [2025-10-02T19:29:22.061434] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-02T19:29:22.061476] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-02T19:29:22.061518] [DEBUG] [LOCAL ] HTGC: No primary data file found to delete. [2025-10-02T19:29:22.061551] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-02T19:29:22.448811] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:22.457365] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T19:29:22.673020] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-10-02T19:29:22.991966] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-10-02T19:29:23.472990] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-02T19:29:24.273018] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-10-02T19:29:25.072979] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-02T19:29:25.407513] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-10-02T19:29:25.449674] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T19:29:25.843915] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T19:29:25.872970] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-02T19:29:26.673024] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-02T19:29:27.472974] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-02T19:29:27.514351] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T19:29:27.832553] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-02T19:29:28.159416] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T19:29:28.273009] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-02T19:29:29.073034] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-02T19:29:29.872981] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-02T19:29:30.134938] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T19:29:30.612448] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T19:29:30.645486] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:29:30.672962] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-02T19:29:31.473000] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-02T19:29:32.272986] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-02T19:29:32.510621] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T19:29:32.755327] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T19:29:32.757137] [INFO ] [REMOTE ] HSBC: Full fetch complete (73368 records). [2025-10-02T19:29:32.757263] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-02T19:29:32.758480] [FATAL] [VALIDATOR ] HSBC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:29:32.758691] [FATAL] [MAIN ] HSBC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:29:32.758776] [WARN ] [MAIN ] HSBC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:29:32.758873] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-02T19:29:32.758972] [DEBUG] [LOCAL ] HSBC: No primary data file found to delete. [2025-10-02T19:29:32.759020] [INFO ] [LOCAL ] HSBC: Starting deletion of derivative data. [2025-10-02T19:29:32.759065] [DEBUG] [LOCAL ] HSBC: No derivative data file found to delete. [2025-10-02T19:29:32.759185] [INFO ] [MAIN ] Update Progress: 1060/2370 symbols completed. HSBC took 40.7s. Estimated remaining: 3h 4m 44s. Rate: 7.1 symbols/min [2025-10-02T19:29:32.962965] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:32.963127] [DEBUG] [LOCAL ] HTH: No existing data file found in primary storage. [2025-10-02T19:29:32.963165] [WARN ] [MAIN ] HTH: No existing data found, performing full refresh instead. [2025-10-02T19:29:32.963275] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-02T19:29:32.963317] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-02T19:29:32.963358] [DEBUG] [LOCAL ] HTH: No primary data file found to delete. [2025-10-02T19:29:32.963412] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-02T19:29:33.075523] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-02T19:29:33.249492] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T19:29:33.380189] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:33.442260] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-02T19:29:33.873006] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-02T19:29:34.673008] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-10-02T19:29:34.799063] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-02T19:29:35.473009] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-02T19:29:35.825564] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T19:29:36.160096] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-02T19:29:36.161213] [INFO ] [REMOTE ] HTD: Full fetch complete (18970 records). [2025-10-02T19:29:36.161289] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-02T19:29:36.161809] [FATAL] [VALIDATOR ] HTD: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:29:36.161920] [FATAL] [MAIN ] HTD: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:29:36.162001] [WARN ] [MAIN ] HTD: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:29:36.162104] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-02T19:29:36.162183] [DEBUG] [LOCAL ] HTD: No primary data file found to delete. [2025-10-02T19:29:36.162244] [INFO ] [LOCAL ] HTD: Starting deletion of derivative data. [2025-10-02T19:29:36.162305] [DEBUG] [LOCAL ] HTD: No derivative data file found to delete. [2025-10-02T19:29:36.162365] [INFO ] [MAIN ] Update Progress: 1061/2370 symbols completed. HTD took 26.1s. Estimated remaining: 3h 4m 30s. Rate: 7.1 symbols/min [2025-10-02T19:29:36.278271] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-02T19:29:36.368283] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:36.368502] [DEBUG] [LOCAL ] HUBB: No existing data file found in primary storage. [2025-10-02T19:29:36.368559] [WARN ] [MAIN ] HUBB: No existing data found, performing full refresh instead. [2025-10-02T19:29:36.368637] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-02T19:29:36.368717] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-02T19:29:36.368769] [DEBUG] [LOCAL ] HUBB: No primary data file found to delete. [2025-10-02T19:29:36.368806] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-02T19:29:36.766878] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:37.072998] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-02T19:29:37.873027] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-02T19:29:37.921079] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:29:38.136164] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T19:29:38.281518] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-02T19:29:38.673028] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-02T19:29:38.895967] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-02T19:29:39.472992] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-02T19:29:39.709394] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-02T19:29:40.272995] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-02T19:29:40.502203] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-02T19:29:41.073003] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-10-02T19:29:41.872988] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-02T19:29:42.385847] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T19:29:42.673006] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-02T19:29:43.472991] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-02T19:29:43.574153] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T19:29:44.284923] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-02T19:29:44.311841] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T19:29:44.518499] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-10-02T19:29:44.593273] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-02T19:29:45.072997] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-02T19:29:45.306452] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-02T19:29:45.872993] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-02T19:29:46.672999] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-02T19:29:47.472977] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-02T19:29:48.108754] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-02T19:29:48.109407] [INFO ] [REMOTE ] HTFC: Full fetch complete (833 records). [2025-10-02T19:29:48.109477] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-02T19:29:48.109871] [FATAL] [VALIDATOR ] HTFC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:29:48.109960] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:29:48.110004] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:29:48.110076] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-02T19:29:48.110138] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-02T19:29:48.110174] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-02T19:29:48.110241] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-02T19:29:48.110332] [INFO ] [MAIN ] Update Progress: 1062/2370 symbols completed. HTFC took 28.5s. Estimated remaining: 3h 4m 25s. Rate: 7.1 symbols/min [2025-10-02T19:29:48.277774] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-02T19:29:48.306596] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:29:48.307728] [DEBUG] [LOCAL ] HUBS: No existing data file found in primary storage. [2025-10-02T19:29:48.307872] [WARN ] [MAIN ] HUBS: No existing data found, performing full refresh instead. [2025-10-02T19:29:48.307998] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-02T19:29:48.308063] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-02T19:29:48.308110] [DEBUG] [LOCAL ] HUBS: No primary data file found to delete. [2025-10-02T19:29:48.308377] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-02T19:29:48.457970] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T19:29:48.767292] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:29:48.787370] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T19:29:49.073053] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-10-02T19:29:49.873053] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-02T19:29:50.464597] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T19:29:50.563200] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-10-02T19:29:50.672987] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-02T19:29:51.276753] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-02T19:29:51.473001] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-02T19:29:52.273031] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-02T19:29:52.331628] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T19:29:52.843701] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-02T19:29:53.073000] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-02T19:29:53.740820] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T19:29:53.873020] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-02T19:29:54.210375] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T19:29:54.673029] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-02T19:29:55.169908] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T19:29:55.473043] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-02T19:29:56.272987] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-02T19:29:56.431062] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T19:29:56.932946] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T19:29:57.073023] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-02T19:29:57.609165] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T19:29:57.872996] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-02T19:29:58.255013] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-02T19:29:58.673016] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-02T19:29:59.478007] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-02T19:29:59.483458] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T19:30:00.270595] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T19:30:00.279802] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-02T19:30:00.817198] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T19:30:01.072991] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-02T19:30:01.470950] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T19:30:01.473111] [INFO ] [REMOTE ] HTGC: Full fetch complete (67885 records). [2025-10-02T19:30:01.473436] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-02T19:30:01.474242] [FATAL] [VALIDATOR ] HTGC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:01.474343] [FATAL] [MAIN ] HTGC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:01.474392] [WARN ] [MAIN ] HTGC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:01.474437] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-02T19:30:01.474541] [DEBUG] [LOCAL ] HTGC: No primary data file found to delete. [2025-10-02T19:30:01.474595] [INFO ] [LOCAL ] HTGC: Starting deletion of derivative data. [2025-10-02T19:30:01.474671] [DEBUG] [LOCAL ] HTGC: No derivative data file found to delete. [2025-10-02T19:30:01.474771] [INFO ] [MAIN ] Update Progress: 1063/2370 symbols completed. HTGC took 39.6s. Estimated remaining: 3h 4m 23s. Rate: 7.1 symbols/min [2025-10-02T19:30:01.681509] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:01.681701] [DEBUG] [LOCAL ] HUM: No existing data file found in primary storage. [2025-10-02T19:30:01.681755] [WARN ] [MAIN ] HUM: No existing data found, performing full refresh instead. [2025-10-02T19:30:01.681871] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-02T19:30:01.681916] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-02T19:30:01.681960] [DEBUG] [LOCAL ] HUM: No primary data file found to delete. [2025-10-02T19:30:01.681996] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-02T19:30:01.878118] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-02T19:30:02.184452] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:02.218787] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T19:30:02.673060] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-10-02T19:30:03.473031] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-02T19:30:03.620758] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T19:30:04.272980] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-02T19:30:04.646156] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-10-02T19:30:05.038510] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T19:30:05.072988] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-02T19:30:05.873004] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-02T19:30:06.673020] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-02T19:30:06.844221] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T19:30:07.211380] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (2.94 seconds). [2025-10-02T19:30:07.212698] [INFO ] [REMOTE ] HTH: Full fetch complete (46521 records). [2025-10-02T19:30:07.212798] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-02T19:30:07.213453] [FATAL] [VALIDATOR ] HTH: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:07.213543] [FATAL] [MAIN ] HTH: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:07.213588] [WARN ] [MAIN ] HTH: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:07.213630] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-02T19:30:07.213782] [DEBUG] [LOCAL ] HTH: No primary data file found to delete. [2025-10-02T19:30:07.213835] [INFO ] [LOCAL ] HTH: Starting deletion of derivative data. [2025-10-02T19:30:07.213881] [DEBUG] [LOCAL ] HTH: No derivative data file found to delete. [2025-10-02T19:30:07.213969] [INFO ] [MAIN ] Update Progress: 1064/2370 symbols completed. HTH took 34.5s. Estimated remaining: 3h 4m 11s. Rate: 7.1 symbols/min [2025-10-02T19:30:07.420957] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:07.421185] [DEBUG] [LOCAL ] HUN: No existing data file found in primary storage. [2025-10-02T19:30:07.421250] [WARN ] [MAIN ] HUN: No existing data found, performing full refresh instead. [2025-10-02T19:30:07.421494] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-02T19:30:07.421569] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-02T19:30:07.421713] [DEBUG] [LOCAL ] HUN: No primary data file found to delete. [2025-10-02T19:30:07.421788] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-02T19:30:07.483097] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-02T19:30:07.700584] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-02T19:30:07.903555] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:07.927121] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T19:30:08.273007] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-02T19:30:08.975841] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T19:30:09.073053] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-02T19:30:09.712194] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T19:30:09.873019] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-02T19:30:10.649808] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:30:10.672955] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-02T19:30:11.472956] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-02T19:30:11.611407] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T19:30:12.099679] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:30:12.273043] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-02T19:30:13.053174] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:30:13.073002] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-10-02T19:30:13.792207] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T19:30:13.873011] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-02T19:30:14.450915] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:30:14.673041] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-02T19:30:15.473065] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-02T19:30:15.516834] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T19:30:16.273018] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-02T19:30:16.568225] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-02T19:30:16.589137] [INFO ] [REMOTE ] HUBB: Full fetch complete (53451 records). [2025-10-02T19:30:16.608121] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-02T19:30:16.609934] [FATAL] [VALIDATOR ] HUBB: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:16.613721] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T19:30:16.617936] [FATAL] [MAIN ] HUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:16.625074] [WARN ] [MAIN ] HUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:16.625359] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-02T19:30:16.625446] [DEBUG] [LOCAL ] HUBB: No primary data file found to delete. [2025-10-02T19:30:16.625488] [INFO ] [LOCAL ] HUBB: Starting deletion of derivative data. [2025-10-02T19:30:16.626134] [DEBUG] [LOCAL ] HUBB: No derivative data file found to delete. [2025-10-02T19:30:16.626432] [INFO ] [MAIN ] Update Progress: 1065/2370 symbols completed. HUBB took 40.5s. Estimated remaining: 3h 4m 4s. Rate: 7.1 symbols/min [2025-10-02T19:30:16.843499] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:16.843742] [DEBUG] [LOCAL ] HUYA: No existing data file found in primary storage. [2025-10-02T19:30:16.843798] [WARN ] [MAIN ] HUYA: No existing data found, performing full refresh instead. [2025-10-02T19:30:16.843952] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-02T19:30:16.844027] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-02T19:30:16.844089] [DEBUG] [LOCAL ] HUYA: No primary data file found to delete. [2025-10-02T19:30:16.844125] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-02T19:30:17.078318] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-02T19:30:17.247276] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:17.873025] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-02T19:30:17.973045] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:30:18.394131] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T19:30:18.673036] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-10-02T19:30:19.473064] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-02T19:30:19.779178] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-10-02T19:30:20.212875] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-10-02T19:30:20.273010] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-02T19:30:21.073053] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-02T19:30:21.764508] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:30:21.873072] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-02T19:30:22.444134] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:30:22.673031] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-02T19:30:22.690153] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (3.22 seconds). [2025-10-02T19:30:22.692319] [INFO ] [REMOTE ] HUBS: Full fetch complete (55284 records). [2025-10-02T19:30:22.692478] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-02T19:30:22.693448] [FATAL] [VALIDATOR ] HUBS: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:22.693558] [FATAL] [MAIN ] HUBS: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:22.693631] [WARN ] [MAIN ] HUBS: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:22.693755] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-02T19:30:22.693842] [DEBUG] [LOCAL ] HUBS: No primary data file found to delete. [2025-10-02T19:30:22.693883] [INFO ] [LOCAL ] HUBS: Starting deletion of derivative data. [2025-10-02T19:30:22.693926] [DEBUG] [LOCAL ] HUBS: No derivative data file found to delete. [2025-10-02T19:30:22.693999] [INFO ] [MAIN ] Update Progress: 1066/2370 symbols completed. HUBS took 34.6s. Estimated remaining: 3h 3m 52s. Rate: 7.1 symbols/min [2025-10-02T19:30:22.878535] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:22.878856] [DEBUG] [LOCAL ] HVT: No existing data file found in primary storage. [2025-10-02T19:30:22.878904] [WARN ] [MAIN ] HVT: No existing data found, performing full refresh instead. [2025-10-02T19:30:22.879044] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-02T19:30:22.879122] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-02T19:30:22.879167] [DEBUG] [LOCAL ] HVT: No primary data file found to delete. [2025-10-02T19:30:22.879202] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-02T19:30:23.297895] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:23.473078] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-02T19:30:23.564760] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-02T19:30:24.273017] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-02T19:30:24.680503] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-02T19:30:24.898791] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:30:25.073008] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-02T19:30:25.873067] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-10-02T19:30:26.091978] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:30:26.673123] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-02T19:30:26.818238] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T19:30:26.878925] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T19:30:27.473040] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-02T19:30:28.191095] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T19:30:28.273051] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-02T19:30:28.613824] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T19:30:29.073010] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-02T19:30:29.726035] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T19:30:29.872989] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-02T19:30:30.100587] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-02T19:30:30.673053] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-02T19:30:31.472957] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-02T19:30:31.671434] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T19:30:32.273020] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-02T19:30:32.409392] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T19:30:32.948996] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T19:30:33.073008] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-02T19:30:33.609806] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T19:30:33.611381] [INFO ] [REMOTE ] HUM: Full fetch complete (70613 records). [2025-10-02T19:30:33.611484] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-02T19:30:33.612591] [FATAL] [VALIDATOR ] HUM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:33.612834] [FATAL] [MAIN ] HUM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:33.612905] [WARN ] [MAIN ] HUM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:33.612981] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-02T19:30:33.613049] [DEBUG] [LOCAL ] HUM: No primary data file found to delete. [2025-10-02T19:30:33.613129] [INFO ] [LOCAL ] HUM: Starting deletion of derivative data. [2025-10-02T19:30:33.613183] [DEBUG] [LOCAL ] HUM: No derivative data file found to delete. [2025-10-02T19:30:33.613291] [INFO ] [MAIN ] Update Progress: 1067/2370 symbols completed. HUM took 32.1s. Estimated remaining: 3h 3m 47s. Rate: 7.1 symbols/min [2025-10-02T19:30:33.805312] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:33.805523] [DEBUG] [LOCAL ] HWM: No existing data file found in primary storage. [2025-10-02T19:30:33.805579] [WARN ] [MAIN ] HWM: No existing data found, performing full refresh instead. [2025-10-02T19:30:33.805728] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-02T19:30:33.805778] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-02T19:30:33.805821] [DEBUG] [LOCAL ] HWM: No primary data file found to delete. [2025-10-02T19:30:33.805855] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-02T19:30:33.878350] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-02T19:30:34.233620] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:34.653825] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T19:30:34.672975] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-10-02T19:30:34.689036] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-02T19:30:35.473008] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-02T19:30:36.273040] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-02T19:30:36.679917] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-10-02T19:30:37.073049] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-02T19:30:37.211083] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-02T19:30:37.572252] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T19:30:37.873011] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-02T19:30:38.673017] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-02T19:30:38.693825] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T19:30:39.036950] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-10-02T19:30:39.473000] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-02T19:30:40.182821] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T19:30:40.272974] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-02T19:30:41.072998] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-02T19:30:41.303858] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-02T19:30:41.783860] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T19:30:41.872965] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-02T19:30:42.187959] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T19:30:42.672996] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-02T19:30:43.472998] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-02T19:30:43.679023] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-02T19:30:44.272961] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-02T19:30:44.486025] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T19:30:45.080976] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-02T19:30:45.088840] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T19:30:45.698015] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T19:30:45.795759] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-02T19:30:45.873008] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-02T19:30:46.673003] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-02T19:30:46.774173] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T19:30:47.473040] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-02T19:30:47.804155] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T19:30:47.805668] [INFO ] [REMOTE ] HUYA: Full fetch complete (63286 records). [2025-10-02T19:30:47.805782] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-02T19:30:47.806533] [FATAL] [VALIDATOR ] HUYA: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:47.806633] [FATAL] [MAIN ] HUYA: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:47.806720] [WARN ] [MAIN ] HUYA: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:47.806768] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-02T19:30:47.806826] [DEBUG] [LOCAL ] HUYA: No primary data file found to delete. [2025-10-02T19:30:47.806862] [INFO ] [LOCAL ] HUYA: Starting deletion of derivative data. [2025-10-02T19:30:47.806902] [DEBUG] [LOCAL ] HUYA: No derivative data file found to delete. [2025-10-02T19:30:47.807025] [INFO ] [MAIN ] Update Progress: 1068/2370 symbols completed. HUYA took 31.2s. Estimated remaining: 3h 3m 46s. Rate: 7.1 symbols/min [2025-10-02T19:30:47.989663] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:47.989879] [DEBUG] [LOCAL ] HXL: No existing data file found in primary storage. [2025-10-02T19:30:47.989935] [WARN ] [MAIN ] HXL: No existing data found, performing full refresh instead. [2025-10-02T19:30:47.990052] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-02T19:30:47.990095] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-02T19:30:47.990138] [DEBUG] [LOCAL ] HXL: No primary data file found to delete. [2025-10-02T19:30:47.990171] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-02T19:30:48.278145] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-02T19:30:48.373354] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:49.073011] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-02T19:30:49.117562] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:30:49.641319] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T19:30:49.642980] [INFO ] [REMOTE ] HUN: Full fetch complete (76304 records). [2025-10-02T19:30:49.643095] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-02T19:30:49.643958] [FATAL] [VALIDATOR ] HUN: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:49.644049] [FATAL] [MAIN ] HUN: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:49.644095] [WARN ] [MAIN ] HUN: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:49.644138] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-02T19:30:49.644233] [DEBUG] [LOCAL ] HUN: No primary data file found to delete. [2025-10-02T19:30:49.644290] [INFO ] [LOCAL ] HUN: Starting deletion of derivative data. [2025-10-02T19:30:49.644350] [DEBUG] [LOCAL ] HUN: No derivative data file found to delete. [2025-10-02T19:30:49.644432] [INFO ] [MAIN ] Update Progress: 1069/2370 symbols completed. HUN took 42.4s. Estimated remaining: 3h 3m 29s. Rate: 7.1 symbols/min [2025-10-02T19:30:49.845720] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:49.846025] [DEBUG] [LOCAL ] HY: No existing data file found in primary storage. [2025-10-02T19:30:49.846117] [WARN ] [MAIN ] HY: No existing data found, performing full refresh instead. [2025-10-02T19:30:49.846207] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-02T19:30:49.846247] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-02T19:30:49.846292] [DEBUG] [LOCAL ] HY: No primary data file found to delete. [2025-10-02T19:30:49.846327] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-02T19:30:49.880727] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-10-02T19:30:50.176914] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T19:30:50.270446] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:50.673050] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-02T19:30:51.338854] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T19:30:51.467870] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T19:30:51.476210] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-02T19:30:52.273012] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-02T19:30:53.073009] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-02T19:30:53.157093] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T19:30:53.179098] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T19:30:53.873007] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-02T19:30:54.475825] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T19:30:54.476837] [INFO ] [REMOTE ] HVT: Full fetch complete (23337 records). [2025-10-02T19:30:54.476913] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-02T19:30:54.477542] [FATAL] [VALIDATOR ] HVT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:30:54.477699] [FATAL] [MAIN ] HVT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:30:54.477772] [WARN ] [MAIN ] HVT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:30:54.477861] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-02T19:30:54.477958] [DEBUG] [LOCAL ] HVT: No primary data file found to delete. [2025-10-02T19:30:54.478026] [INFO ] [LOCAL ] HVT: Starting deletion of derivative data. [2025-10-02T19:30:54.478118] [DEBUG] [LOCAL ] HVT: No derivative data file found to delete. [2025-10-02T19:30:54.478259] [INFO ] [MAIN ] Update Progress: 1070/2370 symbols completed. HVT took 31.8s. Estimated remaining: 3h 3m 16s. Rate: 7.1 symbols/min [2025-10-02T19:30:54.669262] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:30:54.669480] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-02T19:30:54.669556] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-02T19:30:54.669755] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-02T19:30:54.669898] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-02T19:30:54.670056] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-02T19:30:54.670115] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-02T19:30:54.675401] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-10-02T19:30:55.014216] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T19:30:55.111434] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:30:55.472993] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-02T19:30:55.523141] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-10-02T19:30:56.273050] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-02T19:30:57.043621] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T19:30:57.072253] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T19:30:57.074856] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-02T19:30:57.873005] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-02T19:30:58.657884] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T19:30:58.672979] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-02T19:30:59.097773] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-02T19:30:59.473036] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-02T19:30:59.551298] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-02T19:31:00.273004] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-10-02T19:31:00.566191] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-10-02T19:31:01.072973] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-02T19:31:01.414271] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-02T19:31:01.749018] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-02T19:31:01.873025] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-02T19:31:02.673040] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-02T19:31:03.473011] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-02T19:31:03.950569] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-02T19:31:04.203232] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T19:31:04.229926] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T19:31:04.272994] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-02T19:31:05.073035] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-02T19:31:05.872993] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-02T19:31:06.008234] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T19:31:06.132671] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-10-02T19:31:06.463750] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-02T19:31:06.465470] [INFO ] [REMOTE ] HWM: Full fetch complete (76237 records). [2025-10-02T19:31:06.465628] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-02T19:31:06.466717] [FATAL] [VALIDATOR ] HWM: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:31:06.466841] [FATAL] [MAIN ] HWM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:31:06.466900] [WARN ] [MAIN ] HWM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:31:06.466946] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-02T19:31:06.467019] [DEBUG] [LOCAL ] HWM: No primary data file found to delete. [2025-10-02T19:31:06.467079] [INFO ] [LOCAL ] HWM: Starting deletion of derivative data. [2025-10-02T19:31:06.467125] [DEBUG] [LOCAL ] HWM: No derivative data file found to delete. [2025-10-02T19:31:06.467247] [INFO ] [MAIN ] Update Progress: 1071/2370 symbols completed. HWM took 32.9s. Estimated remaining: 3h 3m 12s. Rate: 7.1 symbols/min [2025-10-02T19:31:06.663981] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:31:06.664148] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-02T19:31:06.664189] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-02T19:31:06.664316] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-02T19:31:06.664359] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-02T19:31:06.664407] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-02T19:31:06.664483] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-02T19:31:06.678093] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-02T19:31:07.069804] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:31:07.472977] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-10-02T19:31:07.503397] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T19:31:07.821633] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-02T19:31:08.272995] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-02T19:31:09.046852] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-02T19:31:09.072976] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-02T19:31:09.873000] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-02T19:31:09.903422] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T19:31:10.673016] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-02T19:31:10.993996] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-02T19:31:11.259747] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T19:31:11.473038] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-02T19:31:11.707718] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-02T19:31:12.273046] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-02T19:31:13.073006] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-02T19:31:13.124872] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-02T19:31:13.873014] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-02T19:31:14.117149] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-02T19:31:14.672992] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-02T19:31:14.793420] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T19:31:15.012552] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-02T19:31:15.473057] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-02T19:31:16.273012] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-02T19:31:16.588858] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-02T19:31:17.029863] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T19:31:17.073009] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-02T19:31:17.569371] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T19:31:17.570392] [INFO ] [REMOTE ] HY: Full fetch complete (15085 records). [2025-10-02T19:31:17.570469] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-02T19:31:17.570969] [FATAL] [VALIDATOR ] HY: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:31:17.571104] [FATAL] [MAIN ] HY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:31:17.571182] [WARN ] [MAIN ] HY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:31:17.571257] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-02T19:31:17.571320] [DEBUG] [LOCAL ] HY: No primary data file found to delete. [2025-10-02T19:31:17.571356] [INFO ] [LOCAL ] HY: Starting deletion of derivative data. [2025-10-02T19:31:17.571396] [DEBUG] [LOCAL ] HY: No derivative data file found to delete. [2025-10-02T19:31:17.571451] [INFO ] [MAIN ] Update Progress: 1072/2370 symbols completed. HY took 27.9s. Estimated remaining: 3h 3m 7s. Rate: 7.1 symbols/min [2025-10-02T19:31:17.762459] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:31:17.762699] [DEBUG] [LOCAL ] HYI: No existing data file found in primary storage. [2025-10-02T19:31:17.762772] [WARN ] [MAIN ] HYI: No existing data found, performing full refresh instead. [2025-10-02T19:31:17.762895] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-02T19:31:17.762937] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-02T19:31:17.762979] [DEBUG] [LOCAL ] HYI: No primary data file found to delete. [2025-10-02T19:31:17.763012] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-02T19:31:17.878124] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-02T19:31:18.172275] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:31:18.258574] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-02T19:31:18.673018] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-10-02T19:31:19.473024] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-02T19:31:19.583210] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-02T19:31:19.788164] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-02T19:31:20.273025] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-02T19:31:20.487295] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-10-02T19:31:21.073045] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-02T19:31:21.873001] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-02T19:31:22.194769] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-02T19:31:22.672979] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-02T19:31:22.840073] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T19:31:23.002032] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-02T19:31:23.472999] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-02T19:31:24.273009] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-02T19:31:24.988058] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-02T19:31:25.006313] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-02T19:31:25.073016] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-02T19:31:25.873023] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-02T19:31:26.211146] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-02T19:31:26.385791] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-02T19:31:26.673012] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-02T19:31:27.431000] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T19:31:27.473032] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-02T19:31:28.215478] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T19:31:28.273056] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-02T19:31:29.067716] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-02T19:31:29.072958] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-02T19:31:29.856951] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T19:31:29.872954] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-02T19:31:30.184397] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-02T19:31:30.673018] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-02T19:31:31.473027] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-02T19:31:31.745954] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T19:31:31.748432] [INFO ] [REMOTE ] HXL: Full fetch complete (65911 records). [2025-10-02T19:31:31.748585] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-02T19:31:31.749501] [FATAL] [VALIDATOR ] HXL: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:31:31.749621] [FATAL] [MAIN ] HXL: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:31:31.749730] [WARN ] [MAIN ] HXL: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:31:31.749862] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-02T19:31:31.749967] [DEBUG] [LOCAL ] HXL: No primary data file found to delete. [2025-10-02T19:31:31.750038] [INFO ] [LOCAL ] HXL: Starting deletion of derivative data. [2025-10-02T19:31:31.750111] [DEBUG] [LOCAL ] HXL: No derivative data file found to delete. [2025-10-02T19:31:31.750210] [INFO ] [MAIN ] Update Progress: 1073/2370 symbols completed. HXL took 43.9s. Estimated remaining: 3h 3m 5s. Rate: 7.1 symbols/min [2025-10-02T19:31:31.940308] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:31:31.941344] [DEBUG] [LOCAL ] HYT: No existing data file found in primary storage. [2025-10-02T19:31:31.941416] [WARN ] [MAIN ] HYT: No existing data found, performing full refresh instead. [2025-10-02T19:31:31.941630] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-02T19:31:31.941719] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-02T19:31:31.941777] [DEBUG] [LOCAL ] HYT: No primary data file found to delete. [2025-10-02T19:31:31.941824] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-02T19:31:32.044759] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T19:31:32.278079] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-02T19:31:32.343980] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:31:32.906902] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-02T19:31:33.072998] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-02T19:31:33.309591] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-02T19:31:33.873006] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-02T19:31:34.306950] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-02T19:31:34.673000] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-02T19:31:34.921272] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-02T19:31:35.473009] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-02T19:31:35.734202] [DEBUG] [REMOTE ] HYBX: Error fetching primary data for 2025-10: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:31:35.734667] [WARN ] [REMOTE ] HYBX: No data returned for month 2025-10 [2025-10-02T19:31:35.734782] [FATAL] [REMOTE ] HYBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:31:35.734910] [FATAL] [MAIN ] HYBX: Failed to fetch primary data. [2025-10-02T19:31:35.734990] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:31:35.735077] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-02T19:31:35.735204] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-02T19:31:35.735275] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-02T19:31:35.735336] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-02T19:31:35.735420] [INFO ] [MAIN ] Update Progress: 1074/2370 symbols completed. HYBX took 29.3s. Estimated remaining: 3h 2m 51s. Rate: 7.1 symbols/min [2025-10-02T19:31:35.958354] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:31:35.958553] [DEBUG] [LOCAL ] HYTR: No existing data file found in primary storage. [2025-10-02T19:31:35.958610] [WARN ] [MAIN ] HYTR: No existing data found, performing full refresh instead. [2025-10-02T19:31:35.958770] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-02T19:31:35.958826] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-02T19:31:35.958906] [DEBUG] [LOCAL ] HYTR: No primary data file found to delete. [2025-10-02T19:31:35.958954] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-02T19:31:36.278136] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-10-02T19:31:36.353622] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:31:37.073017] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-02T19:31:37.266732] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.19 seconds). [2025-10-02T19:31:37.545751] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T19:31:37.872994] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-02T19:31:38.673004] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-02T19:31:39.228223] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T19:31:39.472584] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T19:31:39.475571] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-02T19:31:40.272967] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-02T19:31:40.739201] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T19:31:40.752337] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T19:31:41.073079] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-02T19:31:41.872975] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-10-02T19:31:41.949572] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T19:31:42.319002] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-02T19:31:42.673003] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-02T19:31:43.473053] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-02T19:31:44.059626] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T19:31:44.060721] [INFO ] [REMOTE ] HYI: Full fetch complete (13450 records). [2025-10-02T19:31:44.060815] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-02T19:31:44.061280] [FATAL] [VALIDATOR ] HYI: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:31:44.061363] [FATAL] [MAIN ] HYI: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:31:44.061406] [WARN ] [MAIN ] HYI: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:31:44.061447] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-02T19:31:44.061503] [DEBUG] [LOCAL ] HYI: No primary data file found to delete. [2025-10-02T19:31:44.061538] [INFO ] [LOCAL ] HYI: Starting deletion of derivative data. [2025-10-02T19:31:44.061578] [DEBUG] [LOCAL ] HYI: No derivative data file found to delete. [2025-10-02T19:31:44.061674] [INFO ] [MAIN ] Update Progress: 1075/2370 symbols completed. HYI took 26.5s. Estimated remaining: 3h 2m 43s. Rate: 7.1 symbols/min [2025-10-02T19:31:44.221854] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T19:31:44.275152] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-02T19:31:44.293944] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:31:44.295253] [DEBUG] [LOCAL ] HZO: No existing data file found in primary storage. [2025-10-02T19:31:44.295340] [WARN ] [MAIN ] HZO: No existing data found, performing full refresh instead. [2025-10-02T19:31:44.295457] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-02T19:31:44.295527] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-02T19:31:44.295587] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-10-02T19:31:44.295622] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-02T19:31:44.670153] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:31:44.912288] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-02T19:31:45.072977] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-02T19:31:45.617544] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-02T19:31:45.873028] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-02T19:31:46.167304] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-10-02T19:31:46.168219] [INFO ] [REMOTE ] HYAC: Full fetch complete (855 records). [2025-10-02T19:31:46.168296] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-02T19:31:46.168743] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:31:46.168827] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:31:46.168898] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:31:46.168973] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-02T19:31:46.169036] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-02T19:31:46.169071] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-02T19:31:46.169110] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-02T19:31:46.169185] [INFO ] [MAIN ] Update Progress: 1076/2370 symbols completed. HYAC took 51.7s. Estimated remaining: 3h 2m 27s. Rate: 7.1 symbols/min [2025-10-02T19:31:46.357388] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:31:46.357581] [DEBUG] [LOCAL ] IAE: No existing data file found in primary storage. [2025-10-02T19:31:46.357700] [WARN ] [MAIN ] IAE: No existing data found, performing full refresh instead. [2025-10-02T19:31:46.357838] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-02T19:31:46.357885] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-02T19:31:46.357930] [DEBUG] [LOCAL ] IAE: No primary data file found to delete. [2025-10-02T19:31:46.357964] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-02T19:31:46.678119] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-02T19:31:46.747005] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:31:47.472999] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-10-02T19:31:48.220171] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T19:31:48.272990] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-10-02T19:31:48.568576] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T19:31:48.888419] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-02T19:31:49.073040] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-02T19:31:49.873016] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-02T19:31:50.398478] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-02T19:31:50.673003] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-02T19:31:50.957859] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-02T19:31:51.473036] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-02T19:31:52.128976] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T19:31:52.272981] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-02T19:31:52.613438] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T19:31:53.073050] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-02T19:31:53.407518] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T19:31:53.873015] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-02T19:31:54.453427] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-02T19:31:54.673025] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-02T19:31:54.935290] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T19:31:55.296242] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T19:31:55.472988] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-02T19:31:56.044443] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-02T19:31:56.273051] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-02T19:31:57.072980] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-02T19:31:57.630169] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-02T19:31:57.770907] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-02T19:31:57.872976] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-02T19:31:58.673040] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-02T19:31:59.010894] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T19:31:59.320508] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-02T19:31:59.473064] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-02T19:31:59.823938] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T19:32:00.273005] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-02T19:32:00.851346] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T19:32:01.073030] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-02T19:32:01.430708] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-02T19:32:01.873028] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-02T19:32:02.673017] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-02T19:32:03.279692] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-02T19:32:03.343413] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-02T19:32:03.472995] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-02T19:32:03.935323] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-02T19:32:04.273066] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-02T19:32:04.878899] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-02T19:32:05.073015] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-02T19:32:05.637579] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T19:32:05.872991] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-02T19:32:06.503703] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-02T19:32:06.673010] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-02T19:32:07.170123] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T19:32:07.472994] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-02T19:32:08.273010] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-02T19:32:08.628123] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-02T19:32:08.628923] [INFO ] [REMOTE ] HYTR: Full fetch complete (4508 records). [2025-10-02T19:32:08.629010] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-02T19:32:08.629781] [FATAL] [VALIDATOR ] HYTR: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:32:08.629871] [FATAL] [MAIN ] HYTR: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:32:08.629917] [WARN ] [MAIN ] HYTR: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:32:08.629993] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-02T19:32:08.630075] [DEBUG] [LOCAL ] HYTR: No primary data file found to delete. [2025-10-02T19:32:08.630113] [INFO ] [LOCAL ] HYTR: Starting deletion of derivative data. [2025-10-02T19:32:08.630154] [DEBUG] [LOCAL ] HYTR: No derivative data file found to delete. [2025-10-02T19:32:08.630218] [INFO ] [MAIN ] Update Progress: 1077/2370 symbols completed. HYTR took 32.9s. Estimated remaining: 3h 2m 35s. Rate: 7.1 symbols/min [2025-10-02T19:32:08.761916] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-02T19:32:09.073011] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-02T19:32:09.872993] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-02T19:32:10.584876] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-02T19:32:10.673002] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-02T19:32:11.323461] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T19:32:11.473004] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-02T19:32:11.993969] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-02T19:32:12.124714] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (3.05 seconds). [2025-10-02T19:32:12.126787] [INFO ] [REMOTE ] HYT: Full fetch complete (47304 records). [2025-10-02T19:32:12.126913] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-02T19:32:12.127623] [FATAL] [VALIDATOR ] HYT: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:32:12.127774] [FATAL] [MAIN ] HYT: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:32:12.127869] [WARN ] [MAIN ] HYT: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:32:12.127949] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-02T19:32:12.128028] [DEBUG] [LOCAL ] HYT: No primary data file found to delete. [2025-10-02T19:32:12.128071] [INFO ] [LOCAL ] HYT: Starting deletion of derivative data. [2025-10-02T19:32:12.128122] [DEBUG] [LOCAL ] HYT: No derivative data file found to delete. [2025-10-02T19:32:12.128243] [INFO ] [MAIN ] Update Progress: 1078/2370 symbols completed. HYT took 40.4s. Estimated remaining: 3h 2m 20s. Rate: 7.1 symbols/min [2025-10-02T19:32:12.273018] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-02T19:32:12.747818] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-02T19:32:12.749136] [INFO ] [REMOTE ] IAE: Full fetch complete (8625 records). [2025-10-02T19:32:12.749209] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-02T19:32:12.749585] [FATAL] [VALIDATOR ] IAE: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:32:12.749704] [FATAL] [MAIN ] IAE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:32:12.749755] [WARN ] [MAIN ] IAE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:32:12.749847] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-02T19:32:12.749913] [DEBUG] [LOCAL ] IAE: No primary data file found to delete. [2025-10-02T19:32:12.749950] [INFO ] [LOCAL ] IAE: Starting deletion of derivative data. [2025-10-02T19:32:12.749990] [DEBUG] [LOCAL ] IAE: No derivative data file found to delete. [2025-10-02T19:32:12.750045] [INFO ] [MAIN ] Update Progress: 1079/2370 symbols completed. IAE took 26.6s. Estimated remaining: 3h 2m 3s. Rate: 7.1 symbols/min [2025-10-02T19:32:13.073062] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-02T19:32:14.480775] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T19:32:14.487936] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-02T19:32:15.752868] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T19:32:15.760257] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-02T19:32:17.009105] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T19:32:17.016489] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-02T19:32:17.982367] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T19:32:17.983950] [INFO ] [REMOTE ] HZO: Full fetch complete (40838 records). [2025-10-02T19:32:17.984092] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-02T19:32:17.984861] [FATAL] [VALIDATOR ] HZO: Data is stale - most recent date (2025-10-01) is before last completed trading day (2025-10-02). Symbol may be delisted or halted. [2025-10-02T19:32:17.984969] [FATAL] [MAIN ] HZO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:32:17.985022] [WARN ] [MAIN ] HZO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:32:17.985071] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-02T19:32:17.985136] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-10-02T19:32:17.985179] [INFO ] [LOCAL ] HZO: Starting deletion of derivative data. [2025-10-02T19:32:17.985286] [DEBUG] [LOCAL ] HZO: No derivative data file found to delete. [2025-10-02T19:32:17.985407] [INFO ] [MAIN ] Update Progress: 1080/2370 symbols completed. HZO took 33.9s. Estimated remaining: 3h 1m 50s. Rate: 7.1 symbols/min [2025-10-02T19:32:18.626463] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:18.728086] [DEBUG] [LOCAL ] IBN: No existing data file found in primary storage. [2025-10-02T19:32:18.726417] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:18.728293] [WARN ] [MAIN ] IBN: No existing data found, performing full refresh instead. [2025-10-02T19:32:18.759874] [DEBUG] [LOCAL ] IAG: No existing data file found in primary storage. [2025-10-02T19:32:18.760090] [WARN ] [MAIN ] IAG: No existing data found, performing full refresh instead. [2025-10-02T19:32:18.782284] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-02T19:32:18.783522] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-02T19:32:18.783288] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:18.779333] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:18.783344] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-02T19:32:18.783789] [DEBUG] [LOCAL ] IBN: No primary data file found to delete. [2025-10-02T19:32:18.784188] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-02T19:32:18.784125] [DEBUG] [LOCAL ] IBP: No existing data file found in primary storage. [2025-10-02T19:32:18.784477] [WARN ] [MAIN ] IBP: No existing data found, performing full refresh instead. [2025-10-02T19:32:18.784252] [DEBUG] [LOCAL ] IBM: No existing data file found in primary storage. [2025-10-02T19:32:18.784806] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-02T19:32:18.784866] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-02T19:32:18.785037] [DEBUG] [LOCAL ] IAG: No primary data file found to delete. [2025-10-02T19:32:18.784721] [WARN ] [MAIN ] IBM: No existing data found, performing full refresh instead. [2025-10-02T19:32:18.796964] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-02T19:32:18.849470] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-02T19:32:18.807375] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-02T19:32:18.865747] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-02T19:32:18.914711] [DEBUG] [LOCAL ] IBM: No primary data file found to delete. [2025-10-02T19:32:18.998342] [DEBUG] [LOCAL ] IBP: No primary data file found to delete. [2025-10-02T19:32:19.002455] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-02T19:32:19.014466] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-02T19:32:20.163796] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:20.075373] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:20.191255] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-10-02T19:32:20.185865] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-10-02T19:32:20.441430] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:20.456416] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-10-02T19:32:20.456001] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:20.457977] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-10-02T19:32:21.853305] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T19:32:21.859633] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-02T19:32:22.029064] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-10-02T19:32:22.040493] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-02T19:32:22.116670] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T19:32:22.127922] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-02T19:32:22.655215] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-10-02T19:32:22.666698] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-02T19:32:22.768320] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T19:32:22.774720] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-02T19:32:23.388543] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T19:32:23.473004] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-02T19:32:23.873578] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T19:32:23.994306] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T19:32:24.273016] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-02T19:32:24.880037] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-10-02T19:32:25.049395] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T19:32:25.072954] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-02T19:32:25.621506] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-02T19:32:25.873019] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-02T19:32:26.672971] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-02T19:32:26.758872] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T19:32:27.344607] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T19:32:27.473009] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-02T19:32:28.134744] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-02T19:32:28.273052] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-02T19:32:28.867004] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-02T19:32:29.073010] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-02T19:32:29.873036] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-02T19:32:30.322636] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-10-02T19:32:30.526789] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T19:32:30.673006] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-02T19:32:31.473012] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-02T19:32:31.876135] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-10-02T19:32:32.273000] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-02T19:32:32.667596] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T19:32:33.018274] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T19:32:33.072997] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-02T19:32:33.532849] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T19:32:33.872993] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-02T19:32:34.672969] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-02T19:32:34.779806] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T19:32:35.224837] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T19:32:35.472995] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-02T19:32:36.011163] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T19:32:36.273024] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-02T19:32:37.072952] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-02T19:32:37.660836] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-02T19:32:37.717315] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T19:32:37.873000] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-02T19:32:38.672993] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-02T19:32:38.959197] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-10-02T19:32:39.473011] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-02T19:32:39.619700] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-02T19:32:40.183462] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-10-02T19:32:40.273028] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-02T19:32:40.855934] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T19:32:41.073057] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-02T19:32:41.159749] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-02T19:32:41.873055] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-02T19:32:42.672968] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-02T19:32:42.822920] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-02T19:32:42.824475] [INFO ] [REMOTE ] IBP: Full fetch complete (41164 records). [2025-10-02T19:32:42.824576] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-02T19:32:43.286341] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-02T19:32:43.286534] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-02T19:32:43.287421] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-02T19:32:43.287601] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-02T19:32:43.320159] [DEBUG] [LOCAL ] IBP: Trimmed 41164 records to 29050 (keeping 200 days of data) [2025-10-02T19:32:43.321799] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-10-02T19:32:43.473763] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-02T19:32:43.544272] [DEBUG] [LOCAL ] IBP: Primary data saved (29050 records). [2025-10-02T19:32:43.544413] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-02T19:32:43.544489] [INFO ] [MAIN ] Update Progress: 1081/2370 symbols completed. IBP took 25.5s. Estimated remaining: 3h 2m 2s. Rate: 7.1 symbols/min [2025-10-02T19:32:43.738394] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:43.783273] [DEBUG] [LOCAL ] IBTA: Loaded 37611 existing records from primary storage. [2025-10-02T19:32:43.783611] [INFO ] [MAIN ] IBTA: Loaded 37611 existing records. [2025-10-02T19:32:43.998875] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:32:43.999110] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-02T19:32:43.999172] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-02T19:32:44.001226] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-02T19:32:44.001360] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-02T19:32:44.283236] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-02T19:32:44.435605] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:44.629854] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T19:32:45.074850] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-02T19:32:45.081162] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T19:32:45.873057] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-02T19:32:46.498983] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-02T19:32:46.594159] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-02T19:32:46.672987] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-02T19:32:47.472980] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-02T19:32:47.611929] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-02T19:32:47.614041] [INFO ] [REMOTE ] IAG: Full fetch complete (77253 records). [2025-10-02T19:32:47.614198] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-02T19:32:48.067828] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-02T19:32:48.067914] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-02T19:32:48.072175] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-02T19:32:48.072253] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-02T19:32:48.073897] [DEBUG] [LOCAL ] IAG: Trimmed 77253 records to 53844 (keeping 200 days of data) [2025-10-02T19:32:48.287575] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-10-02T19:32:48.410061] [DEBUG] [LOCAL ] IAG: Primary data saved (53844 records). [2025-10-02T19:32:48.410206] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-02T19:32:48.410281] [INFO ] [MAIN ] Update Progress: 1082/2370 symbols completed. IAG took 30.4s. Estimated remaining: 3h 1m 49s. Rate: 7.1 symbols/min [2025-10-02T19:32:48.592266] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:48.652877] [DEBUG] [LOCAL ] ICE: Loaded 53003 existing records from primary storage. [2025-10-02T19:32:48.653218] [INFO ] [MAIN ] ICE: Loaded 53003 existing records. [2025-10-02T19:32:48.852966] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:32:48.853469] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-02T19:32:48.853868] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-02T19:32:48.855825] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-02T19:32:48.855892] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-02T19:32:49.273129] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:49.273743] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-10-02T19:32:49.341438] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T19:32:49.371922] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-10-02T19:32:49.381801] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-10-02T19:32:49.872992] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-02T19:32:50.673027] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-02T19:32:50.963795] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T19:32:51.048887] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T19:32:51.473074] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-02T19:32:52.221283] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T19:32:52.223498] [INFO ] [REMOTE ] IBN: Full fetch complete (76319 records). [2025-10-02T19:32:52.223628] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-02T19:32:52.273211] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-02T19:32:52.713175] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-02T19:32:52.714343] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T19:32:52.713736] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-02T19:32:52.720949] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-02T19:32:52.721563] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-02T19:32:52.723048] [DEBUG] [LOCAL ] IBN: Trimmed 76319 records to 53259 (keeping 200 days of data) [2025-10-02T19:32:53.082877] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-02T19:32:53.085221] [DEBUG] [LOCAL ] IBN: Primary data saved (53259 records). [2025-10-02T19:32:53.086539] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-02T19:32:53.086679] [INFO ] [MAIN ] Update Progress: 1083/2370 symbols completed. IBN took 35.1s. Estimated remaining: 3h 1m 36s. Rate: 7.1 symbols/min [2025-10-02T19:32:53.296880] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:32:53.341189] [DEBUG] [LOCAL ] ICL: Loaded 38446 existing records from primary storage. [2025-10-02T19:32:53.341559] [INFO ] [MAIN ] ICL: Loaded 38446 existing records. [2025-10-02T19:32:53.586414] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:32:53.586637] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-02T19:32:53.586726] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-02T19:32:53.587973] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-02T19:32:53.588035] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-02T19:32:53.877240] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-02T19:32:54.047363] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:32:54.094997] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T19:32:54.673011] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-02T19:32:54.708608] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T19:32:55.473067] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-02T19:32:56.167747] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-10-02T19:32:56.272977] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-10-02T19:32:56.312042] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T19:32:57.072998] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-02T19:32:57.114478] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:32:57.708722] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T19:32:57.872989] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-02T19:32:58.673066] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-02T19:32:59.069109] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T19:32:59.289004] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T19:32:59.473020] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-02T19:33:00.048331] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-02T19:33:00.273040] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-02T19:33:01.073017] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-02T19:33:01.767007] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T19:33:01.872970] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-02T19:33:01.894622] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T19:33:02.318562] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-10-02T19:33:02.673000] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-02T19:33:03.020206] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:33:03.473038] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-02T19:33:04.273058] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-02T19:33:04.921271] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-02T19:33:04.923503] [INFO ] [REMOTE ] IBM: Full fetch complete (77620 records). [2025-10-02T19:33:04.923689] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-02T19:33:05.089788] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-02T19:33:05.373572] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-02T19:33:05.373790] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-02T19:33:05.375032] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-02T19:33:05.375209] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-02T19:33:05.376918] [DEBUG] [LOCAL ] IBM: Trimmed 77620 records to 54023 (keeping 200 days of data) [2025-10-02T19:33:05.507403] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T19:33:05.786539] [DEBUG] [LOCAL ] IBM: Primary data saved (54023 records). [2025-10-02T19:33:05.786719] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-02T19:33:05.786810] [INFO ] [MAIN ] Update Progress: 1084/2370 symbols completed. IBM took 47.8s. Estimated remaining: 3h 1m 33s. Rate: 7.1 symbols/min [2025-10-02T19:33:05.876748] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-02T19:33:06.016238] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:06.019074] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T19:33:06.077606] [DEBUG] [LOCAL ] IDA: Loaded 32160 existing records from primary storage. [2025-10-02T19:33:06.078046] [INFO ] [MAIN ] IDA: Loaded 32160 existing records. [2025-10-02T19:33:06.306439] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:06.306850] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-02T19:33:06.306932] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-02T19:33:06.308416] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-02T19:33:06.308480] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-02T19:33:06.522218] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-02T19:33:06.689534] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-02T19:33:06.744758] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:07.406067] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T19:33:07.472966] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-02T19:33:08.047912] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-02T19:33:08.272995] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-02T19:33:09.073049] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-02T19:33:09.198524] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-02T19:33:09.818929] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T19:33:09.873053] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-02T19:33:10.307943] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T19:33:10.673051] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-02T19:33:11.271732] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-02T19:33:11.473031] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-10-02T19:33:12.210121] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:33:12.272989] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-02T19:33:12.371209] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-10-02T19:33:13.073017] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-02T19:33:13.872998] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-02T19:33:14.107559] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T19:33:14.557023] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T19:33:14.673023] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-02T19:33:15.033839] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-02T19:33:15.035435] [INFO ] [REMOTE ] IBTA: Full fetch complete (50823 records). [2025-10-02T19:33:15.035560] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-02T19:33:15.447076] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-02T19:33:15.447171] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-02T19:33:15.448018] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-02T19:33:15.448094] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-02T19:33:15.449404] [DEBUG] [LOCAL ] IBTA: Trimmed 50823 records to 37847 (keeping 200 days of data) [2025-10-02T19:33:15.499751] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-02T19:33:15.683620] [DEBUG] [LOCAL ] IBTA: Primary data saved (37847 records). [2025-10-02T19:33:15.683843] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-02T19:33:15.683956] [INFO ] [MAIN ] Update Progress: 1085/2370 symbols completed. IBTA took 32.1s. Estimated remaining: 3h 1m 26s. Rate: 7.1 symbols/min [2025-10-02T19:33:15.877796] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:15.888536] [DEBUG] [LOCAL ] IDE: Loaded 8754 existing records from primary storage. [2025-10-02T19:33:15.888821] [INFO ] [MAIN ] IDE: Loaded 8754 existing records. [2025-10-02T19:33:16.088846] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:16.089201] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-02T19:33:16.089363] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-02T19:33:16.089887] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-02T19:33:16.089953] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-02T19:33:16.224174] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T19:33:16.273169] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-02T19:33:16.512490] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:17.028492] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T19:33:17.073000] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-02T19:33:17.873007] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-02T19:33:18.131301] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-02T19:33:18.175744] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:33:18.673004] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-02T19:33:19.365891] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-02T19:33:19.473028] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-02T19:33:20.273012] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-02T19:33:20.494495] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-02T19:33:20.498112] [INFO ] [REMOTE ] ICE: Full fetch complete (76757 records). [2025-10-02T19:33:20.498272] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-02T19:33:20.839540] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-02T19:33:20.862955] [INFO ] [REMOTE ] ICL: Full fetch complete (55927 records). [2025-10-02T19:33:20.891147] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-02T19:33:21.058473] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-02T19:33:21.074598] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-02T19:33:21.074499] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-10-02T19:33:21.080916] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-02T19:33:21.092481] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-02T19:33:21.252135] [DEBUG] [LOCAL ] ICE: Trimmed 76757 records to 53392 (keeping 200 days of data) [2025-10-02T19:33:21.532179] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-02T19:33:21.532299] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-02T19:33:21.533285] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-02T19:33:21.536960] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-02T19:33:21.551501] [DEBUG] [LOCAL ] ICL: Trimmed 55927 records to 38682 (keeping 200 days of data) [2025-10-02T19:33:21.774446] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T19:33:21.883090] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-10-02T19:33:21.954180] [DEBUG] [LOCAL ] ICL: Primary data saved (38682 records). [2025-10-02T19:33:21.954926] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-02T19:33:21.963693] [INFO ] [MAIN ] Update Progress: 1086/2370 symbols completed. ICL took 28.9s. Estimated remaining: 3h 1m 15s. Rate: 7.1 symbols/min [2025-10-02T19:33:21.987093] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-02T19:33:22.186345] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:22.278863] [DEBUG] [LOCAL ] IDT: Loaded 17953 existing records from primary storage. [2025-10-02T19:33:22.280611] [INFO ] [MAIN ] IDT: Loaded 17953 existing records. [2025-10-02T19:33:22.478771] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:22.479751] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-02T19:33:22.479833] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-02T19:33:22.481368] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-02T19:33:22.483347] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-02T19:33:22.684399] [DEBUG] [LOCAL ] ICE: Primary data saved (53392 records). [2025-10-02T19:33:22.705344] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-02T19:33:22.683746] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-02T19:33:22.731608] [INFO ] [MAIN ] Update Progress: 1087/2370 symbols completed. ICE took 34.3s. Estimated remaining: 3h 0m 58s. Rate: 7.1 symbols/min [2025-10-02T19:33:23.041051] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:23.095089] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:23.136419] [DEBUG] [LOCAL ] IEX: Loaded 38359 existing records from primary storage. [2025-10-02T19:33:23.136800] [INFO ] [MAIN ] IEX: Loaded 38359 existing records. [2025-10-02T19:33:23.332695] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:23.333119] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-02T19:33:23.333201] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-02T19:33:23.334814] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-02T19:33:23.334883] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-02T19:33:23.476394] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-10-02T19:33:23.577903] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-02T19:33:23.531943] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T19:33:23.786112] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:24.272973] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-10-02T19:33:24.546050] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T19:33:25.073013] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-10-02T19:33:25.768923] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:33:25.873018] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-10-02T19:33:26.472789] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T19:33:26.673008] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-02T19:33:26.825153] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T19:33:27.210192] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-02T19:33:27.472999] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-02T19:33:28.257306] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T19:33:28.272968] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-02T19:33:28.994339] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T19:33:29.073001] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-02T19:33:29.873005] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-02T19:33:30.471853] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T19:33:30.479151] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-02T19:33:30.673006] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-10-02T19:33:31.473020] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-02T19:33:32.273008] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-02T19:33:32.307794] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T19:33:32.532867] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T19:33:33.073039] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-10-02T19:33:33.768066] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:33:33.872976] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-02T19:33:33.914238] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T19:33:34.582244] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-02T19:33:34.673061] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-02T19:33:35.473057] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-02T19:33:36.235506] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:33:36.272979] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-02T19:33:36.588696] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-02T19:33:37.073005] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-02T19:33:37.822237] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-02T19:33:37.878092] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-02T19:33:37.892925] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T19:33:38.641828] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-02T19:33:38.672998] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-02T19:33:39.472949] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-02T19:33:39.916291] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T19:33:40.273005] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-02T19:33:40.490136] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-02T19:33:41.073017] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-02T19:33:41.765606] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-02T19:33:41.872981] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-02T19:33:42.097945] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T19:33:42.673003] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-02T19:33:42.684596] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T19:33:43.472995] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-02T19:33:43.755624] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-02T19:33:44.052687] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T19:33:44.273015] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-10-02T19:33:45.073032] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-02T19:33:45.813507] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T19:33:45.882585] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-02T19:33:45.885612] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T19:33:46.466320] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T19:33:46.467213] [INFO ] [REMOTE ] IDE: Full fetch complete (12578 records). [2025-10-02T19:33:46.467286] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-02T19:33:46.680735] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-10-02T19:33:46.866003] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-02T19:33:46.866111] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-02T19:33:46.866459] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-02T19:33:46.866503] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-02T19:33:46.867276] [DEBUG] [LOCAL ] IDE: Trimmed 12578 records to 8807 (keeping 200 days of data) [2025-10-02T19:33:46.926934] [DEBUG] [LOCAL ] IDE: Primary data saved (8807 records). [2025-10-02T19:33:46.927083] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-02T19:33:46.927172] [INFO ] [MAIN ] Update Progress: 1088/2370 symbols completed. IDE took 31.2s. Estimated remaining: 3h 1m 8s. Rate: 7.1 symbols/min [2025-10-02T19:33:47.115269] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:47.174318] [DEBUG] [LOCAL ] IFF: Loaded 50984 existing records from primary storage. [2025-10-02T19:33:47.174744] [INFO ] [MAIN ] IFF: Loaded 50984 existing records. [2025-10-02T19:33:47.392674] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:47.393027] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-02T19:33:47.393160] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-02T19:33:47.394877] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-02T19:33:47.395009] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-02T19:33:47.478242] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-02T19:33:47.829895] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:47.875444] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-02T19:33:47.878371] [INFO ] [REMOTE ] IDA: Full fetch complete (44817 records). [2025-10-02T19:33:47.878483] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-10-02T19:33:48.283849] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-02T19:33:48.287810] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-10-02T19:33:48.287927] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-10-02T19:33:48.288949] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-10-02T19:33:48.289152] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-10-02T19:33:48.291568] [DEBUG] [LOCAL ] IDA: Trimmed 44817 records to 32394 (keeping 200 days of data) [2025-10-02T19:33:48.517284] [DEBUG] [LOCAL ] IDA: Primary data saved (32394 records). [2025-10-02T19:33:48.517423] [INFO ] [MAIN ] IDA: Full history saved. [2025-10-02T19:33:48.517593] [INFO ] [MAIN ] Update Progress: 1089/2370 symbols completed. IDA took 42.7s. Estimated remaining: 3h 0m 51s. Rate: 7.1 symbols/min [2025-10-02T19:33:48.695114] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:48.715503] [DEBUG] [LOCAL ] IFN: Loaded 18268 existing records from primary storage. [2025-10-02T19:33:48.715770] [INFO ] [MAIN ] IFN: Loaded 18268 existing records. [2025-10-02T19:33:48.900484] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:48.900704] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-02T19:33:48.900764] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-02T19:33:48.901538] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-02T19:33:48.901602] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-02T19:33:49.083638] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-10-02T19:33:49.303056] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:49.384334] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T19:33:49.596742] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T19:33:49.873005] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-02T19:33:50.673002] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-10-02T19:33:50.937408] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-02T19:33:51.072464] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-10-02T19:33:51.473053] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-02T19:33:52.015051] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T19:33:52.272997] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-02T19:33:52.444949] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T19:33:52.446372] [INFO ] [REMOTE ] IDT: Full fetch complete (23023 records). [2025-10-02T19:33:52.446450] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-02T19:33:52.860403] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-02T19:33:52.860492] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-02T19:33:52.861121] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-02T19:33:52.861190] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-02T19:33:52.862020] [DEBUG] [LOCAL ] IDT: Trimmed 23023 records to 18168 (keeping 200 days of data) [2025-10-02T19:33:52.981621] [DEBUG] [LOCAL ] IDT: Primary data saved (18168 records). [2025-10-02T19:33:52.981798] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-02T19:33:52.981904] [INFO ] [MAIN ] Update Progress: 1090/2370 symbols completed. IDT took 31.0s. Estimated remaining: 3h 0m 38s. Rate: 7.1 symbols/min [2025-10-02T19:33:53.078144] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-02T19:33:53.176746] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:53.200997] [DEBUG] [LOCAL ] IFS: Loaded 23078 existing records from primary storage. [2025-10-02T19:33:53.201295] [INFO ] [MAIN ] IFS: Loaded 23078 existing records. [2025-10-02T19:33:53.395550] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:53.396028] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-02T19:33:53.396087] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-02T19:33:53.397062] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-02T19:33:53.397128] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-02T19:33:53.752938] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T19:33:53.822311] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:53.873010] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-02T19:33:54.608250] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-02T19:33:54.672994] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-02T19:33:55.472976] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-10-02T19:33:55.568554] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:33:55.770835] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T19:33:56.272971] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-02T19:33:56.495444] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-10-02T19:33:57.072986] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-02T19:33:57.567555] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:33:57.569444] [INFO ] [REMOTE ] IEX: Full fetch complete (53557 records). [2025-10-02T19:33:57.569604] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-02T19:33:57.878226] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-02T19:33:57.991159] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T19:33:58.035737] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-02T19:33:58.035831] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-02T19:33:58.036603] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-02T19:33:58.036673] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-02T19:33:58.038303] [DEBUG] [LOCAL ] IEX: Trimmed 53557 records to 38652 (keeping 200 days of data) [2025-10-02T19:33:58.301828] [DEBUG] [LOCAL ] IEX: Primary data saved (38652 records). [2025-10-02T19:33:58.301977] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-02T19:33:58.302079] [INFO ] [MAIN ] Update Progress: 1091/2370 symbols completed. IEX took 35.6s. Estimated remaining: 3h 0m 26s. Rate: 7.1 symbols/min [2025-10-02T19:33:58.488202] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:33:58.499879] [DEBUG] [LOCAL ] IGA: Loaded 9830 existing records from primary storage. [2025-10-02T19:33:58.500133] [INFO ] [MAIN ] IGA: Loaded 9830 existing records. [2025-10-02T19:33:58.673100] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-02T19:33:58.695428] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:33:58.696583] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-02T19:33:58.696676] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-02T19:33:58.697324] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-02T19:33:58.697444] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-02T19:33:59.148875] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:33:59.252479] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T19:33:59.473019] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-02T19:33:59.734829] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T19:34:00.273009] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-10-02T19:34:00.446337] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T19:34:01.073074] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-02T19:34:01.274366] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T19:34:01.873028] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-02T19:34:02.179587] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T19:34:02.673030] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-02T19:34:03.472989] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-02T19:34:03.745269] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-10-02T19:34:03.769391] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T19:34:04.237884] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T19:34:04.273033] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-02T19:34:05.072988] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-02T19:34:05.368400] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:34:05.873016] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-02T19:34:06.023350] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T19:34:06.673027] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-02T19:34:06.976923] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T19:34:07.441596] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T19:34:07.472998] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-02T19:34:08.273008] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-02T19:34:09.009113] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-02T19:34:09.073050] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-02T19:34:09.296898] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T19:34:09.872997] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-02T19:34:10.282725] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-02T19:34:10.655072] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T19:34:10.672940] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-02T19:34:11.410404] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T19:34:11.473005] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-02T19:34:12.267203] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-02T19:34:12.272950] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-02T19:34:13.075989] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-02T19:34:13.078773] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-02T19:34:13.872986] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-02T19:34:14.683967] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-02T19:34:14.690218] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T19:34:14.709826] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-02T19:34:15.473040] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-02T19:34:16.036022] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T19:34:16.273005] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-02T19:34:16.306695] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-02T19:34:17.072997] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-02T19:34:17.218510] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-02T19:34:17.873036] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-02T19:34:18.210347] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-02T19:34:18.673022] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-02T19:34:19.130937] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T19:34:19.473029] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-02T19:34:19.765781] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-02T19:34:20.273034] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-02T19:34:21.072988] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-02T19:34:21.241979] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T19:34:21.376492] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T19:34:21.873028] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-02T19:34:22.673008] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-02T19:34:23.322157] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T19:34:23.323233] [INFO ] [REMOTE ] IGA: Full fetch complete (13746 records). [2025-10-02T19:34:23.323309] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-02T19:34:23.479179] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-02T19:34:23.736390] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-02T19:34:23.736473] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-02T19:34:23.736862] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-02T19:34:23.736929] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-02T19:34:23.737692] [DEBUG] [LOCAL ] IGA: Trimmed 13746 records to 9918 (keeping 200 days of data) [2025-10-02T19:34:23.805341] [DEBUG] [LOCAL ] IGA: Primary data saved (9918 records). [2025-10-02T19:34:23.805490] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-02T19:34:23.805629] [INFO ] [MAIN ] Update Progress: 1092/2370 symbols completed. IGA took 25.5s. Estimated remaining: 3h 0m 37s. Rate: 7.1 symbols/min [2025-10-02T19:34:23.995739] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:34:24.015312] [DEBUG] [LOCAL ] IGD: Loaded 19065 existing records from primary storage. [2025-10-02T19:34:24.015595] [INFO ] [MAIN ] IGD: Loaded 19065 existing records. [2025-10-02T19:34:24.224045] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:34:24.224304] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-02T19:34:24.224362] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-02T19:34:24.225746] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-02T19:34:24.225858] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-02T19:34:24.726283] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:34:24.726852] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-10-02T19:34:25.134777] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T19:34:25.151481] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-02T19:34:25.799386] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (4.73 seconds). [2025-10-02T19:34:25.878308] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-02T19:34:25.879309] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T19:34:26.326247] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (4.45 seconds). [2025-10-02T19:34:26.672994] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-02T19:34:26.728500] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T19:34:27.002260] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T19:34:27.003556] [INFO ] [REMOTE ] IFN: Full fetch complete (29071 records). [2025-10-02T19:34:27.003739] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-02T19:34:27.427334] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-02T19:34:27.427427] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-02T19:34:27.428354] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-02T19:34:27.428428] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-02T19:34:27.429576] [DEBUG] [LOCAL ] IFN: Trimmed 29071 records to 18372 (keeping 200 days of data) [2025-10-02T19:34:27.485797] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-02T19:34:27.560112] [DEBUG] [LOCAL ] IFN: Primary data saved (18372 records). [2025-10-02T19:34:27.560290] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-02T19:34:27.560450] [INFO ] [MAIN ] Update Progress: 1093/2370 symbols completed. IFN took 39.0s. Estimated remaining: 3h 0m 23s. Rate: 7.1 symbols/min [2025-10-02T19:34:27.755174] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:34:27.775714] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-02T19:34:27.784821] [DEBUG] [LOCAL ] IGI: Loaded 3604 existing records from primary storage. [2025-10-02T19:34:27.785543] [INFO ] [MAIN ] IGI: Loaded 3604 existing records. [2025-10-02T19:34:27.983796] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:34:27.984002] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-02T19:34:27.984051] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-02T19:34:27.984378] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-02T19:34:27.984446] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-02T19:34:28.280452] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-02T19:34:28.407434] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:34:28.622089] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T19:34:29.072992] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-10-02T19:34:29.647018] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-02T19:34:29.873036] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-02T19:34:30.136621] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-02T19:34:30.138870] [INFO ] [REMOTE ] IFF: Full fetch complete (73046 records). [2025-10-02T19:34:30.139030] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-02T19:34:30.568150] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-02T19:34:30.568312] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-02T19:34:30.569272] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-02T19:34:30.569337] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-02T19:34:30.570843] [DEBUG] [LOCAL ] IFF: Trimmed 73046 records to 51357 (keeping 200 days of data) [2025-10-02T19:34:30.676702] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-02T19:34:30.846604] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T19:34:30.849139] [INFO ] [REMOTE ] IFS: Full fetch complete (31658 records). [2025-10-02T19:34:30.850372] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-02T19:34:31.343712] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-02T19:34:31.344927] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-02T19:34:31.347750] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-02T19:34:31.348364] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-02T19:34:31.351881] [DEBUG] [LOCAL ] IFS: Trimmed 31658 records to 23264 (keeping 200 days of data) [2025-10-02T19:34:31.447210] [DEBUG] [LOCAL ] IFF: Primary data saved (51357 records). [2025-10-02T19:34:31.448070] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-02T19:34:31.448525] [INFO ] [MAIN ] Update Progress: 1094/2370 symbols completed. IFF took 44.5s. Estimated remaining: 3h 0m 9s. Rate: 7.1 symbols/min [2025-10-02T19:34:31.484044] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-02T19:34:31.624045] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T19:34:31.700087] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:34:31.759813] [DEBUG] [LOCAL ] IGR: Loaded 30496 existing records from primary storage. [2025-10-02T19:34:31.761099] [INFO ] [MAIN ] IGR: Loaded 30496 existing records. [2025-10-02T19:34:31.899771] [DEBUG] [LOCAL ] IFS: Primary data saved (23264 records). [2025-10-02T19:34:31.910146] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-02T19:34:31.926440] [INFO ] [MAIN ] Update Progress: 1095/2370 symbols completed. IFS took 38.9s. Estimated remaining: 2h 59m 52s. Rate: 7.1 symbols/min [2025-10-02T19:34:32.067858] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:34:32.087466] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-02T19:34:32.064437] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-02T19:34:32.087667] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-02T19:34:32.095619] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-02T19:34:32.105944] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-02T19:34:32.281987] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-02T19:34:32.276747] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:34:32.366233] [DEBUG] [LOCAL ] IH: Loaded 3116 existing records from primary storage. [2025-10-02T19:34:32.383135] [INFO ] [MAIN ] IH: Loaded 3116 existing records. [2025-10-02T19:34:32.735752] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:34:32.753251] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-02T19:34:32.774282] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-02T19:34:32.802677] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:34:32.795391] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-02T19:34:32.803230] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-02T19:34:32.867003] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T19:34:33.078115] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-02T19:34:33.197763] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:34:33.724103] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T19:34:33.873001] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-02T19:34:34.330134] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-02T19:34:34.673031] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-10-02T19:34:35.247158] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-02T19:34:35.473046] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-02T19:34:35.921487] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-02T19:34:36.273053] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-02T19:34:36.859226] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-02T19:34:37.073040] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-02T19:34:37.873023] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-10-02T19:34:38.673004] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-02T19:34:39.473046] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-02T19:34:39.507804] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T19:34:39.513894] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T19:34:40.272971] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-02T19:34:40.617195] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-02T19:34:41.073056] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-02T19:34:41.516020] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-02T19:34:41.717944] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:34:41.872986] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-02T19:34:42.673040] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-02T19:34:42.935483] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-02T19:34:43.120340] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T19:34:43.473014] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-02T19:34:44.058772] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (6.99 seconds). [2025-10-02T19:34:44.273022] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-02T19:34:44.879243] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T19:34:45.073026] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-02T19:34:45.333864] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T19:34:45.529463] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-02T19:34:45.873045] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-02T19:34:46.673011] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-02T19:34:47.238253] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T19:34:47.251820] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-02T19:34:47.473039] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-02T19:34:48.049858] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T19:34:48.273032] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-02T19:34:49.072996] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-02T19:34:49.391304] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-02T19:34:49.804061] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-02T19:34:49.873012] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-02T19:34:50.673040] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-02T19:34:50.937176] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-02T19:34:51.473008] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-02T19:34:51.621039] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-02T19:34:51.837249] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-02T19:34:52.273013] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-02T19:34:52.738358] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T19:34:53.073030] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-02T19:34:53.872999] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-02T19:34:54.106254] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T19:34:54.486759] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T19:34:54.673005] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-02T19:34:55.101665] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-02T19:34:55.102428] [INFO ] [REMOTE ] IH: Full fetch complete (4974 records). [2025-10-02T19:34:55.102506] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-02T19:34:55.478235] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-02T19:34:55.521203] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-02T19:34:55.521319] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-02T19:34:55.522531] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-02T19:34:55.522601] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-02T19:34:55.523032] [DEBUG] [LOCAL ] IH: Trimmed 4974 records to 3128 (keeping 200 days of data) [2025-10-02T19:34:55.543162] [DEBUG] [LOCAL ] IH: Primary data saved (3128 records). [2025-10-02T19:34:55.543253] [INFO ] [MAIN ] IH: Full history saved. [2025-10-02T19:34:55.543335] [INFO ] [MAIN ] Update Progress: 1096/2370 symbols completed. IH took 23.6s. Estimated remaining: 3h 0m 1s. Rate: 7.1 symbols/min [2025-10-02T19:34:55.742589] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:34:55.752322] [DEBUG] [LOCAL ] IHD: Loaded 6958 existing records from primary storage. [2025-10-02T19:34:55.752584] [INFO ] [MAIN ] IHD: Loaded 6958 existing records. [2025-10-02T19:34:55.942846] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:34:55.943168] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-02T19:34:55.943229] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-02T19:34:55.943999] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-02T19:34:55.944068] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-02T19:34:56.278213] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-02T19:34:56.338284] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:34:56.809963] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:34:57.073002] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-10-02T19:34:57.472080] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-02T19:34:57.643711] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-10-02T19:34:57.873017] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-02T19:34:58.427989] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-02T19:34:58.673006] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-02T19:34:59.473029] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-02T19:34:59.744593] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-02T19:35:00.272992] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-02T19:35:00.389588] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-02T19:35:01.073057] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-02T19:35:01.197392] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-02T19:35:01.198563] [INFO ] [REMOTE ] IGI: Full fetch complete (5293 records). [2025-10-02T19:35:01.198740] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-02T19:35:01.629700] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-02T19:35:01.629835] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-02T19:35:01.630016] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-02T19:35:01.630060] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-02T19:35:01.630734] [DEBUG] [LOCAL ] IGI: Trimmed 5293 records to 3658 (keeping 200 days of data) [2025-10-02T19:35:01.655234] [DEBUG] [LOCAL ] IGI: Primary data saved (3658 records). [2025-10-02T19:35:01.655349] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-02T19:35:01.655441] [INFO ] [MAIN ] Update Progress: 1097/2370 symbols completed. IGI took 34.1s. Estimated remaining: 2h 59m 50s. Rate: 7.1 symbols/min [2025-10-02T19:35:01.875536] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:01.875707] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-02T19:35:01.902220] [DEBUG] [LOCAL ] IHG: Loaded 24438 existing records from primary storage. [2025-10-02T19:35:01.902489] [INFO ] [MAIN ] IHG: Loaded 24438 existing records. [2025-10-02T19:35:02.114509] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:02.114743] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-02T19:35:02.114798] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-02T19:35:02.116013] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-02T19:35:02.116076] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-02T19:35:02.527531] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:02.640982] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-02T19:35:02.648043] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T19:35:02.672988] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-02T19:35:03.429304] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-02T19:35:03.473014] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-02T19:35:04.273032] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-10-02T19:35:04.823036] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T19:35:05.072965] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-02T19:35:05.221928] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T19:35:05.873007] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-02T19:35:06.255267] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T19:35:06.256617] [INFO ] [REMOTE ] IGR: Full fetch complete (45700 records). [2025-10-02T19:35:06.256724] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-02T19:35:06.588425] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-02T19:35:06.673019] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-02T19:35:06.687741] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-02T19:35:06.687839] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-02T19:35:06.688723] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-02T19:35:06.688889] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-02T19:35:06.690091] [DEBUG] [LOCAL ] IGR: Trimmed 45700 records to 30686 (keeping 200 days of data) [2025-10-02T19:35:06.884027] [DEBUG] [LOCAL ] IGR: Primary data saved (30686 records). [2025-10-02T19:35:06.884180] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-02T19:35:06.884270] [INFO ] [MAIN ] Update Progress: 1098/2370 symbols completed. IGR took 35.4s. Estimated remaining: 2h 59m 37s. Rate: 7.1 symbols/min [2025-10-02T19:35:07.073859] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:07.111847] [DEBUG] [LOCAL ] IHS: Loaded 39149 existing records from primary storage. [2025-10-02T19:35:07.112172] [INFO ] [MAIN ] IHS: Loaded 39149 existing records. [2025-10-02T19:35:07.316114] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:07.316470] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-02T19:35:07.316578] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-02T19:35:07.317814] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-02T19:35:07.317909] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-02T19:35:07.475086] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-02T19:35:07.643542] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-02T19:35:07.729847] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:08.272998] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-02T19:35:08.627728] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-02T19:35:08.964222] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-02T19:35:09.073038] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-10-02T19:35:09.873004] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-02T19:35:10.595145] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-02T19:35:10.672982] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-02T19:35:10.711480] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T19:35:11.397750] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T19:35:11.473023] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-02T19:35:12.272992] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-02T19:35:12.676080] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T19:35:12.867634] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-02T19:35:13.073003] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-02T19:35:13.598604] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T19:35:13.872995] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-02T19:35:14.358617] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T19:35:14.359519] [INFO ] [REMOTE ] IHD: Full fetch complete (11759 records). [2025-10-02T19:35:14.359593] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-02T19:35:14.678465] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-02T19:35:14.774418] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-02T19:35:14.774498] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-02T19:35:14.774822] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-02T19:35:14.774885] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-02T19:35:14.775387] [DEBUG] [LOCAL ] IHD: Trimmed 11759 records to 6998 (keeping 200 days of data) [2025-10-02T19:35:14.821844] [DEBUG] [LOCAL ] IHD: Primary data saved (6998 records). [2025-10-02T19:35:14.822025] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-02T19:35:14.822125] [INFO ] [MAIN ] Update Progress: 1099/2370 symbols completed. IHD took 19.3s. Estimated remaining: 2h 59m 28s. Rate: 7.1 symbols/min [2025-10-02T19:35:15.000318] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:15.007259] [DEBUG] [LOCAL ] IIF: Loaded 5723 existing records from primary storage. [2025-10-02T19:35:15.007450] [INFO ] [MAIN ] IIF: Loaded 5723 existing records. [2025-10-02T19:35:15.201518] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:15.201747] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-02T19:35:15.201802] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-02T19:35:15.202114] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-02T19:35:15.202216] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-02T19:35:15.478099] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-02T19:35:15.600365] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:15.759222] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T19:35:15.760706] [INFO ] [REMOTE ] IGD: Full fetch complete (29782 records). [2025-10-02T19:35:15.760798] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-02T19:35:16.174508] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-02T19:35:16.174591] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-02T19:35:16.175248] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-02T19:35:16.175323] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-02T19:35:16.176169] [DEBUG] [LOCAL ] IGD: Trimmed 29782 records to 19256 (keeping 200 days of data) [2025-10-02T19:35:16.272971] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-10-02T19:35:16.295539] [DEBUG] [LOCAL ] IGD: Primary data saved (19256 records). [2025-10-02T19:35:16.295697] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-02T19:35:16.295791] [INFO ] [MAIN ] Update Progress: 1100/2370 symbols completed. IGD took 52.5s. Estimated remaining: 2h 59m 12s. Rate: 7.1 symbols/min [2025-10-02T19:35:16.478923] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:16.498533] [DEBUG] [LOCAL ] IIIN: Loaded 16358 existing records from primary storage. [2025-10-02T19:35:16.498825] [INFO ] [MAIN ] IIIN: Loaded 16358 existing records. [2025-10-02T19:35:16.743941] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:16.744285] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-02T19:35:16.744364] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-02T19:35:16.750891] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-02T19:35:16.762875] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-02T19:35:16.761958] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-02T19:35:17.078407] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-02T19:35:17.219520] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T19:35:17.354302] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:17.873045] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-02T19:35:18.132956] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-02T19:35:18.655566] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-02T19:35:18.672973] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-02T19:35:19.473007] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-02T19:35:19.800002] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T19:35:20.034838] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-02T19:35:20.272997] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-10-02T19:35:21.073015] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-02T19:35:21.712853] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-10-02T19:35:21.872994] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-02T19:35:22.633126] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:35:22.672967] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-02T19:35:23.473015] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-02T19:35:24.039495] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T19:35:24.040351] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-02T19:35:24.273017] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-02T19:35:25.073021] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-02T19:35:25.557081] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T19:35:25.873030] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-02T19:35:26.273902] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T19:35:26.327822] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (4.45 seconds). [2025-10-02T19:35:26.550948] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-02T19:35:26.673003] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-02T19:35:27.473012] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-02T19:35:28.185073] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-02T19:35:28.273002] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-02T19:35:28.371062] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T19:35:29.073054] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-02T19:35:29.605079] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:35:29.873015] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-02T19:35:29.893587] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T19:35:30.673002] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-02T19:35:30.967608] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T19:35:31.473052] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-02T19:35:32.103474] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T19:35:32.251339] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-02T19:35:32.272966] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-02T19:35:32.972662] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-02T19:35:33.073059] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-02T19:35:33.873002] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-02T19:35:34.162589] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-02T19:35:34.673055] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-02T19:35:35.030615] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-02T19:35:35.473044] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-02T19:35:35.783758] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-02T19:35:36.273002] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-02T19:35:36.511721] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T19:35:36.513107] [INFO ] [REMOTE ] IHG: Full fetch complete (33815 records). [2025-10-02T19:35:36.513194] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-02T19:35:36.912483] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T19:35:36.952226] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-02T19:35:36.952322] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-02T19:35:36.953158] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-02T19:35:36.953235] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-02T19:35:36.954333] [DEBUG] [LOCAL ] IHG: Trimmed 33815 records to 24606 (keeping 200 days of data) [2025-10-02T19:35:37.073055] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-02T19:35:37.126992] [DEBUG] [LOCAL ] IHG: Primary data saved (24606 records). [2025-10-02T19:35:37.127141] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-02T19:35:37.127245] [INFO ] [MAIN ] Update Progress: 1101/2370 symbols completed. IHG took 35.5s. Estimated remaining: 2h 59m 17s. Rate: 7.1 symbols/min [2025-10-02T19:35:37.317030] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:37.334442] [DEBUG] [LOCAL ] IIM: Loaded 16041 existing records from primary storage. [2025-10-02T19:35:37.334718] [INFO ] [MAIN ] IIM: Loaded 16041 existing records. [2025-10-02T19:35:37.521112] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:37.521379] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-02T19:35:37.521435] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-02T19:35:37.522194] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-02T19:35:37.522258] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-02T19:35:37.815350] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-02T19:35:37.878114] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-02T19:35:37.959246] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:38.672981] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-02T19:35:38.863571] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T19:35:39.473008] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-10-02T19:35:39.734195] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T19:35:40.273037] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-02T19:35:40.688291] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T19:35:40.884469] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T19:35:41.073072] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-02T19:35:41.873042] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-02T19:35:41.900710] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T19:35:42.673039] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-02T19:35:42.932530] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-02T19:35:43.237966] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T19:35:43.473045] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-02T19:35:44.273000] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-02T19:35:44.553929] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-02T19:35:44.697020] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-02T19:35:44.697824] [INFO ] [REMOTE ] IIF: Full fetch complete (9391 records). [2025-10-02T19:35:44.697934] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-02T19:35:45.079494] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-02T19:35:45.089420] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-02T19:35:45.089529] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-02T19:35:45.089828] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-02T19:35:45.089909] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-02T19:35:45.090448] [DEBUG] [LOCAL ] IIF: Trimmed 9391 records to 5734 (keeping 200 days of data) [2025-10-02T19:35:45.126348] [DEBUG] [LOCAL ] IIF: Primary data saved (5734 records). [2025-10-02T19:35:45.126483] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-02T19:35:45.126570] [INFO ] [MAIN ] Update Progress: 1102/2370 symbols completed. IIF took 30.3s. Estimated remaining: 2h 59m 8s. Rate: 7.1 symbols/min [2025-10-02T19:35:45.312462] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:45.350097] [DEBUG] [LOCAL ] IIPR: Loaded 29798 existing records from primary storage. [2025-10-02T19:35:45.350379] [INFO ] [MAIN ] IIPR: Loaded 29798 existing records. [2025-10-02T19:35:45.546042] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:45.546327] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-02T19:35:45.546406] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-02T19:35:45.547771] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-02T19:35:45.547851] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-02T19:35:45.878117] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-02T19:35:45.951435] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:46.322403] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T19:35:46.672977] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-02T19:35:46.980260] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T19:35:47.473006] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-02T19:35:47.761218] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T19:35:47.762785] [INFO ] [REMOTE ] IHS: Full fetch complete (51732 records). [2025-10-02T19:35:47.762889] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-02T19:35:48.194494] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-02T19:35:48.194602] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-02T19:35:48.195445] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-02T19:35:48.195505] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-02T19:35:48.196695] [DEBUG] [LOCAL ] IHS: Trimmed 51732 records to 39304 (keeping 200 days of data) [2025-10-02T19:35:48.277062] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-10-02T19:35:48.401956] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-02T19:35:48.441624] [DEBUG] [LOCAL ] IHS: Primary data saved (39304 records). [2025-10-02T19:35:48.441827] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-02T19:35:48.441923] [INFO ] [MAIN ] Update Progress: 1103/2370 symbols completed. IHS took 41.6s. Estimated remaining: 2h 58m 54s. Rate: 7.1 symbols/min [2025-10-02T19:35:48.625950] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:48.666547] [DEBUG] [LOCAL ] IMAX: Loaded 42818 existing records from primary storage. [2025-10-02T19:35:48.666912] [INFO ] [MAIN ] IMAX: Loaded 42818 existing records. [2025-10-02T19:35:48.866420] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:48.866732] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-02T19:35:48.866799] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-02T19:35:48.868307] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-02T19:35:48.868369] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-02T19:35:49.078236] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-02T19:35:49.262045] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:49.756756] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T19:35:49.873017] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-02T19:35:50.128557] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T19:35:50.672996] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-02T19:35:50.862811] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-02T19:35:51.293416] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-02T19:35:51.294497] [INFO ] [REMOTE ] IIIN: Full fetch complete (24907 records). [2025-10-02T19:35:51.294596] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-02T19:35:51.477444] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-10-02T19:35:51.708756] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-02T19:35:51.708834] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-02T19:35:51.709334] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-02T19:35:51.709374] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-02T19:35:51.710112] [DEBUG] [LOCAL ] IIIN: Trimmed 24907 records to 16475 (keeping 200 days of data) [2025-10-02T19:35:51.814060] [DEBUG] [LOCAL ] IIIN: Primary data saved (16475 records). [2025-10-02T19:35:51.814201] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-02T19:35:51.814281] [INFO ] [MAIN ] Update Progress: 1104/2370 symbols completed. IIIN took 35.5s. Estimated remaining: 2h 58m 40s. Rate: 7.1 symbols/min [2025-10-02T19:35:51.995869] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:35:52.051404] [DEBUG] [LOCAL ] INFA: Loaded 49567 existing records from primary storage. [2025-10-02T19:35:52.051774] [INFO ] [MAIN ] INFA: Loaded 49567 existing records. [2025-10-02T19:35:52.243392] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:35:52.243620] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-02T19:35:52.243705] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-02T19:35:52.246033] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-02T19:35:52.246100] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-02T19:35:52.272994] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-02T19:35:52.651909] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:35:52.932134] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:35:53.072994] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-02T19:35:53.768562] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T19:35:53.873009] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-10-02T19:35:54.510062] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:35:54.673001] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-02T19:35:55.473022] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-02T19:35:55.537222] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T19:35:55.635477] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T19:35:56.273036] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-02T19:35:56.907670] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:35:57.073030] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-02T19:35:57.872970] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-02T19:35:58.025347] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-02T19:35:58.328883] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:35:58.672994] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-02T19:35:59.347820] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-02T19:35:59.472988] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-02T19:36:00.272978] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-02T19:36:00.446846] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T19:36:00.913350] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:36:01.072982] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-02T19:36:01.201798] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-02T19:36:01.873038] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-02T19:36:02.537339] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-02T19:36:02.566539] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T19:36:02.673038] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-02T19:36:03.473049] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-02T19:36:04.247792] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-02T19:36:04.272982] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-02T19:36:04.464997] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T19:36:05.073004] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-02T19:36:05.873035] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-02T19:36:05.933798] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T19:36:06.083377] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-02T19:36:06.673019] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-02T19:36:07.473028] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-02T19:36:07.674239] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-02T19:36:07.764311] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-02T19:36:08.273010] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-02T19:36:08.742757] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-02T19:36:09.072976] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-02T19:36:09.077959] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T19:36:09.079337] [INFO ] [REMOTE ] IIM: Full fetch complete (25563 records). [2025-10-02T19:36:09.079427] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-02T19:36:09.584791] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-02T19:36:09.584930] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-02T19:36:09.586156] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-02T19:36:09.586251] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-02T19:36:09.587461] [DEBUG] [LOCAL ] IIM: Trimmed 25563 records to 16251 (keeping 200 days of data) [2025-10-02T19:36:09.769743] [DEBUG] [LOCAL ] IIM: Primary data saved (16251 records). [2025-10-02T19:36:09.769949] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-02T19:36:09.770087] [INFO ] [MAIN ] Update Progress: 1105/2370 symbols completed. IIM took 32.6s. Estimated remaining: 2h 58m 42s. Rate: 7.1 symbols/min [2025-10-02T19:36:09.878337] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-02T19:36:10.039488] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:10.107959] [DEBUG] [LOCAL ] INFY: Loaded 53598 existing records from primary storage. [2025-10-02T19:36:10.108539] [INFO ] [MAIN ] INFY: Loaded 53598 existing records. [2025-10-02T19:36:10.350825] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:36:10.351086] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-02T19:36:10.351170] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-02T19:36:10.354388] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-02T19:36:10.354460] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-02T19:36:10.673761] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-02T19:36:10.769823] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:10.806348] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T19:36:11.162049] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T19:36:11.473001] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-02T19:36:12.278137] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-02T19:36:12.301628] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T19:36:12.638094] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T19:36:13.073006] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-10-02T19:36:13.873002] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-02T19:36:14.093035] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T19:36:14.672969] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-02T19:36:14.818007] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T19:36:15.192745] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T19:36:15.472994] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-02T19:36:16.269041] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T19:36:16.285092] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-02T19:36:17.072995] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-02T19:36:17.300482] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T19:36:17.702840] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T19:36:17.705575] [INFO ] [REMOTE ] IMAX: Full fetch complete (59878 records). [2025-10-02T19:36:17.705739] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-02T19:36:17.878076] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-02T19:36:18.138486] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-02T19:36:18.138566] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-02T19:36:18.139365] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-02T19:36:18.139453] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-02T19:36:18.140953] [DEBUG] [LOCAL ] IMAX: Trimmed 59878 records to 43087 (keeping 200 days of data) [2025-10-02T19:36:18.409582] [DEBUG] [LOCAL ] IMAX: Primary data saved (43087 records). [2025-10-02T19:36:18.409740] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-02T19:36:18.409985] [INFO ] [MAIN ] Update Progress: 1106/2370 symbols completed. IMAX took 30.0s. Estimated remaining: 2h 58m 34s. Rate: 7.1 symbols/min [2025-10-02T19:36:18.594381] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:18.626262] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-02T19:36:18.680451] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-02T19:36:18.683839] [DEBUG] [LOCAL ] ING: Loaded 50724 existing records from primary storage. [2025-10-02T19:36:18.684220] [INFO ] [MAIN ] ING: Loaded 50724 existing records. [2025-10-02T19:36:18.887008] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:36:18.887232] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-02T19:36:18.887284] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-02T19:36:18.889706] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-02T19:36:18.889791] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-02T19:36:19.290005] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:19.473017] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-10-02T19:36:19.756226] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T19:36:20.066237] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T19:36:20.273001] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-02T19:36:20.863234] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T19:36:21.073017] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-02T19:36:21.571382] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:36:21.872999] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-02T19:36:22.673023] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-02T19:36:23.014691] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-02T19:36:23.473045] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-02T19:36:23.533673] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T19:36:24.182569] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T19:36:24.273039] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-02T19:36:25.073000] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-02T19:36:25.132281] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T19:36:25.872964] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-02T19:36:26.066407] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T19:36:26.649601] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:36:26.672958] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-02T19:36:27.431715] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:36:27.472985] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-02T19:36:28.232407] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T19:36:28.273019] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-02T19:36:29.078145] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-02T19:36:29.101103] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T19:36:29.154279] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-02T19:36:29.873046] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-02T19:36:30.673012] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-02T19:36:31.087269] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-02T19:36:31.089444] [INFO ] [REMOTE ] INFA: Full fetch complete (71374 records). [2025-10-02T19:36:31.089586] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-02T19:36:31.536271] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-02T19:36:31.624513] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-02T19:36:31.627427] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-02T19:36:31.628894] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-02T19:36:31.629017] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-02T19:36:31.627302] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T19:36:31.642579] [DEBUG] [LOCAL ] INFA: Trimmed 71374 records to 49887 (keeping 200 days of data) [2025-10-02T19:36:31.957172] [DEBUG] [LOCAL ] INFA: Primary data saved (49887 records). [2025-10-02T19:36:31.957323] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-02T19:36:31.957445] [INFO ] [MAIN ] Update Progress: 1107/2370 symbols completed. INFA took 40.1s. Estimated remaining: 2h 58m 31s. Rate: 7.1 symbols/min [2025-10-02T19:36:32.132742] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-02T19:36:32.160260] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:32.161042] [INFO ] [REMOTE ] IIPR: Full fetch complete (44734 records). [2025-10-02T19:36:32.161226] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-02T19:36:32.278110] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-02T19:36:32.410866] [DEBUG] [LOCAL ] INGM: Loaded 28652 existing records from primary storage. [2025-10-02T19:36:32.478385] [INFO ] [MAIN ] INGM: Loaded 28652 existing records. [2025-10-02T19:36:32.822696] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:36:32.837949] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-02T19:36:32.838056] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-02T19:36:32.838345] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-02T19:36:32.838407] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-02T19:36:32.839187] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-02T19:36:32.839232] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-02T19:36:32.839378] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-02T19:36:32.844595] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-02T19:36:32.956625] [DEBUG] [LOCAL ] IIPR: Trimmed 44734 records to 30075 (keeping 200 days of data) [2025-10-02T19:36:33.355020] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:33.355969] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-10-02T19:36:33.473787] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-02T19:36:33.503055] [DEBUG] [LOCAL ] IIPR: Primary data saved (30075 records). [2025-10-02T19:36:33.503216] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-02T19:36:33.504634] [INFO ] [MAIN ] Update Progress: 1108/2370 symbols completed. IIPR took 48.4s. Estimated remaining: 2h 58m 15s. Rate: 7.1 symbols/min [2025-10-02T19:36:33.693548] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:33.736050] [DEBUG] [LOCAL ] INGR: Loaded 33339 existing records from primary storage. [2025-10-02T19:36:33.736353] [INFO ] [MAIN ] INGR: Loaded 33339 existing records. [2025-10-02T19:36:33.893358] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-02T19:36:33.956753] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:36:33.969674] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-02T19:36:33.969972] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-02T19:36:33.971593] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T19:36:33.971746] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-02T19:36:33.982539] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-02T19:36:34.394061] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:34.673051] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-02T19:36:34.856728] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-10-02T19:36:35.433016] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:36:35.473058] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-10-02T19:36:36.273031] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-02T19:36:36.406122] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-02T19:36:36.788879] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T19:36:37.073035] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-10-02T19:36:37.873013] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-02T19:36:38.111102] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T19:36:38.672995] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-02T19:36:38.742877] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-02T19:36:39.294340] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T19:36:39.473037] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-02T19:36:40.252499] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:36:40.273000] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-10-02T19:36:40.405851] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-02T19:36:41.073038] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-02T19:36:41.715886] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-02T19:36:41.873018] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-10-02T19:36:42.558784] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T19:36:42.673024] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-02T19:36:43.087543] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T19:36:43.089909] [INFO ] [REMOTE ] ING: Full fetch complete (73620 records). [2025-10-02T19:36:43.090057] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-10-02T19:36:43.478203] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-02T19:36:43.532923] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-10-02T19:36:43.533042] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-10-02T19:36:43.534068] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-10-02T19:36:43.534188] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-10-02T19:36:43.536369] [DEBUG] [LOCAL ] ING: Trimmed 73620 records to 51091 (keeping 200 days of data) [2025-10-02T19:36:43.874138] [DEBUG] [LOCAL ] ING: Primary data saved (51091 records). [2025-10-02T19:36:43.874294] [INFO ] [MAIN ] ING: Full history saved. [2025-10-02T19:36:43.874382] [INFO ] [MAIN ] Update Progress: 1109/2370 symbols completed. ING took 25.5s. Estimated remaining: 2h 58m 8s. Rate: 7.1 symbols/min [2025-10-02T19:36:44.055182] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:44.093210] [DEBUG] [LOCAL ] INN: Loaded 41756 existing records from primary storage. [2025-10-02T19:36:44.093548] [INFO ] [MAIN ] INN: Loaded 41756 existing records. [2025-10-02T19:36:44.279585] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-02T19:36:44.286294] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:36:44.287481] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-02T19:36:44.287537] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-02T19:36:44.288872] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-02T19:36:44.288939] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-02T19:36:44.697750] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:44.736838] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-10-02T19:36:45.079565] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-02T19:36:45.082556] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T19:36:45.510026] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T19:36:45.873028] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-02T19:36:46.522876] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-02T19:36:46.525485] [INFO ] [REMOTE ] INFY: Full fetch complete (77542 records). [2025-10-02T19:36:46.525605] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-02T19:36:46.684298] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-02T19:36:46.981692] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-02T19:36:46.981866] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-02T19:36:46.983206] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-02T19:36:46.983273] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-02T19:36:46.986915] [DEBUG] [LOCAL ] INFY: Trimmed 77542 records to 53985 (keeping 200 days of data) [2025-10-02T19:36:47.251816] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-02T19:36:47.380384] [DEBUG] [LOCAL ] INFY: Primary data saved (53985 records). [2025-10-02T19:36:47.380572] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-02T19:36:47.380716] [INFO ] [MAIN ] Update Progress: 1110/2370 symbols completed. INFY took 37.6s. Estimated remaining: 2h 57m 54s. Rate: 7.1 symbols/min [2025-10-02T19:36:47.478087] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-02T19:36:47.576437] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:47.576600] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-02T19:36:47.576638] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-02T19:36:47.576776] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-02T19:36:47.576818] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-02T19:36:47.576881] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-02T19:36:47.576915] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-02T19:36:47.977446] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:48.167318] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T19:36:48.273050] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-10-02T19:36:48.831953] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:36:48.832396] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-10-02T19:36:48.832515] [FATAL] [REMOTE ] INR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:36:48.832580] [FATAL] [MAIN ] INR: Failed to fetch primary data. [2025-10-02T19:36:48.832685] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:36:48.832773] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-02T19:36:48.832869] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-02T19:36:48.832937] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-02T19:36:48.832997] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-02T19:36:48.833074] [INFO ] [MAIN ] Update Progress: 1111/2370 symbols completed. INR took 1.5s. Estimated remaining: 2h 57m 38s. Rate: 7.1 symbols/min [2025-10-02T19:36:49.051179] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T19:36:49.071323] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:36:49.078411] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-10-02T19:36:49.121181] [DEBUG] [LOCAL ] INSP: Loaded 37162 existing records from primary storage. [2025-10-02T19:36:49.121526] [INFO ] [MAIN ] INSP: Loaded 37162 existing records. [2025-10-02T19:36:49.318540] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:36:49.318813] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-02T19:36:49.318865] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-02T19:36:49.319944] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-02T19:36:49.320007] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-02T19:36:49.736104] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:36:49.873020] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-10-02T19:36:50.563520] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-10-02T19:36:50.673006] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-02T19:36:51.257350] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:36:51.473037] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-02T19:36:51.907353] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T19:36:52.273022] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-02T19:36:52.923141] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-02T19:36:53.073003] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-02T19:36:53.761776] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:36:53.872980] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-02T19:36:54.438477] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T19:36:54.673013] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-02T19:36:55.409169] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-02T19:36:55.473047] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-02T19:36:55.692262] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-02T19:36:56.273005] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-02T19:36:56.730631] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T19:36:57.073190] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-02T19:36:57.652359] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T19:36:57.873030] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-02T19:36:58.425853] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T19:36:58.672998] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-02T19:36:59.114719] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-02T19:36:59.473037] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-02T19:36:59.707735] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T19:37:00.273017] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-02T19:37:00.873319] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T19:37:01.073055] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-02T19:37:01.507138] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-02T19:37:01.873014] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-02T19:37:02.411230] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-02T19:37:02.673000] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-02T19:37:03.351170] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T19:37:03.473062] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-02T19:37:04.079820] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-02T19:37:04.273008] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-02T19:37:04.578221] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T19:37:05.072997] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-02T19:37:05.667543] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T19:37:05.872979] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-02T19:37:06.170200] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T19:37:06.673009] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-02T19:37:07.466532] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T19:37:07.476389] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-02T19:37:08.202961] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-02T19:37:08.273048] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-02T19:37:08.494542] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T19:37:08.496254] [INFO ] [REMOTE ] INGM: Full fetch complete (42480 records). [2025-10-02T19:37:08.496421] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-02T19:37:08.956242] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-02T19:37:08.956339] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-02T19:37:08.957163] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-02T19:37:08.957299] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-02T19:37:08.958566] [DEBUG] [LOCAL ] INGM: Trimmed 42480 records to 28854 (keeping 200 days of data) [2025-10-02T19:37:09.074053] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-02T19:37:09.162057] [DEBUG] [LOCAL ] INGM: Primary data saved (28854 records). [2025-10-02T19:37:09.162219] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-02T19:37:09.162337] [INFO ] [MAIN ] Update Progress: 1112/2370 symbols completed. INGM took 37.2s. Estimated remaining: 2h 57m 43s. Rate: 7.1 symbols/min [2025-10-02T19:37:09.357041] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:37:09.401804] [DEBUG] [LOCAL ] INSW: Loaded 39994 existing records from primary storage. [2025-10-02T19:37:09.402125] [INFO ] [MAIN ] INSW: Loaded 39994 existing records. [2025-10-02T19:37:09.519749] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T19:37:09.543701] [INFO ] [REMOTE ] INGR: Full fetch complete (50228 records). [2025-10-02T19:37:09.574141] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-02T19:37:09.648536] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:37:09.686797] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-02T19:37:09.700921] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-02T19:37:09.733964] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-02T19:37:09.734076] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-02T19:37:09.885032] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-02T19:37:10.378824] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-02T19:37:10.405623] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-02T19:37:10.461310] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:37:10.462230] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-02T19:37:10.463008] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-02T19:37:10.464166] [DEBUG] [LOCAL ] INGR: Trimmed 50228 records to 33646 (keeping 200 days of data) [2025-10-02T19:37:10.673273] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-10-02T19:37:10.695211] [DEBUG] [LOCAL ] INGR: Primary data saved (33646 records). [2025-10-02T19:37:10.695345] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-02T19:37:10.696207] [INFO ] [MAIN ] Update Progress: 1113/2370 symbols completed. INGR took 37.2s. Estimated remaining: 2h 57m 27s. Rate: 7.1 symbols/min [2025-10-02T19:37:10.878416] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:37:10.908010] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T19:37:10.965482] [DEBUG] [LOCAL ] INVH: Loaded 53133 existing records from primary storage. [2025-10-02T19:37:10.965847] [INFO ] [MAIN ] INVH: Loaded 53133 existing records. [2025-10-02T19:37:11.156714] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:37:11.156940] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-02T19:37:11.156989] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-02T19:37:11.158730] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-02T19:37:11.158792] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-02T19:37:11.495693] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-02T19:37:11.540964] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:37:11.582243] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T19:37:12.273019] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-02T19:37:12.409831] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T19:37:12.755053] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T19:37:13.073005] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-10-02T19:37:13.385165] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T19:37:13.872998] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-02T19:37:14.672959] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-02T19:37:14.709930] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T19:37:15.371238] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-02T19:37:15.373335] [INFO ] [REMOTE ] INSP: Full fetch complete (53094 records). [2025-10-02T19:37:15.373472] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-02T19:37:15.478113] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-02T19:37:15.878512] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-02T19:37:15.878848] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-02T19:37:15.879750] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-02T19:37:15.879863] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-02T19:37:15.881577] [DEBUG] [LOCAL ] INSP: Trimmed 53094 records to 37471 (keeping 200 days of data) [2025-10-02T19:37:16.006186] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:37:16.170751] [DEBUG] [LOCAL ] INSP: Primary data saved (37471 records). [2025-10-02T19:37:16.170904] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-02T19:37:16.170988] [INFO ] [MAIN ] Update Progress: 1114/2370 symbols completed. INSP took 27.3s. Estimated remaining: 2h 57m 15s. Rate: 7.1 symbols/min [2025-10-02T19:37:16.280353] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-02T19:37:16.362825] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:37:16.393909] [DEBUG] [LOCAL ] INVX: Loaded 29044 existing records from primary storage. [2025-10-02T19:37:16.394273] [INFO ] [MAIN ] INVX: Loaded 29044 existing records. [2025-10-02T19:37:16.597674] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:37:16.597940] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-02T19:37:16.598008] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-02T19:37:16.599178] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-02T19:37:16.599241] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-02T19:37:17.001880] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:37:17.037373] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T19:37:17.073009] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-10-02T19:37:17.492137] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-02T19:37:17.873003] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-02T19:37:18.537875] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T19:37:18.673039] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-02T19:37:19.472999] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-02T19:37:19.549198] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T19:37:20.184197] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T19:37:20.272988] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-02T19:37:20.381768] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T19:37:21.073060] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-02T19:37:21.873025] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-02T19:37:21.927993] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T19:37:22.576232] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-02T19:37:22.673025] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-02T19:37:23.473038] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-02T19:37:23.693739] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:37:23.905704] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T19:37:23.907569] [INFO ] [REMOTE ] INN: Full fetch complete (57783 records). [2025-10-02T19:37:23.907704] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-02T19:37:24.278158] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-02T19:37:24.327287] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-02T19:37:24.327388] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-02T19:37:24.328264] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-02T19:37:24.328340] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-02T19:37:24.329727] [DEBUG] [LOCAL ] INN: Trimmed 57783 records to 41983 (keeping 200 days of data) [2025-10-02T19:37:24.593475] [DEBUG] [LOCAL ] INN: Primary data saved (41983 records). [2025-10-02T19:37:24.593610] [INFO ] [MAIN ] INN: Full history saved. [2025-10-02T19:37:24.593721] [INFO ] [MAIN ] Update Progress: 1115/2370 symbols completed. INN took 40.7s. Estimated remaining: 2h 57m 6s. Rate: 7.1 symbols/min [2025-10-02T19:37:24.785755] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:37:24.842477] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-02T19:37:24.842847] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-02T19:37:25.037400] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:37:25.037710] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-02T19:37:25.037787] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-02T19:37:25.047453] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-02T19:37:25.063248] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-02T19:37:25.078202] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-02T19:37:25.106790] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T19:37:25.460551] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:37:25.859913] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T19:37:25.872944] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-02T19:37:25.902364] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T19:37:26.673046] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-02T19:37:27.473003] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-02T19:37:27.752266] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-02T19:37:27.826558] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:37:28.273004] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-02T19:37:29.083432] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-02T19:37:29.089188] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T19:37:29.682030] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T19:37:29.873034] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-10-02T19:37:30.422385] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-02T19:37:30.673058] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-02T19:37:31.473035] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-02T19:37:31.954900] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T19:37:32.272981] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-02T19:37:32.607801] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-10-02T19:37:32.663301] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T19:37:33.072984] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-02T19:37:33.882826] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-02T19:37:33.907331] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-02T19:37:34.543666] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-02T19:37:34.673041] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-02T19:37:35.256762] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:37:35.473007] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-02T19:37:36.053578] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-02T19:37:36.273021] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-02T19:37:36.832081] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-02T19:37:37.073038] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-02T19:37:37.873046] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-02T19:37:37.970213] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T19:37:38.672985] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-02T19:37:38.811871] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-02T19:37:39.473002] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-02T19:37:39.697478] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-10-02T19:37:40.042909] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-02T19:37:40.273014] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-02T19:37:41.073015] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-02T19:37:41.439705] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-02T19:37:41.872984] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-02T19:37:42.258164] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T19:37:42.314138] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-02T19:37:42.673041] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-02T19:37:43.186335] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T19:37:43.188528] [INFO ] [REMOTE ] INVH: Full fetch complete (76725 records). [2025-10-02T19:37:43.188731] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-02T19:37:43.479754] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-02T19:37:43.628382] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-02T19:37:43.671671] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-02T19:37:43.671987] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-02T19:37:43.673112] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-02T19:37:43.673203] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-02T19:37:43.671892] [INFO ] [REMOTE ] INVX: Full fetch complete (44095 records). [2025-10-02T19:37:43.673584] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-02T19:37:43.780921] [DEBUG] [LOCAL ] INVH: Trimmed 76725 records to 53521 (keeping 200 days of data) [2025-10-02T19:37:44.208041] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-02T19:37:44.209019] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-02T19:37:44.210169] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-02T19:37:44.210532] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-02T19:37:44.218048] [DEBUG] [LOCAL ] INVX: Trimmed 44095 records to 29238 (keeping 200 days of data) [2025-10-02T19:37:44.281543] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-02T19:37:44.607829] [DEBUG] [LOCAL ] INVX: Primary data saved (29238 records). [2025-10-02T19:37:44.608282] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-02T19:37:44.621352] [INFO ] [MAIN ] Update Progress: 1116/2370 symbols completed. INVX took 28.5s. Estimated remaining: 2h 57m 11s. Rate: 7.1 symbols/min [2025-10-02T19:37:44.630384] [DEBUG] [LOCAL ] INVH: Primary data saved (53521 records). [2025-10-02T19:37:44.635947] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-02T19:37:44.643926] [INFO ] [MAIN ] Update Progress: 1117/2370 symbols completed. INVH took 33.9s. Estimated remaining: 2h 56m 53s. Rate: 7.1 symbols/min [2025-10-02T19:37:44.834144] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:37:44.887618] [DEBUG] [LOCAL ] IOT: Loaded 53471 existing records from primary storage. [2025-10-02T19:37:44.887994] [INFO ] [MAIN ] IOT: Loaded 53471 existing records. [2025-10-02T19:37:45.100091] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:37:45.121746] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-02T19:37:45.121884] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-02T19:37:45.123563] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-02T19:37:45.123495] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T19:37:45.123733] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-02T19:37:45.217907] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-02T19:37:45.518313] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:37:45.873038] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-10-02T19:37:46.532273] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T19:37:46.534049] [INFO ] [REMOTE ] INSW: Full fetch complete (60500 records). [2025-10-02T19:37:46.534213] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-02T19:37:46.965492] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-02T19:37:46.965595] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-02T19:37:46.966627] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-02T19:37:46.966769] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-02T19:37:46.968407] [DEBUG] [LOCAL ] INSW: Trimmed 60500 records to 40240 (keeping 200 days of data) [2025-10-02T19:37:47.098563] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.82 seconds). [2025-10-02T19:37:47.114704] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-02T19:37:47.273001] [DEBUG] [LOCAL ] INSW: Primary data saved (40240 records). [2025-10-02T19:37:47.273140] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-02T19:37:47.273225] [INFO ] [MAIN ] Update Progress: 1118/2370 symbols completed. INSW took 38.1s. Estimated remaining: 2h 56m 38s. Rate: 7.1 symbols/min [2025-10-02T19:37:47.529740] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-10-02T19:37:47.542621] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-02T19:37:49.281973] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T19:37:49.293305] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-02T19:37:49.933423] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-10-02T19:37:49.945782] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-02T19:37:51.117688] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-02T19:37:51.128301] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-02T19:37:52.371796] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-02T19:37:52.383893] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-02T19:37:53.031163] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-02T19:37:53.042921] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-02T19:37:54.613219] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-02T19:37:54.624928] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-02T19:37:54.702638] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T19:37:54.714441] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-02T19:37:56.062914] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-02T19:37:56.074834] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-02T19:37:57.596474] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-10-02T19:37:57.615881] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-02T19:37:57.660423] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-02T19:37:57.672602] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-02T19:37:59.704438] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T19:37:59.717050] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-02T19:37:59.957453] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-10-02T19:37:59.970556] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-02T19:38:01.650075] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-02T19:38:01.662171] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-02T19:38:02.766964] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.80 seconds). [2025-10-02T19:38:02.778873] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-02T19:38:03.301018] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-02T19:38:03.312867] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-02T19:38:04.608613] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T19:38:04.610884] [INFO ] [REMOTE ] IOT: Full fetch complete (77383 records). [2025-10-02T19:38:04.611094] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-02T19:38:05.042069] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-02T19:38:05.042196] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-02T19:38:05.043274] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-02T19:38:05.043344] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-02T19:38:05.045053] [DEBUG] [LOCAL ] IOT: Trimmed 77383 records to 53861 (keeping 200 days of data) [2025-10-02T19:38:05.370886] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.59 seconds). [2025-10-02T19:38:05.375026] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-02T19:38:05.375817] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-02T19:38:05.824475] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-02T19:38:05.825123] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-02T19:38:05.826503] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-02T19:38:05.826911] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-02T19:38:05.831837] [DEBUG] [LOCAL ] IOT: Primary data saved (53861 records). [2025-10-02T19:38:05.832127] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-02T19:38:05.832283] [INFO ] [MAIN ] Update Progress: 1119/2370 symbols completed. IOT took 21.2s. Estimated remaining: 2h 56m 41s. Rate: 7.1 symbols/min [2025-10-02T19:38:05.833182] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54178 (keeping 200 days of data) [2025-10-02T19:38:06.180475] [DEBUG] [LOCAL ] IONQ: Primary data saved (54178 records). [2025-10-02T19:38:06.180659] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-02T19:38:06.180768] [INFO ] [MAIN ] Update Progress: 1120/2370 symbols completed. IONQ took 41.6s. Estimated remaining: 2h 56m 23s. Rate: 7.1 symbols/min [2025-10-02T19:38:06.768531] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:06.887867] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:06.917561] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:07.003682] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:07.025131] [DEBUG] [LOCAL ] IPI: Loaded 21433 existing records from primary storage. [2025-10-02T19:38:07.029906] [INFO ] [MAIN ] IPI: Loaded 21433 existing records. [2025-10-02T19:38:07.155233] [DEBUG] [LOCAL ] IQI: Loaded 18090 existing records from primary storage. [2025-10-02T19:38:07.166064] [INFO ] [MAIN ] IQI: Loaded 18090 existing records. [2025-10-02T19:38:07.262677] [DEBUG] [LOCAL ] IP: Loaded 53313 existing records from primary storage. [2025-10-02T19:38:07.307795] [DEBUG] [LOCAL ] IPG: Loaded 53330 existing records from primary storage. [2025-10-02T19:38:07.377076] [INFO ] [MAIN ] IP: Loaded 53313 existing records. [2025-10-02T19:38:07.392190] [INFO ] [MAIN ] IPG: Loaded 53330 existing records. [2025-10-02T19:38:07.423341] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:07.497709] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-02T19:38:07.550766] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-02T19:38:07.621065] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-02T19:38:07.711531] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-02T19:38:07.792543] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:07.792852] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-02T19:38:07.803760] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-02T19:38:07.871765] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-02T19:38:08.003519] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:08.008980] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-02T19:38:08.017924] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-02T19:38:08.017821] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:08.087316] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-02T19:38:08.040569] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-02T19:38:08.108042] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-02T19:38:08.125224] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-02T19:38:08.140417] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-02T19:38:08.153736] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-02T19:38:08.175746] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-02T19:38:09.431723] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:09.435779] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:09.458341] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-10-02T19:38:09.458084] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-10-02T19:38:09.588455] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:09.622039] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-10-02T19:38:09.628481] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:09.628917] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-10-02T19:38:10.638889] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-10-02T19:38:10.643523] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-02T19:38:10.725062] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-10-02T19:38:10.730846] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-02T19:38:11.364744] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T19:38:11.399875] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-02T19:38:11.399049] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T19:38:11.412201] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-02T19:38:11.492598] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-10-02T19:38:11.508414] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T19:38:11.516112] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-02T19:38:11.509460] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-02T19:38:12.215520] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-02T19:38:12.220538] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-02T19:38:12.512812] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:38:12.518467] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-02T19:38:13.067262] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-02T19:38:13.079102] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-02T19:38:13.358037] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-02T19:38:13.381163] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-02T19:38:13.398073] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-02T19:38:13.410198] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-02T19:38:13.575919] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T19:38:13.580379] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-02T19:38:14.278374] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T19:38:14.284380] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-02T19:38:14.335141] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-02T19:38:14.340607] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-02T19:38:14.496106] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-02T19:38:14.672997] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-02T19:38:15.109533] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T19:38:15.155833] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T19:38:15.201231] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T19:38:15.472997] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-02T19:38:16.174788] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-02T19:38:16.223400] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T19:38:16.273011] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-02T19:38:17.018774] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T19:38:17.073003] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-02T19:38:17.873010] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-02T19:38:18.672983] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-02T19:38:18.971263] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T19:38:19.473025] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-02T19:38:19.476254] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-02T19:38:19.653520] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T19:38:20.272998] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-02T19:38:21.072981] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-02T19:38:21.185682] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-02T19:38:21.262539] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-02T19:38:21.873043] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-02T19:38:22.673003] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-02T19:38:22.818668] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T19:38:23.007068] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-02T19:38:23.473057] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-02T19:38:24.123092] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-02T19:38:24.124368] [INFO ] [REMOTE ] IQI: Full fetch complete (27034 records). [2025-10-02T19:38:24.124455] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-02T19:38:24.273539] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-02T19:38:24.562044] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-02T19:38:24.562173] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-02T19:38:24.562825] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-02T19:38:24.562989] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-02T19:38:24.564305] [DEBUG] [LOCAL ] IQI: Trimmed 27034 records to 18227 (keeping 200 days of data) [2025-10-02T19:38:24.679465] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T19:38:24.725455] [DEBUG] [LOCAL ] IQI: Primary data saved (18227 records). [2025-10-02T19:38:24.725585] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-02T19:38:24.725730] [INFO ] [MAIN ] Update Progress: 1121/2370 symbols completed. IQI took 18.5s. Estimated remaining: 2h 56m 26s. Rate: 7.1 symbols/min [2025-10-02T19:38:24.920772] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:24.975414] [DEBUG] [LOCAL ] IQV: Loaded 50102 existing records from primary storage. [2025-10-02T19:38:24.975783] [INFO ] [MAIN ] IQV: Loaded 50102 existing records. [2025-10-02T19:38:25.078900] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-02T19:38:25.176196] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:25.176432] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-02T19:38:25.176550] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-02T19:38:25.177876] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-02T19:38:25.177939] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-02T19:38:25.605631] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:25.873029] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-10-02T19:38:26.241039] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-02T19:38:26.672997] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-02T19:38:26.986208] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-02T19:38:27.340952] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T19:38:27.473005] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-02T19:38:27.721405] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-02T19:38:28.273057] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-02T19:38:29.073013] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-02T19:38:29.148544] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T19:38:29.370985] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T19:38:29.873073] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-02T19:38:30.673011] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-02T19:38:30.842594] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-02T19:38:31.388606] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:38:31.456126] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T19:38:31.473009] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-02T19:38:32.272994] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-02T19:38:32.349567] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T19:38:32.350894] [INFO ] [REMOTE ] IPI: Full fetch complete (29307 records). [2025-10-02T19:38:32.350969] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-02T19:38:32.749238] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-02T19:38:32.749342] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-02T19:38:32.749953] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-02T19:38:32.750017] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-02T19:38:32.750810] [DEBUG] [LOCAL ] IPI: Trimmed 29307 records to 21605 (keeping 200 days of data) [2025-10-02T19:38:32.880242] [DEBUG] [LOCAL ] IPI: Primary data saved (21605 records). [2025-10-02T19:38:32.880366] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-02T19:38:32.880446] [INFO ] [MAIN ] Update Progress: 1122/2370 symbols completed. IPI took 26.7s. Estimated remaining: 2h 56m 17s. Rate: 7.1 symbols/min [2025-10-02T19:38:33.070602] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:33.073072] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-02T19:38:33.126098] [DEBUG] [LOCAL ] IR: Loaded 52690 existing records from primary storage. [2025-10-02T19:38:33.126458] [INFO ] [MAIN ] IR: Loaded 52690 existing records. [2025-10-02T19:38:33.320535] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:33.320793] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-02T19:38:33.320846] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-02T19:38:33.322222] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-02T19:38:33.322287] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-02T19:38:33.738103] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:33.873038] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-10-02T19:38:34.082268] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-02T19:38:34.672980] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-02T19:38:34.912210] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-02T19:38:35.405187] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T19:38:35.473037] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-02T19:38:36.123092] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-02T19:38:36.125377] [INFO ] [REMOTE ] IPG: Full fetch complete (77253 records). [2025-10-02T19:38:36.125523] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-02T19:38:36.278100] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-02T19:38:36.620743] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-02T19:38:36.620842] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-02T19:38:36.621846] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-02T19:38:36.621917] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-02T19:38:36.623980] [DEBUG] [LOCAL ] IPG: Trimmed 77253 records to 53719 (keeping 200 days of data) [2025-10-02T19:38:36.973420] [DEBUG] [LOCAL ] IPG: Primary data saved (53719 records). [2025-10-02T19:38:36.973715] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-02T19:38:36.973823] [INFO ] [MAIN ] Update Progress: 1123/2370 symbols completed. IPG took 30.8s. Estimated remaining: 2h 56m 4s. Rate: 7.1 symbols/min [2025-10-02T19:38:37.075499] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-02T19:38:37.136353] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T19:38:37.225250] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:37.274980] [DEBUG] [LOCAL ] IRM: Loaded 49302 existing records from primary storage. [2025-10-02T19:38:37.275369] [INFO ] [MAIN ] IRM: Loaded 49302 existing records. [2025-10-02T19:38:37.478625] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:37.478906] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-02T19:38:37.478961] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-02T19:38:37.480240] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-02T19:38:37.480300] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-02T19:38:37.878603] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:37.874319] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-02T19:38:38.090813] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-02T19:38:38.359618] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-02T19:38:38.673055] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-02T19:38:39.438762] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-02T19:38:39.472969] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-02T19:38:40.273023] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-10-02T19:38:40.399732] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T19:38:40.960806] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-02T19:38:40.962977] [INFO ] [REMOTE ] IP: Full fetch complete (77100 records). [2025-10-02T19:38:40.963089] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-02T19:38:41.074418] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-02T19:38:41.381975] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-02T19:38:41.382094] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-02T19:38:41.383101] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-02T19:38:41.383169] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-02T19:38:41.384800] [DEBUG] [LOCAL ] IP: Trimmed 77100 records to 53702 (keeping 200 days of data) [2025-10-02T19:38:41.779168] [DEBUG] [LOCAL ] IP: Primary data saved (53702 records). [2025-10-02T19:38:41.779344] [INFO ] [MAIN ] IP: Full history saved. [2025-10-02T19:38:41.780544] [INFO ] [MAIN ] Update Progress: 1124/2370 symbols completed. IP took 35.6s. Estimated remaining: 2h 55m 51s. Rate: 7.1 symbols/min [2025-10-02T19:38:41.876594] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-02T19:38:41.981999] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:38:42.016723] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T19:38:42.045017] [DEBUG] [LOCAL ] IRS: Loaded 21936 existing records from primary storage. [2025-10-02T19:38:42.045293] [INFO ] [MAIN ] IRS: Loaded 21936 existing records. [2025-10-02T19:38:42.258897] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:38:42.259212] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-02T19:38:42.259269] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-02T19:38:42.260048] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-02T19:38:42.260112] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-02T19:38:42.675098] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-02T19:38:42.674870] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:38:42.903985] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T19:38:43.472970] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-02T19:38:43.659039] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-02T19:38:44.127436] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:38:44.273021] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-02T19:38:45.072969] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-10-02T19:38:45.263245] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T19:38:45.872997] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-02T19:38:45.972092] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-02T19:38:46.394327] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-10-02T19:38:46.673019] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-02T19:38:47.312165] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-02T19:38:47.473027] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-02T19:38:47.968401] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T19:38:48.273008] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-02T19:38:49.072980] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-02T19:38:49.315091] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T19:38:49.360778] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-02T19:38:49.873043] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-02T19:38:50.672987] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-02T19:38:50.907009] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T19:38:51.472978] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-02T19:38:51.585974] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T19:38:52.185610] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T19:38:52.273023] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-02T19:38:52.437148] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-02T19:38:53.073011] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-02T19:38:53.873062] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-02T19:38:53.929695] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T19:38:54.322861] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T19:38:54.672974] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-02T19:38:54.927924] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-02T19:38:55.473014] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-02T19:38:56.084990] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T19:38:56.273002] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-02T19:38:57.073038] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-02T19:38:57.306077] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T19:38:57.873125] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-02T19:38:57.976400] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-02T19:38:58.672991] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-02T19:38:58.784490] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-02T19:38:59.443570] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T19:38:59.472984] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-02T19:38:59.510825] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T19:39:00.273010] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-02T19:39:00.639195] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T19:39:01.073004] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-02T19:39:01.655170] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T19:39:01.873000] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-02T19:39:02.673015] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-02T19:39:02.815102] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T19:39:03.473072] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-02T19:39:03.587099] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-02T19:39:03.899917] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T19:39:03.902444] [INFO ] [REMOTE ] IQV: Full fetch complete (72192 records). [2025-10-02T19:39:03.902710] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-02T19:39:04.278139] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-02T19:39:04.384112] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-02T19:39:04.384231] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-02T19:39:04.385277] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-02T19:39:04.385448] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-02T19:39:04.387682] [DEBUG] [LOCAL ] IQV: Trimmed 72192 records to 50465 (keeping 200 days of data) [2025-10-02T19:39:04.608625] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T19:39:04.742930] [DEBUG] [LOCAL ] IQV: Primary data saved (50465 records). [2025-10-02T19:39:04.743086] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-02T19:39:04.743227] [INFO ] [MAIN ] Update Progress: 1125/2370 symbols completed. IQV took 40.0s. Estimated remaining: 2h 55m 59s. Rate: 7.1 symbols/min [2025-10-02T19:39:04.922387] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:04.976964] [DEBUG] [LOCAL ] IRT: Loaded 50401 existing records from primary storage. [2025-10-02T19:39:04.977334] [INFO ] [MAIN ] IRT: Loaded 50401 existing records. [2025-10-02T19:39:05.078261] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-02T19:39:05.174833] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:05.175049] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-02T19:39:05.175100] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-02T19:39:05.176575] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-02T19:39:05.176668] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-02T19:39:05.567245] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:05.826853] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-02T19:39:05.829848] [INFO ] [REMOTE ] IR: Full fetch complete (76181 records). [2025-10-02T19:39:05.829977] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-02T19:39:05.878161] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-02T19:39:06.294362] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-02T19:39:06.295148] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-02T19:39:06.294954] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T19:39:06.296331] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-02T19:39:06.301703] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-02T19:39:06.309198] [DEBUG] [LOCAL ] IR: Trimmed 76181 records to 53077 (keeping 200 days of data) [2025-10-02T19:39:06.663154] [DEBUG] [LOCAL ] IR: Primary data saved (53077 records). [2025-10-02T19:39:06.663299] [INFO ] [MAIN ] IR: Full history saved. [2025-10-02T19:39:06.663422] [INFO ] [MAIN ] Update Progress: 1126/2370 symbols completed. IR took 33.8s. Estimated remaining: 2h 55m 43s. Rate: 7.1 symbols/min [2025-10-02T19:39:06.678158] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-02T19:39:06.861226] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:06.879840] [DEBUG] [LOCAL ] ISD: Loaded 15574 existing records from primary storage. [2025-10-02T19:39:06.880205] [INFO ] [MAIN ] ISD: Loaded 15574 existing records. [2025-10-02T19:39:07.075607] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:07.075849] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-02T19:39:07.075910] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-02T19:39:07.076567] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-02T19:39:07.076629] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-02T19:39:07.472545] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:07.473064] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-10-02T19:39:07.550233] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T19:39:08.071097] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-02T19:39:08.272998] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-02T19:39:08.585184] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-10-02T19:39:09.073003] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-10-02T19:39:09.480798] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T19:39:09.483023] [INFO ] [REMOTE ] IRS: Full fetch complete (32271 records). [2025-10-02T19:39:09.483172] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-02T19:39:09.881459] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-02T19:39:09.927254] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-02T19:39:09.927337] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-02T19:39:09.928066] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-02T19:39:09.928133] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-02T19:39:09.929036] [DEBUG] [LOCAL ] IRS: Trimmed 32271 records to 22194 (keeping 200 days of data) [2025-10-02T19:39:10.070174] [DEBUG] [LOCAL ] IRS: Primary data saved (22194 records). [2025-10-02T19:39:10.070309] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-02T19:39:10.070395] [INFO ] [MAIN ] Update Progress: 1127/2370 symbols completed. IRS took 28.3s. Estimated remaining: 2h 55m 29s. Rate: 7.1 symbols/min [2025-10-02T19:39:10.255218] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:10.306629] [DEBUG] [LOCAL ] IT: Loaded 42034 existing records from primary storage. [2025-10-02T19:39:10.307169] [INFO ] [MAIN ] IT: Loaded 42034 existing records. [2025-10-02T19:39:10.541203] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:10.541464] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-02T19:39:10.541558] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-02T19:39:10.542724] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-02T19:39:10.542801] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-02T19:39:10.676336] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-02T19:39:10.941576] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-10-02T19:39:10.992560] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:11.009597] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T19:39:11.473001] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-02T19:39:12.273012] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-10-02T19:39:12.503982] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-10-02T19:39:13.012630] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T19:39:13.072996] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-02T19:39:13.679135] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T19:39:13.872992] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-02T19:39:14.574320] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:39:14.673004] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-02T19:39:15.303921] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-02T19:39:15.473004] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-02T19:39:16.209361] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T19:39:16.273026] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-02T19:39:16.789298] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-02T19:39:17.073024] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-02T19:39:17.872990] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-02T19:39:17.983338] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-02T19:39:18.023529] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-02T19:39:18.673060] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-02T19:39:19.473052] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-02T19:39:19.654393] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T19:39:19.671548] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-02T19:39:20.273041] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-02T19:39:21.027839] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-02T19:39:21.072973] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-02T19:39:21.872968] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-02T19:39:21.904517] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-02T19:39:22.543667] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-02T19:39:22.545746] [INFO ] [REMOTE ] IRM: Full fetch complete (72245 records). [2025-10-02T19:39:22.545864] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-02T19:39:22.678087] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-02T19:39:22.958028] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-02T19:39:22.958121] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-02T19:39:22.959164] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-02T19:39:22.959233] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-02T19:39:22.960855] [DEBUG] [LOCAL ] IRM: Trimmed 72245 records to 49653 (keeping 200 days of data) [2025-10-02T19:39:23.285688] [DEBUG] [LOCAL ] IRM: Primary data saved (49653 records). [2025-10-02T19:39:23.285861] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-02T19:39:23.285971] [INFO ] [MAIN ] Update Progress: 1128/2370 symbols completed. IRM took 46.3s. Estimated remaining: 2h 55m 26s. Rate: 7.1 symbols/min [2025-10-02T19:39:23.479393] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:23.479496] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-02T19:39:23.512700] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T19:39:23.553761] [DEBUG] [LOCAL ] ITGR: Loaded 31386 existing records from primary storage. [2025-10-02T19:39:23.554095] [INFO ] [MAIN ] ITGR: Loaded 31386 existing records. [2025-10-02T19:39:23.751550] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:23.751790] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-02T19:39:23.751843] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-02T19:39:23.752742] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-02T19:39:23.752804] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-02T19:39:24.157858] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:24.273008] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-02T19:39:24.302039] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-02T19:39:25.073020] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-02T19:39:25.218578] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T19:39:25.664186] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T19:39:25.873040] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-02T19:39:26.177147] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-02T19:39:26.452518] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T19:39:26.673037] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-02T19:39:27.473014] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-02T19:39:28.231266] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T19:39:28.272971] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-10-02T19:39:28.317944] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-02T19:39:29.073009] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-02T19:39:29.560085] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-10-02T19:39:29.873019] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-02T19:39:30.175482] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-02T19:39:30.673076] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-02T19:39:31.474582] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-02T19:39:31.478211] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-02T19:39:31.506023] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-02T19:39:32.273013] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-02T19:39:32.548824] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-02T19:39:33.072934] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-02T19:39:33.606374] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T19:39:33.608461] [INFO ] [REMOTE ] IRT: Full fetch complete (72616 records). [2025-10-02T19:39:33.608586] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-02T19:39:33.882567] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-02T19:39:34.054247] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-02T19:39:34.054404] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-02T19:39:34.055516] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-02T19:39:34.055621] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-02T19:39:34.057283] [DEBUG] [LOCAL ] IRT: Trimmed 72616 records to 50773 (keeping 200 days of data) [2025-10-02T19:39:34.278101] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-02T19:39:34.421789] [DEBUG] [LOCAL ] IRT: Primary data saved (50773 records). [2025-10-02T19:39:34.421982] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-02T19:39:34.422078] [INFO ] [MAIN ] Update Progress: 1129/2370 symbols completed. IRT took 29.7s. Estimated remaining: 2h 55m 20s. Rate: 7.1 symbols/min [2025-10-02T19:39:34.606794] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:34.644625] [DEBUG] [LOCAL ] ITT: Loaded 32783 existing records from primary storage. [2025-10-02T19:39:34.645019] [INFO ] [MAIN ] ITT: Loaded 32783 existing records. [2025-10-02T19:39:34.678129] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-02T19:39:34.846922] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:34.847201] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-02T19:39:34.847265] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-02T19:39:34.848579] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-02T19:39:34.848675] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-02T19:39:35.272249] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:35.296806] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-02T19:39:35.473038] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-02T19:39:36.223824] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-02T19:39:36.272987] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-02T19:39:36.336455] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-02T19:39:37.073058] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-02T19:39:37.592628] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T19:39:37.744771] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-02T19:39:37.746080] [INFO ] [REMOTE ] ISD: Full fetch complete (24019 records). [2025-10-02T19:39:37.746165] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-02T19:39:37.878204] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-02T19:39:38.154492] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-02T19:39:38.154576] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-02T19:39:38.155206] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-02T19:39:38.155272] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-02T19:39:38.156211] [DEBUG] [LOCAL ] ISD: Trimmed 24019 records to 15710 (keeping 200 days of data) [2025-10-02T19:39:38.254630] [DEBUG] [LOCAL ] ISD: Primary data saved (15710 records). [2025-10-02T19:39:38.254813] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-02T19:39:38.254941] [INFO ] [MAIN ] Update Progress: 1130/2370 symbols completed. ISD took 31.6s. Estimated remaining: 2h 55m 6s. Rate: 7.1 symbols/min [2025-10-02T19:39:38.433385] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:38.487375] [DEBUG] [LOCAL ] ITUB: Loaded 53325 existing records from primary storage. [2025-10-02T19:39:38.487758] [INFO ] [MAIN ] ITUB: Loaded 53325 existing records. [2025-10-02T19:39:38.683254] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-02T19:39:38.690818] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:38.692102] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-02T19:39:38.692181] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-02T19:39:38.694226] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-02T19:39:38.694289] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-02T19:39:39.099488] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:39.472975] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-10-02T19:39:39.513875] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T19:39:40.136728] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T19:39:40.273016] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-02T19:39:40.800174] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T19:39:41.073040] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-02T19:39:41.759603] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T19:39:41.873003] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-02T19:39:42.312583] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T19:39:42.673057] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-02T19:39:43.223454] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T19:39:43.472978] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-02T19:39:43.762509] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T19:39:44.273022] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-02T19:39:44.727009] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T19:39:45.073000] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-02T19:39:45.687002] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T19:39:45.873030] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-02T19:39:46.332848] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T19:39:46.334716] [INFO ] [REMOTE ] IT: Full fetch complete (56194 records). [2025-10-02T19:39:46.334863] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-02T19:39:46.678202] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-10-02T19:39:46.762376] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-02T19:39:46.762475] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-02T19:39:46.763364] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-02T19:39:46.763428] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-02T19:39:46.764819] [DEBUG] [LOCAL ] IT: Trimmed 56194 records to 42328 (keeping 200 days of data) [2025-10-02T19:39:47.043106] [DEBUG] [LOCAL ] IT: Primary data saved (42328 records). [2025-10-02T19:39:47.043279] [INFO ] [MAIN ] IT: Full history saved. [2025-10-02T19:39:47.044233] [INFO ] [MAIN ] Update Progress: 1131/2370 symbols completed. IT took 37.0s. Estimated remaining: 2h 54m 58s. Rate: 7.1 symbols/min [2025-10-02T19:39:47.246884] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:47.307923] [DEBUG] [LOCAL ] ITW: Loaded 45819 existing records from primary storage. [2025-10-02T19:39:47.308305] [INFO ] [MAIN ] ITW: Loaded 45819 existing records. [2025-10-02T19:39:47.455742] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-02T19:39:47.478996] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-02T19:39:47.544767] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:47.545328] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-02T19:39:47.545428] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-02T19:39:47.547264] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-02T19:39:47.547333] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-02T19:39:47.972449] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:48.200635] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-10-02T19:39:48.272966] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-02T19:39:48.661201] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T19:39:49.073010] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-02T19:39:49.714744] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:39:49.873017] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-02T19:39:50.431891] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T19:39:50.673012] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-02T19:39:51.364117] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T19:39:51.473060] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-10-02T19:39:51.698337] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-02T19:39:51.701947] [INFO ] [REMOTE ] ITGR: Full fetch complete (41788 records). [2025-10-02T19:39:51.702051] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-02T19:39:52.179322] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-02T19:39:52.179437] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-02T19:39:52.180870] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-02T19:39:52.180941] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-02T19:39:52.182388] [DEBUG] [LOCAL ] ITGR: Trimmed 41788 records to 31551 (keeping 200 days of data) [2025-10-02T19:39:52.273342] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-02T19:39:52.401815] [DEBUG] [LOCAL ] ITGR: Primary data saved (31551 records). [2025-10-02T19:39:52.402041] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-02T19:39:52.402184] [INFO ] [MAIN ] Update Progress: 1132/2370 symbols completed. ITGR took 29.1s. Estimated remaining: 2h 54m 46s. Rate: 7.1 symbols/min [2025-10-02T19:39:52.573316] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:39:52.627188] [DEBUG] [LOCAL ] IVR: Loaded 47888 existing records from primary storage. [2025-10-02T19:39:52.627677] [INFO ] [MAIN ] IVR: Loaded 47888 existing records. [2025-10-02T19:39:52.820882] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:39:52.821406] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-02T19:39:52.821470] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-02T19:39:52.825490] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-02T19:39:52.825557] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-02T19:39:53.081737] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-02T19:39:53.233453] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:39:53.245492] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-10-02T19:39:53.873044] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-10-02T19:39:54.071296] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-02T19:39:54.413523] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T19:39:54.673023] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-02T19:39:55.345691] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-10-02T19:39:55.473080] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-02T19:39:56.163824] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:39:56.273009] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-02T19:39:57.073008] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-02T19:39:57.122997] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-02T19:39:57.883709] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-02T19:39:57.890003] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-02T19:39:58.555453] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-02T19:39:58.672999] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-02T19:39:59.269137] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-02T19:39:59.473076] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-02T19:40:00.257585] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T19:40:00.272963] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-02T19:40:01.073018] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-02T19:40:01.705967] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-02T19:40:01.872999] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-02T19:40:02.394059] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T19:40:02.509355] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-10-02T19:40:02.673029] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-02T19:40:03.473003] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-02T19:40:03.750474] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-02T19:40:04.034198] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T19:40:04.273020] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-02T19:40:05.073029] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-02T19:40:05.291914] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T19:40:05.873045] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-02T19:40:05.903432] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-02T19:40:05.905017] [INFO ] [REMOTE ] ITT: Full fetch complete (47024 records). [2025-10-02T19:40:05.905143] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-02T19:40:06.362502] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-02T19:40:06.362860] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-02T19:40:06.364313] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-02T19:40:06.365592] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-10-02T19:40:06.376149] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-02T19:40:06.377839] [DEBUG] [LOCAL ] ITT: Trimmed 47024 records to 32995 (keeping 200 days of data) [2025-10-02T19:40:06.612511] [DEBUG] [LOCAL ] ITT: Primary data saved (32995 records). [2025-10-02T19:40:06.612680] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-02T19:40:06.612784] [INFO ] [MAIN ] Update Progress: 1133/2370 symbols completed. ITT took 32.2s. Estimated remaining: 2h 54m 44s. Rate: 7.1 symbols/min [2025-10-02T19:40:06.684147] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-02T19:40:06.806214] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:40:06.839384] [DEBUG] [LOCAL ] IVT: Loaded 30693 existing records from primary storage. [2025-10-02T19:40:06.839688] [INFO ] [MAIN ] IVT: Loaded 30693 existing records. [2025-10-02T19:40:07.028108] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:40:07.028375] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-02T19:40:07.028426] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-02T19:40:07.029734] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-02T19:40:07.029824] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-02T19:40:07.468850] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:40:07.472979] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-02T19:40:07.552288] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T19:40:08.273034] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-02T19:40:08.647570] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-02T19:40:08.996562] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T19:40:09.073000] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-02T19:40:09.873012] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-02T19:40:10.282252] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T19:40:10.673009] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-10-02T19:40:10.758820] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-02T19:40:11.473065] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-02T19:40:11.688951] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-02T19:40:12.030989] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T19:40:12.272990] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-02T19:40:12.655904] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T19:40:13.072996] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-02T19:40:13.560195] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T19:40:13.873001] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-02T19:40:14.672994] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-02T19:40:14.920106] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-10-02T19:40:15.473061] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-02T19:40:15.570350] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-02T19:40:16.273045] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-02T19:40:16.505887] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T19:40:17.013210] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T19:40:17.073006] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-02T19:40:17.873012] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-02T19:40:18.235466] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-02T19:40:18.673684] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T19:40:18.673778] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-02T19:40:19.132263] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:40:19.473025] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-02T19:40:20.273027] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-02T19:40:20.511372] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T19:40:21.073030] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-02T19:40:21.162402] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T19:40:21.521982] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-02T19:40:21.873007] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-02T19:40:22.589218] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T19:40:22.591435] [INFO ] [REMOTE ] ITUB: Full fetch complete (77169 records). [2025-10-02T19:40:22.591677] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-02T19:40:22.678199] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-02T19:40:23.038612] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-02T19:40:23.038729] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-02T19:40:23.039823] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-02T19:40:23.039889] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-02T19:40:23.041389] [DEBUG] [LOCAL ] ITUB: Trimmed 77169 records to 53711 (keeping 200 days of data) [2025-10-02T19:40:23.377991] [DEBUG] [LOCAL ] ITUB: Primary data saved (53711 records). [2025-10-02T19:40:23.378167] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-02T19:40:23.378295] [INFO ] [MAIN ] Update Progress: 1134/2370 symbols completed. ITUB took 45.1s. Estimated remaining: 2h 54m 45s. Rate: 7.1 symbols/min [2025-10-02T19:40:23.477276] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-02T19:40:23.579369] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:40:23.637993] [DEBUG] [LOCAL ] IVZ: Loaded 53128 existing records from primary storage. [2025-10-02T19:40:23.638382] [INFO ] [MAIN ] IVZ: Loaded 53128 existing records. [2025-10-02T19:40:23.881595] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-10-02T19:40:23.879665] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:40:23.892499] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-02T19:40:23.892596] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-02T19:40:23.894991] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-02T19:40:23.895062] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-02T19:40:24.310743] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:40:24.304405] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-02T19:40:24.333190] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-02T19:40:24.645863] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-02T19:40:24.647743] [INFO ] [REMOTE ] ITW: Full fetch complete (66374 records). [2025-10-02T19:40:24.647846] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-02T19:40:25.061913] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-02T19:40:25.062004] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-02T19:40:25.062966] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-02T19:40:25.063050] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-02T19:40:25.064520] [DEBUG] [LOCAL ] ITW: Trimmed 66374 records to 46101 (keeping 200 days of data) [2025-10-02T19:40:25.126094] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-10-02T19:40:25.390273] [DEBUG] [LOCAL ] ITW: Primary data saved (46101 records). [2025-10-02T19:40:25.390411] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-02T19:40:25.391818] [INFO ] [MAIN ] Update Progress: 1135/2370 symbols completed. ITW took 38.3s. Estimated remaining: 2h 54m 29s. Rate: 7.1 symbols/min [2025-10-02T19:40:25.576241] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:40:25.603746] [DEBUG] [LOCAL ] IX: Loaded 22501 existing records from primary storage. [2025-10-02T19:40:25.604008] [INFO ] [MAIN ] IX: Loaded 22501 existing records. [2025-10-02T19:40:25.816461] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:40:25.816724] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-02T19:40:25.816825] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-02T19:40:25.817633] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-02T19:40:25.817732] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-02T19:40:25.878145] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-02T19:40:25.931690] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-02T19:40:25.950037] [INFO ] [REMOTE ] IVR: Full fetch complete (69181 records). [2025-10-02T19:40:25.965761] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-02T19:40:26.500855] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:40:26.677475] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-10-02T19:40:26.681454] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-02T19:40:26.682519] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-02T19:40:26.683572] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-02T19:40:26.683853] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-02T19:40:26.686220] [DEBUG] [LOCAL ] IVR: Trimmed 69181 records to 48258 (keeping 200 days of data) [2025-10-02T19:40:26.812175] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T19:40:27.025210] [DEBUG] [LOCAL ] IVR: Primary data saved (48258 records). [2025-10-02T19:40:27.025515] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-02T19:40:27.025722] [INFO ] [MAIN ] Update Progress: 1136/2370 symbols completed. IVR took 34.6s. Estimated remaining: 2h 54m 13s. Rate: 7.1 symbols/min [2025-10-02T19:40:27.233194] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:40:27.278971] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:40:27.299284] [DEBUG] [LOCAL ] J: Loaded 40138 existing records from primary storage. [2025-10-02T19:40:27.299610] [INFO ] [MAIN ] J: Loaded 40138 existing records. [2025-10-02T19:40:27.494044] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-02T19:40:27.500533] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:40:27.501947] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-02T19:40:27.502018] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-02T19:40:27.504211] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-02T19:40:27.504438] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-02T19:40:27.850060] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T19:40:27.920959] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:40:28.273045] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-02T19:40:28.763905] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-02T19:40:29.073047] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-10-02T19:40:29.873025] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-02T19:40:29.971924] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:40:30.240459] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T19:40:30.301293] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T19:40:30.673006] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-02T19:40:31.473007] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-02T19:40:32.193365] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T19:40:32.273049] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-02T19:40:33.073003] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-02T19:40:33.229005] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-10-02T19:40:33.790770] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-02T19:40:33.843540] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-02T19:40:33.872966] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-02T19:40:34.673051] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-02T19:40:34.744209] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-02T19:40:35.472969] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-02T19:40:35.761621] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T19:40:36.273031] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-02T19:40:37.072995] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-02T19:40:37.308365] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-02T19:40:37.342037] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T19:40:37.873035] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-02T19:40:38.591370] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:40:38.673075] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-02T19:40:38.877915] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-02T19:40:39.472997] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-02T19:40:40.273023] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-02T19:40:40.324003] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T19:40:41.072984] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-02T19:40:41.324693] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T19:40:41.358636] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-02T19:40:41.360723] [INFO ] [REMOTE ] IVT: Full fetch complete (45515 records). [2025-10-02T19:40:41.360852] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-02T19:40:41.786198] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-02T19:40:41.786286] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-02T19:40:41.787006] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-02T19:40:41.787071] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-02T19:40:41.788259] [DEBUG] [LOCAL ] IVT: Trimmed 45515 records to 30940 (keeping 200 days of data) [2025-10-02T19:40:41.877501] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-02T19:40:41.985300] [DEBUG] [LOCAL ] IVT: Primary data saved (30940 records). [2025-10-02T19:40:41.985447] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-02T19:40:41.985529] [INFO ] [MAIN ] Update Progress: 1137/2370 symbols completed. IVT took 35.4s. Estimated remaining: 2h 54m 12s. Rate: 7.1 symbols/min [2025-10-02T19:40:42.171208] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:40:42.215130] [DEBUG] [LOCAL ] JBGS: Loaded 42383 existing records from primary storage. [2025-10-02T19:40:42.215481] [INFO ] [MAIN ] JBGS: Loaded 42383 existing records. [2025-10-02T19:40:42.423867] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:40:42.424165] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-02T19:40:42.424215] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-02T19:40:42.427160] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-02T19:40:42.427233] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-02T19:40:42.678139] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-02T19:40:42.880987] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:40:42.893363] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T19:40:43.472973] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-02T19:40:43.594765] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-02T19:40:43.724819] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-10-02T19:40:44.273026] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-02T19:40:44.841304] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T19:40:45.073040] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-02T19:40:45.321160] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-02T19:40:45.873028] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-10-02T19:40:46.468943] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T19:40:46.673065] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-02T19:40:46.994337] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-10-02T19:40:47.473036] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-02T19:40:48.060142] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-02T19:40:48.272997] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-02T19:40:48.406180] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-02T19:40:49.073044] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-02T19:40:49.872990] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-02T19:40:50.256762] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-02T19:40:50.383077] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-02T19:40:50.673007] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-02T19:40:51.021740] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-02T19:40:51.473026] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-02T19:40:52.272995] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-02T19:40:52.459556] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-02T19:40:52.866201] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-02T19:40:53.073009] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-02T19:40:53.766987] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T19:40:53.873000] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-02T19:40:54.435463] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T19:40:54.484112] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-02T19:40:54.673046] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-02T19:40:55.473014] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-02T19:40:56.198129] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-02T19:40:56.272986] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-02T19:40:56.652893] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-02T19:40:57.073016] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-02T19:40:57.873004] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-02T19:40:58.071358] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T19:40:58.107901] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-02T19:40:58.109823] [INFO ] [REMOTE ] J: Full fetch complete (59098 records). [2025-10-02T19:40:58.110066] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-02T19:40:58.519009] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-02T19:40:58.519100] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-02T19:40:58.520081] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-02T19:40:58.520147] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-02T19:40:58.521524] [DEBUG] [LOCAL ] J: Trimmed 59098 records to 40454 (keeping 200 days of data) [2025-10-02T19:40:58.709837] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-02T19:40:58.788606] [DEBUG] [LOCAL ] J: Primary data saved (40454 records). [2025-10-02T19:40:58.788770] [INFO ] [MAIN ] J: Full history saved. [2025-10-02T19:40:58.788859] [INFO ] [MAIN ] Update Progress: 1138/2370 symbols completed. J took 31.8s. Estimated remaining: 2h 54m 12s. Rate: 7.1 symbols/min [2025-10-02T19:40:58.987945] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:40:59.000763] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-02T19:40:59.046882] [DEBUG] [LOCAL ] JBI: Loaded 43502 existing records from primary storage. [2025-10-02T19:40:59.047196] [INFO ] [MAIN ] JBI: Loaded 43502 existing records. [2025-10-02T19:40:59.245149] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:40:59.245365] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-02T19:40:59.245460] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-02T19:40:59.246403] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-02T19:40:59.246467] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-02T19:40:59.478207] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-02T19:40:59.634532] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:00.273042] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-10-02T19:41:00.323503] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T19:41:01.073045] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-02T19:41:01.283263] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-02T19:41:01.285842] [INFO ] [REMOTE ] IVZ: Full fetch complete (76783 records). [2025-10-02T19:41:01.286061] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-02T19:41:01.742548] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-02T19:41:01.742720] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-02T19:41:01.744040] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-02T19:41:01.744126] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-02T19:41:01.746116] [DEBUG] [LOCAL ] IVZ: Trimmed 76783 records to 53517 (keeping 200 days of data) [2025-10-02T19:41:01.873807] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-02T19:41:02.048457] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T19:41:02.161535] [DEBUG] [LOCAL ] IVZ: Primary data saved (53517 records). [2025-10-02T19:41:02.161896] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-02T19:41:02.162097] [INFO ] [MAIN ] Update Progress: 1139/2370 symbols completed. IVZ took 38.8s. Estimated remaining: 2h 53m 58s. Rate: 7.1 symbols/min [2025-10-02T19:41:02.310897] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-02T19:41:02.402976] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:02.455867] [DEBUG] [LOCAL ] JBL: Loaded 48376 existing records from primary storage. [2025-10-02T19:41:02.456237] [INFO ] [MAIN ] JBL: Loaded 48376 existing records. [2025-10-02T19:41:02.658247] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:41:02.658463] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-02T19:41:02.658514] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-02T19:41:02.659796] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-02T19:41:02.659859] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-02T19:41:02.680919] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-02T19:41:02.787059] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-02T19:41:02.814786] [INFO ] [REMOTE ] IX: Full fetch complete (27293 records). [2025-10-02T19:41:02.833378] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-02T19:41:03.271852] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:03.477121] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-02T19:41:03.478517] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-02T19:41:03.478624] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-02T19:41:03.479269] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-02T19:41:03.479336] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-02T19:41:03.480392] [DEBUG] [LOCAL ] IX: Trimmed 27293 records to 22607 (keeping 200 days of data) [2025-10-02T19:41:03.621551] [DEBUG] [LOCAL ] IX: Primary data saved (22607 records). [2025-10-02T19:41:03.621711] [INFO ] [MAIN ] IX: Full history saved. [2025-10-02T19:41:03.621825] [INFO ] [MAIN ] Update Progress: 1140/2370 symbols completed. IX took 38.2s. Estimated remaining: 2h 53m 42s. Rate: 7.1 symbols/min [2025-10-02T19:41:03.836738] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:03.867841] [DEBUG] [LOCAL ] JBND: Loaded 26039 existing records from primary storage. [2025-10-02T19:41:03.868143] [INFO ] [MAIN ] JBND: Loaded 26039 existing records. [2025-10-02T19:41:04.077732] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:41:04.077991] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-02T19:41:04.078043] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-02T19:41:04.078943] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-02T19:41:04.079012] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-02T19:41:04.281264] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-10-02T19:41:04.536070] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-02T19:41:04.572687] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:04.737890] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T19:41:05.073071] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-02T19:41:05.853231] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-10-02T19:41:05.872990] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-10-02T19:41:06.520455] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T19:41:06.672963] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-02T19:41:06.886036] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T19:41:07.472995] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-02T19:41:08.273018] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-02T19:41:08.402525] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-02T19:41:08.737501] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T19:41:09.072994] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-02T19:41:09.872993] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-02T19:41:09.901705] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-02T19:41:10.673005] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-02T19:41:10.994573] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T19:41:10.998132] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-02T19:41:11.001815] [INFO ] [REMOTE ] JBGS: Full fetch complete (59305 records). [2025-10-02T19:41:11.008018] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-02T19:41:11.420794] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-02T19:41:11.420938] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-02T19:41:11.421947] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-02T19:41:11.422097] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-02T19:41:11.433916] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T19:41:11.437953] [DEBUG] [LOCAL ] JBGS: Trimmed 59305 records to 42686 (keeping 200 days of data) [2025-10-02T19:41:11.493633] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-02T19:41:11.710135] [DEBUG] [LOCAL ] JBGS: Primary data saved (42686 records). [2025-10-02T19:41:11.710277] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-02T19:41:11.710365] [INFO ] [MAIN ] Update Progress: 1141/2370 symbols completed. JBGS took 29.7s. Estimated remaining: 2h 53m 34s. Rate: 7.1 symbols/min [2025-10-02T19:41:11.892384] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:11.892600] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-02T19:41:11.892679] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-02T19:41:11.892800] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-02T19:41:11.892843] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-02T19:41:11.892885] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-02T19:41:11.892919] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-02T19:41:12.284258] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-02T19:41:12.291000] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:12.455913] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T19:41:13.073052] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-02T19:41:13.872984] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-02T19:41:14.073777] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T19:41:14.175927] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T19:41:14.672985] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-02T19:41:14.904515] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-02T19:41:15.473005] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-02T19:41:16.273061] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-02T19:41:16.346445] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T19:41:16.630402] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-02T19:41:17.072987] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-02T19:41:17.873012] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-10-02T19:41:18.065280] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T19:41:18.088729] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:41:18.089161] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-10-02T19:41:18.089257] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:41:18.089305] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-02T19:41:18.089338] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:41:18.089406] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-02T19:41:18.089522] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-02T19:41:18.089598] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-02T19:41:18.089798] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-02T19:41:18.089873] [INFO ] [MAIN ] Update Progress: 1142/2370 symbols completed. JBS took 6.4s. Estimated remaining: 2h 53m 23s. Rate: 7.1 symbols/min [2025-10-02T19:41:18.312157] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:18.318585] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-10-02T19:41:18.318703] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-10-02T19:41:18.320039] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-02T19:41:18.320286] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-02T19:41:18.325845] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-02T19:41:18.326503] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-02T19:41:18.326966] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-02T19:41:18.679277] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-02T19:41:18.734074] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:19.473012] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-02T19:41:20.174517] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:41:20.273055] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-10-02T19:41:20.476102] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:41:20.476440] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-10-02T19:41:20.476533] [FATAL] [REMOTE ] JBTM: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:41:20.476581] [FATAL] [MAIN ] JBTM: Failed to fetch primary data. [2025-10-02T19:41:20.476615] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:41:20.476688] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-02T19:41:20.476761] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-10-02T19:41:20.476797] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-10-02T19:41:20.476864] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-10-02T19:41:20.476933] [INFO ] [MAIN ] Update Progress: 1143/2370 symbols completed. JBTM took 2.4s. Estimated remaining: 2h 53m 8s. Rate: 7.1 symbols/min [2025-10-02T19:41:20.669126] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:20.679416] [DEBUG] [LOCAL ] JCE: Loaded 6781 existing records from primary storage. [2025-10-02T19:41:20.679691] [INFO ] [MAIN ] JCE: Loaded 6781 existing records. [2025-10-02T19:41:20.885273] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:41:20.885683] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-02T19:41:20.885802] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-02T19:41:20.886237] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-02T19:41:20.886317] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-02T19:41:21.076184] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-02T19:41:21.076275] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-02T19:41:21.328811] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:21.872995] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-02T19:41:22.672993] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-10-02T19:41:23.084058] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-02T19:41:23.176087] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-02T19:41:23.440824] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-10-02T19:41:23.473052] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-02T19:41:24.273039] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-02T19:41:25.052872] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:41:25.072962] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-02T19:41:25.379030] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-02T19:41:25.873045] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-02T19:41:26.460706] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-02T19:41:26.571814] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-02T19:41:26.673010] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-02T19:41:27.472983] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-02T19:41:27.901928] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-02T19:41:27.927452] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T19:41:28.273019] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-02T19:41:29.073065] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-02T19:41:29.761886] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-02T19:41:29.839965] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-02T19:41:29.872991] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-02T19:41:30.673059] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-02T19:41:31.455524] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:41:31.472961] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-02T19:41:31.890918] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-02T19:41:32.272995] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-02T19:41:32.868072] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T19:41:32.968894] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-02T19:41:33.073039] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-02T19:41:33.873028] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-02T19:41:34.270370] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-02T19:41:34.428210] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T19:41:34.673021] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-02T19:41:35.473007] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-02T19:41:36.158589] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-02T19:41:36.273012] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-02T19:41:36.406471] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-02T19:41:37.073007] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-02T19:41:37.469868] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-02T19:41:37.471723] [INFO ] [REMOTE ] JBI: Full fetch complete (64419 records). [2025-10-02T19:41:37.471821] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-02T19:41:37.828089] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T19:41:37.887478] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-02T19:41:37.953014] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-02T19:41:37.953147] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-02T19:41:37.954194] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-02T19:41:37.954269] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-02T19:41:37.956014] [DEBUG] [LOCAL ] JBI: Trimmed 64419 records to 43831 (keeping 200 days of data) [2025-10-02T19:41:38.230510] [DEBUG] [LOCAL ] JBI: Primary data saved (43831 records). [2025-10-02T19:41:38.230688] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-02T19:41:38.230801] [INFO ] [MAIN ] Update Progress: 1144/2370 symbols completed. JBI took 39.4s. Estimated remaining: 2h 53m 9s. Rate: 7.1 symbols/min [2025-10-02T19:41:38.431371] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:38.489906] [DEBUG] [LOCAL ] JCI: Loaded 53545 existing records from primary storage. [2025-10-02T19:41:38.490270] [INFO ] [MAIN ] JCI: Loaded 53545 existing records. [2025-10-02T19:41:38.605412] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-02T19:41:38.683070] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-02T19:41:38.689298] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:41:38.690601] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-02T19:41:38.690691] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-02T19:41:38.692119] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-02T19:41:38.692187] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-02T19:41:39.116534] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:39.473003] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-02T19:41:40.272993] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-02T19:41:40.296853] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-02T19:41:40.298918] [INFO ] [REMOTE ] JBL: Full fetch complete (70384 records). [2025-10-02T19:41:40.299024] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-02T19:41:40.613020] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T19:41:40.746162] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-02T19:41:40.746261] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-02T19:41:40.747210] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-02T19:41:40.747277] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-02T19:41:40.748858] [DEBUG] [LOCAL ] JBL: Trimmed 70384 records to 48752 (keeping 200 days of data) [2025-10-02T19:41:41.068729] [DEBUG] [LOCAL ] JBL: Primary data saved (48752 records). [2025-10-02T19:41:41.068873] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-02T19:41:41.068959] [INFO ] [MAIN ] Update Progress: 1145/2370 symbols completed. JBL took 38.9s. Estimated remaining: 2h 52m 55s. Rate: 7.1 symbols/min [2025-10-02T19:41:41.080499] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-02T19:41:41.261794] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:41.266366] [DEBUG] [LOCAL ] JEF: No existing data file found in primary storage. [2025-10-02T19:41:41.266574] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-02T19:41:41.266739] [WARN ] [MAIN ] JEF: No existing data found, performing full refresh instead. [2025-10-02T19:41:41.268619] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-02T19:41:41.268833] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-02T19:41:41.268747] [INFO ] [REMOTE ] JBND: Full fetch complete (34301 records). [2025-10-02T19:41:41.268919] [DEBUG] [LOCAL ] JEF: No primary data file found to delete. [2025-10-02T19:41:41.269107] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-02T19:41:41.269183] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-02T19:41:41.866368] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T19:41:41.883756] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-10-02T19:41:41.883931] [INFO ] [REMOTE ] JCE: Full fetch complete (9476 records). [2025-10-02T19:41:41.979687] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-02T19:41:42.040796] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:42.245602] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-02T19:41:42.255994] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-02T19:41:42.262072] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-02T19:41:42.279513] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-02T19:41:42.331716] [DEBUG] [LOCAL ] JBND: Trimmed 34301 records to 26305 (keeping 200 days of data) [2025-10-02T19:41:42.642263] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-02T19:41:42.643413] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-02T19:41:42.644258] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-02T19:41:42.644990] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-02T19:41:42.648864] [DEBUG] [LOCAL ] JCE: Trimmed 9476 records to 6893 (keeping 200 days of data) [2025-10-02T19:41:42.674688] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-10-02T19:41:42.725893] [DEBUG] [LOCAL ] JCE: Primary data saved (6893 records). [2025-10-02T19:41:42.726739] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-02T19:41:42.727874] [INFO ] [MAIN ] Update Progress: 1146/2370 symbols completed. JCE took 22.3s. Estimated remaining: 2h 52m 39s. Rate: 7.1 symbols/min [2025-10-02T19:41:42.943720] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:42.994898] [DEBUG] [LOCAL ] JBND: Primary data saved (26305 records). [2025-10-02T19:41:42.995104] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-02T19:41:42.995308] [INFO ] [MAIN ] Update Progress: 1147/2370 symbols completed. JBND took 39.4s. Estimated remaining: 2h 52m 22s. Rate: 7.1 symbols/min [2025-10-02T19:41:43.164381] [DEBUG] [LOCAL ] JELD: Loaded 46073 existing records from primary storage. [2025-10-02T19:41:43.195627] [INFO ] [MAIN ] JELD: Loaded 46073 existing records. [2025-10-02T19:41:43.221474] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:41:43.428734] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:41:43.429237] [DEBUG] [LOCAL ] JEQ: Loaded 8807 existing records from primary storage. [2025-10-02T19:41:43.429470] [INFO ] [MAIN ] JEQ: Loaded 8807 existing records. [2025-10-02T19:41:43.434881] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-02T19:41:43.451484] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-02T19:41:43.517400] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-02T19:41:43.542422] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-02T19:41:43.710176] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:41:43.720822] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-10-02T19:41:43.727668] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-10-02T19:41:43.741057] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-10-02T19:41:43.752313] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-10-02T19:41:44.036170] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-10-02T19:41:44.108601] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-02T19:41:44.364082] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:44.381026] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-10-02T19:41:44.544360] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:41:44.579348] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T19:41:45.073019] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-02T19:41:45.794234] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T19:41:45.872980] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-10-02T19:41:45.942400] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T19:41:46.321135] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-10-02T19:41:46.673060] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-10-02T19:41:46.809857] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T19:41:47.286404] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T19:41:47.473001] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-02T19:41:48.273046] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-02T19:41:49.072983] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-02T19:41:49.125627] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T19:41:49.872984] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-10-02T19:41:49.908599] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T19:41:50.483841] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-02T19:41:50.520625] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:41:50.673012] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-02T19:41:51.473020] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-02T19:41:52.273069] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-10-02T19:41:52.634396] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T19:41:53.073019] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-02T19:41:53.089573] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-02T19:41:53.304912] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-02T19:41:53.873015] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-10-02T19:41:54.592993] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T19:41:54.673033] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-02T19:41:54.692189] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-02T19:41:55.473019] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-02T19:41:56.134147] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T19:41:56.273008] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-10-02T19:41:57.040327] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-02T19:41:57.044336] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-02T19:41:57.073053] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-02T19:41:57.873055] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-10-02T19:41:58.573794] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-02T19:41:58.673000] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-10-02T19:41:58.823865] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-02T19:41:59.309138] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-02T19:41:59.473027] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-02T19:42:00.273023] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-10-02T19:42:01.073000] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-02T19:42:01.511931] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-02T19:42:01.772406] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-10-02T19:42:01.873003] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-10-02T19:42:02.404259] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-02T19:42:02.511076] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T19:42:02.673008] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-02T19:42:03.473009] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-10. [2025-10-02T19:42:03.965554] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-02T19:42:03.966568] [INFO ] [REMOTE ] JEQ: Full fetch complete (11824 records). [2025-10-02T19:42:03.966666] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-10-02T19:42:04.278243] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-02T19:42:04.388750] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-10-02T19:42:04.388933] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-10-02T19:42:04.389314] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-10-02T19:42:04.389435] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-10-02T19:42:04.390351] [DEBUG] [LOCAL ] JEQ: Trimmed 11824 records to 8924 (keeping 200 days of data) [2025-10-02T19:42:04.468048] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:42:04.496135] [DEBUG] [LOCAL ] JEQ: Primary data saved (8924 records). [2025-10-02T19:42:04.496290] [INFO ] [MAIN ] JEQ: Full history saved. [2025-10-02T19:42:04.496397] [INFO ] [MAIN ] Update Progress: 1148/2370 symbols completed. JEQ took 21.5s. Estimated remaining: 2h 52m 27s. Rate: 7.1 symbols/min [2025-10-02T19:42:04.696507] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:04.733292] [DEBUG] [LOCAL ] JFR: Loaded 30718 existing records from primary storage. [2025-10-02T19:42:04.733590] [INFO ] [MAIN ] JFR: Loaded 30718 existing records. [2025-10-02T19:42:04.935408] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:04.935709] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-02T19:42:04.935779] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-02T19:42:04.937774] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-02T19:42:04.937856] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-02T19:42:05.078219] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-02T19:42:05.375842] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:05.872971] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-10-02T19:42:06.209320] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-02T19:42:06.672977] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-02T19:42:06.997835] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T19:42:07.042438] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T19:42:07.472986] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-02T19:42:08.151477] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:42:08.273057] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-02T19:42:09.072992] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-02T19:42:09.466273] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-02T19:42:09.721963] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:42:09.873026] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-02T19:42:10.673027] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-02T19:42:10.831807] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-02T19:42:11.438518] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:42:11.472985] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-02T19:42:12.273042] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-02T19:42:12.527725] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-02T19:42:12.613057] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T19:42:13.073038] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-02T19:42:13.436167] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T19:42:13.873001] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-02T19:42:14.364539] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T19:42:14.673013] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-02T19:42:15.121871] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T19:42:15.125506] [INFO ] [REMOTE ] JCI: Full fetch complete (77414 records). [2025-10-02T19:42:15.125777] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-02T19:42:15.478146] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-02T19:42:15.589774] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-02T19:42:15.589993] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-02T19:42:15.591734] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-02T19:42:15.591860] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-02T19:42:15.594207] [DEBUG] [LOCAL ] JCI: Trimmed 77414 records to 53933 (keeping 200 days of data) [2025-10-02T19:42:15.896954] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-02T19:42:16.054936] [DEBUG] [LOCAL ] JCI: Primary data saved (53933 records). [2025-10-02T19:42:16.055087] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-02T19:42:16.055259] [INFO ] [MAIN ] Update Progress: 1149/2370 symbols completed. JCI took 37.8s. Estimated remaining: 2h 52m 22s. Rate: 7.1 symbols/min [2025-10-02T19:42:16.243504] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:16.256733] [DEBUG] [LOCAL ] JGH: Loaded 11062 existing records from primary storage. [2025-10-02T19:42:16.256993] [INFO ] [MAIN ] JGH: Loaded 11062 existing records. [2025-10-02T19:42:16.280145] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-02T19:42:16.462180] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:16.462457] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-02T19:42:16.462520] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-02T19:42:16.463098] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-02T19:42:16.463162] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-02T19:42:16.913736] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:17.078218] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-10-02T19:42:17.093252] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T19:42:17.502933] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T19:42:17.872986] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-02T19:42:17.941066] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T19:42:18.673024] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-02T19:42:18.988540] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T19:42:19.473009] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-02T19:42:19.994509] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T19:42:20.273044] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-02T19:42:21.073023] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-02T19:42:21.116747] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T19:42:21.169525] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-02T19:42:21.836597] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T19:42:21.872989] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-02T19:42:22.474191] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T19:42:22.673003] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-02T19:42:23.405330] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-02T19:42:23.472971] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-02T19:42:24.272995] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-02T19:42:24.715369] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-02T19:42:25.073041] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-02T19:42:25.702754] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:42:25.748097] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-02T19:42:25.873029] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-02T19:42:26.673000] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-02T19:42:27.220126] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T19:42:27.472995] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-02T19:42:27.499027] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-02T19:42:28.273046] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-02T19:42:28.582517] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T19:42:28.584106] [INFO ] [REMOTE ] JFR: Full fetch complete (48265 records). [2025-10-02T19:42:28.584193] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-02T19:42:29.026871] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-02T19:42:29.026993] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-02T19:42:29.028356] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-02T19:42:29.028468] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-02T19:42:29.029850] [DEBUG] [LOCAL ] JFR: Trimmed 48265 records to 30936 (keeping 200 days of data) [2025-10-02T19:42:29.097764] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-02T19:42:29.252127] [DEBUG] [LOCAL ] JFR: Primary data saved (30936 records). [2025-10-02T19:42:29.252290] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-02T19:42:29.253395] [INFO ] [MAIN ] Update Progress: 1150/2370 symbols completed. JFR took 24.8s. Estimated remaining: 2h 52m 19s. Rate: 7.1 symbols/min [2025-10-02T19:42:29.445312] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:29.497788] [DEBUG] [LOCAL ] JHG: Loaded 47664 existing records from primary storage. [2025-10-02T19:42:29.498120] [INFO ] [MAIN ] JHG: Loaded 47664 existing records. [2025-10-02T19:42:29.616315] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T19:42:29.624304] [INFO ] [REMOTE ] JELD: Full fetch complete (64095 records). [2025-10-02T19:42:29.629546] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-02T19:42:29.814762] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:29.839701] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-02T19:42:29.839833] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-02T19:42:29.862511] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-02T19:42:29.867960] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-02T19:42:29.873170] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-02T19:42:30.482054] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-02T19:42:30.515221] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-02T19:42:30.538245] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-02T19:42:30.548717] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-02T19:42:30.617425] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:30.618759] [DEBUG] [LOCAL ] JELD: Trimmed 64095 records to 46427 (keeping 200 days of data) [2025-10-02T19:42:30.687391] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-10-02T19:42:30.891493] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-02T19:42:30.893313] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-02T19:42:30.979740] [DEBUG] [LOCAL ] JELD: Primary data saved (46427 records). [2025-10-02T19:42:30.979884] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-02T19:42:30.979984] [INFO ] [MAIN ] Update Progress: 1151/2370 symbols completed. JELD took 48.3s. Estimated remaining: 2h 52m 3s. Rate: 7.1 symbols/min [2025-10-02T19:42:31.162554] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:31.169289] [DEBUG] [LOCAL ] JHI: Loaded 3586 existing records from primary storage. [2025-10-02T19:42:31.169511] [INFO ] [MAIN ] JHI: Loaded 3586 existing records. [2025-10-02T19:42:31.365003] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:31.365234] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-02T19:42:31.365289] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-02T19:42:31.365619] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-02T19:42:31.365719] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-02T19:42:31.473791] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-02T19:42:31.763527] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:31.989847] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-10-02T19:42:32.272999] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-02T19:42:32.387362] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-02T19:42:33.073003] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-02T19:42:33.687274] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:42:33.692502] [INFO ] [REMOTE ] JEF: Full fetch complete (72952 records). [2025-10-02T19:42:33.692676] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-02T19:42:33.878750] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-10-02T19:42:33.995223] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-02T19:42:34.153789] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-02T19:42:34.153886] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-02T19:42:34.154840] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-02T19:42:34.154908] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-02T19:42:34.156592] [DEBUG] [LOCAL ] JEF: Trimmed 72952 records to 50415 (keeping 200 days of data) [2025-10-02T19:42:34.409888] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-10-02T19:42:34.511758] [DEBUG] [LOCAL ] JEF: Primary data saved (50415 records). [2025-10-02T19:42:34.511901] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-02T19:42:34.511978] [INFO ] [MAIN ] Update Progress: 1152/2370 symbols completed. JEF took 53.4s. Estimated remaining: 2h 51m 49s. Rate: 7.1 symbols/min [2025-10-02T19:42:34.675704] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-02T19:42:34.697792] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:34.704236] [DEBUG] [LOCAL ] JHS: Loaded 2826 existing records from primary storage. [2025-10-02T19:42:34.704411] [INFO ] [MAIN ] JHS: Loaded 2826 existing records. [2025-10-02T19:42:34.900130] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:34.900361] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-02T19:42:34.900411] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-02T19:42:34.900755] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-02T19:42:34.901013] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-02T19:42:35.293426] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:35.473034] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-02T19:42:36.271078] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-02T19:42:36.274261] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-02T19:42:36.415458] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-02T19:42:36.823755] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-02T19:42:37.073038] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-02T19:42:37.873017] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-10-02T19:42:38.335341] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-10-02T19:42:38.592802] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:42:38.673043] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-02T19:42:39.236887] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-02T19:42:39.473005] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-02T19:42:40.269223] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T19:42:40.270208] [INFO ] [REMOTE ] JGH: Full fetch complete (15057 records). [2025-10-02T19:42:40.270280] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-02T19:42:40.282042] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-02T19:42:40.685210] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-02T19:42:40.685318] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-02T19:42:40.685917] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-02T19:42:40.685987] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-02T19:42:40.687125] [DEBUG] [LOCAL ] JGH: Trimmed 15057 records to 11163 (keeping 200 days of data) [2025-10-02T19:42:40.764679] [DEBUG] [LOCAL ] JGH: Primary data saved (11163 records). [2025-10-02T19:42:40.764881] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-02T19:42:40.765005] [INFO ] [MAIN ] Update Progress: 1153/2370 symbols completed. JGH took 24.7s. Estimated remaining: 2h 51m 39s. Rate: 7.1 symbols/min [2025-10-02T19:42:40.900467] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T19:42:40.978001] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:41.030813] [DEBUG] [LOCAL ] JHX: Loaded 51882 existing records from primary storage. [2025-10-02T19:42:41.031157] [INFO ] [MAIN ] JHX: Loaded 51882 existing records. [2025-10-02T19:42:41.078218] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-02T19:42:41.230395] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:41.230637] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-02T19:42:41.230753] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-02T19:42:41.232208] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-02T19:42:41.232285] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-02T19:42:41.566635] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-02T19:42:41.632901] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:41.873002] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-10-02T19:42:42.673038] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-02T19:42:42.792610] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-02T19:42:43.091672] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-02T19:42:43.472994] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-02T19:42:44.224815] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T19:42:44.273017] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-02T19:42:45.073027] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-02T19:42:45.594773] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-02T19:42:45.873001] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-02T19:42:45.959476] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-02T19:42:46.671376] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-02T19:42:46.673204] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-02T19:42:47.472997] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-02T19:42:47.945440] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-02T19:42:48.273003] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-02T19:42:48.441564] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-02T19:42:48.628346] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-02T19:42:49.073005] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-02T19:42:49.638903] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T19:42:49.873076] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-02T19:42:50.444117] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T19:42:50.672973] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-02T19:42:51.246011] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T19:42:51.473010] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-02T19:42:51.814697] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-02T19:42:52.273005] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-02T19:42:52.747561] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-02T19:42:53.073001] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-02T19:42:53.872993] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-02T19:42:54.672990] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-02T19:42:54.749938] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-02T19:42:54.778283] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-02T19:42:55.119336] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-02T19:42:55.120144] [INFO ] [REMOTE ] JHI: Full fetch complete (5273 records). [2025-10-02T19:42:55.120216] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-02T19:42:55.486715] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-02T19:42:55.542142] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-02T19:42:55.542260] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-02T19:42:55.542473] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-02T19:42:55.542553] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-02T19:42:55.543192] [DEBUG] [LOCAL ] JHI: Trimmed 5273 records to 3612 (keeping 200 days of data) [2025-10-02T19:42:55.578313] [DEBUG] [LOCAL ] JHI: Primary data saved (3612 records). [2025-10-02T19:42:55.578508] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-02T19:42:55.578641] [INFO ] [MAIN ] Update Progress: 1154/2370 symbols completed. JHI took 24.6s. Estimated remaining: 2h 51m 37s. Rate: 7.1 symbols/min [2025-10-02T19:42:55.766087] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:42:55.784194] [DEBUG] [LOCAL ] JILL: Loaded 16664 existing records from primary storage. [2025-10-02T19:42:55.784529] [INFO ] [MAIN ] JILL: Loaded 16664 existing records. [2025-10-02T19:42:55.978785] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:42:55.979025] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-02T19:42:55.979074] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-02T19:42:55.979735] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-02T19:42:55.979795] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-02T19:42:56.273552] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-02T19:42:56.358839] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:42:57.072994] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-02T19:42:57.110693] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:42:57.586284] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-02T19:42:57.640530] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-02T19:42:57.873020] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-02T19:42:58.673000] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-10-02T19:42:59.473042] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-02T19:42:59.632429] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-02T19:42:59.682964] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T19:43:00.273007] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-02T19:43:01.073017] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-02T19:43:01.611621] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-02T19:43:01.668976] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T19:43:01.873002] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-02T19:43:02.110490] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-02T19:43:02.672998] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-02T19:43:03.173091] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:43:03.472987] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-02T19:43:04.105142] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T19:43:04.273002] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-02T19:43:04.983729] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T19:43:05.072982] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-02T19:43:05.087176] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-02T19:43:05.873012] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-02T19:43:06.428809] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T19:43:06.431124] [INFO ] [REMOTE ] JHG: Full fetch complete (68275 records). [2025-10-02T19:43:06.431296] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-02T19:43:06.631038] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-02T19:43:06.678227] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-02T19:43:06.875313] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-02T19:43:06.875412] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-02T19:43:06.876429] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-02T19:43:06.876509] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-02T19:43:06.878040] [DEBUG] [LOCAL ] JHG: Trimmed 68275 records to 47986 (keeping 200 days of data) [2025-10-02T19:43:07.209296] [DEBUG] [LOCAL ] JHG: Primary data saved (47986 records). [2025-10-02T19:43:07.209464] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-02T19:43:07.210378] [INFO ] [MAIN ] Update Progress: 1155/2370 symbols completed. JHG took 38.0s. Estimated remaining: 2h 51m 32s. Rate: 7.1 symbols/min [2025-10-02T19:43:07.323306] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T19:43:07.410398] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:07.453220] [DEBUG] [LOCAL ] JKS: Loaded 40094 existing records from primary storage. [2025-10-02T19:43:07.453559] [INFO ] [MAIN ] JKS: Loaded 40094 existing records. [2025-10-02T19:43:07.478237] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-02T19:43:07.654194] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:43:07.654448] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-02T19:43:07.654502] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-02T19:43:07.655480] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-02T19:43:07.655545] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-02T19:43:08.089909] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:08.094801] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-02T19:43:08.273018] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-10-02T19:43:09.073004] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-02T19:43:09.588915] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T19:43:09.589632] [INFO ] [REMOTE ] JHS: Full fetch complete (4437 records). [2025-10-02T19:43:09.589732] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-02T19:43:09.873886] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-02T19:43:09.999188] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-02T19:43:09.999301] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-02T19:43:09.999488] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-02T19:43:09.999566] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-02T19:43:10.000335] [DEBUG] [LOCAL ] JHS: Trimmed 4437 records to 2834 (keeping 200 days of data) [2025-10-02T19:43:10.047364] [DEBUG] [LOCAL ] JHS: Primary data saved (2834 records). [2025-10-02T19:43:10.048108] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-02T19:43:10.050014] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-10-02T19:43:10.050194] [INFO ] [MAIN ] Update Progress: 1156/2370 symbols completed. JHS took 35.5s. Estimated remaining: 2h 51m 17s. Rate: 7.1 symbols/min [2025-10-02T19:43:10.247987] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:10.280782] [DEBUG] [LOCAL ] JLL: Loaded 31546 existing records from primary storage. [2025-10-02T19:43:10.281081] [INFO ] [MAIN ] JLL: Loaded 31546 existing records. [2025-10-02T19:43:10.476249] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:43:10.476495] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-02T19:43:10.476549] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-02T19:43:10.477309] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-02T19:43:10.477371] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-02T19:43:10.681012] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-02T19:43:10.885720] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:11.062947] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-02T19:43:11.473007] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-02T19:43:12.272983] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-02T19:43:12.392727] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-02T19:43:12.490834] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-02T19:43:13.073075] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-02T19:43:13.796379] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T19:43:13.872973] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-02T19:43:13.949923] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-02T19:43:14.673034] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-02T19:43:15.472976] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-02T19:43:15.500987] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T19:43:15.710094] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T19:43:16.273007] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-02T19:43:17.026048] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-02T19:43:17.073009] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-02T19:43:17.869495] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T19:43:17.885074] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-10-02T19:43:18.635900] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:43:18.672972] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-02T19:43:19.145271] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T19:43:19.473049] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-02T19:43:20.150004] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T19:43:20.155277] [INFO ] [REMOTE ] JHX: Full fetch complete (58833 records). [2025-10-02T19:43:20.155390] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-02T19:43:20.278133] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-02T19:43:20.464386] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T19:43:20.597862] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-02T19:43:20.597948] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-02T19:43:20.598960] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-02T19:43:20.599026] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-02T19:43:20.600573] [DEBUG] [LOCAL ] JHX: Trimmed 58833 records to 52271 (keeping 200 days of data) [2025-10-02T19:43:20.921246] [DEBUG] [LOCAL ] JHX: Primary data saved (52271 records). [2025-10-02T19:43:20.921388] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-02T19:43:20.921468] [INFO ] [MAIN ] Update Progress: 1157/2370 symbols completed. JHX took 40.2s. Estimated remaining: 2h 51m 11s. Rate: 7.1 symbols/min [2025-10-02T19:43:21.073022] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-02T19:43:21.772463] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-02T19:43:21.872956] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-02T19:43:22.673044] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-02T19:43:22.876577] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-02T19:43:22.878951] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T19:43:23.473049] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-02T19:43:24.123138] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-02T19:43:24.174290] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-02T19:43:24.273002] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-02T19:43:25.048052] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-02T19:43:25.049300] [INFO ] [REMOTE ] JILL: Full fetch complete (22822 records). [2025-10-02T19:43:25.049398] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-02T19:43:25.082940] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-02T19:43:25.463866] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-02T19:43:25.463978] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-02T19:43:25.464525] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-02T19:43:25.464589] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-02T19:43:25.465330] [DEBUG] [LOCAL ] JILL: Trimmed 22822 records to 16768 (keeping 200 days of data) [2025-10-02T19:43:25.573447] [DEBUG] [LOCAL ] JILL: Primary data saved (16768 records). [2025-10-02T19:43:25.573593] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-02T19:43:25.573706] [INFO ] [MAIN ] Update Progress: 1158/2370 symbols completed. JILL took 30.0s. Estimated remaining: 2h 50m 59s. Rate: 7.1 symbols/min [2025-10-02T19:43:25.873013] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-02T19:43:26.317511] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-02T19:43:26.673043] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-02T19:43:26.700758] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T19:43:27.473012] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-02T19:43:27.582432] [DEBUG] [REMOTE ] JLL: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-10-02T19:43:27.582905] [WARN ] [REMOTE ] JLL: No data returned for month 2025-04 [2025-10-02T19:43:27.583025] [FATAL] [REMOTE ] JLL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:43:27.583149] [FATAL] [MAIN ] JLL: Failed to fetch primary data. [2025-10-02T19:43:27.583239] [WARN ] [MAIN ] JLL: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:43:27.583331] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-02T19:43:27.583431] [DEBUG] [LOCAL ] JLL: No primary data file found to delete. [2025-10-02T19:43:27.583508] [INFO ] [LOCAL ] JLL: Starting deletion of derivative data. [2025-10-02T19:43:27.584159] [DEBUG] [LOCAL ] JLL: Deleted derivative data file. [2025-10-02T19:43:27.584274] [INFO ] [MAIN ] Update Progress: 1159/2370 symbols completed. JLL took 17.5s. Estimated remaining: 2h 50m 44s. Rate: 7.1 symbols/min [2025-10-02T19:43:28.233063] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T19:43:28.272993] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-02T19:43:29.743204] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T19:43:29.752446] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-02T19:43:30.891017] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-02T19:43:30.899120] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-02T19:43:32.479447] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-02T19:43:32.488825] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-02T19:43:33.509301] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-02T19:43:33.511014] [INFO ] [REMOTE ] JKS: Full fetch complete (58946 records). [2025-10-02T19:43:33.511112] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-02T19:43:33.919388] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-02T19:43:33.919476] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-02T19:43:33.920387] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-02T19:43:33.920454] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-02T19:43:33.921762] [DEBUG] [LOCAL ] JKS: Trimmed 58946 records to 40360 (keeping 200 days of data) [2025-10-02T19:43:34.178930] [DEBUG] [LOCAL ] JKS: Primary data saved (40360 records). [2025-10-02T19:43:34.179059] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-02T19:43:34.179566] [INFO ] [MAIN ] Update Progress: 1160/2370 symbols completed. JKS took 27.0s. Estimated remaining: 2h 50m 33s. Rate: 7.1 symbols/min [2025-10-02T19:43:34.733573] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:34.925807] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:34.954338] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-02T19:43:34.960248] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-02T19:43:34.951038] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:34.961561] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-02T19:43:34.985240] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-02T19:43:34.985468] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-02T19:43:34.985825] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-02T19:43:34.992886] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:35.055893] [DEBUG] [LOCAL ] JLS: Loaded 4138 existing records from primary storage. [2025-10-02T19:43:35.076491] [INFO ] [MAIN ] JLS: Loaded 4138 existing records. [2025-10-02T19:43:35.425474] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-02T19:43:35.558053] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:43:35.563348] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-02T19:43:35.575510] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-02T19:43:35.587294] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-02T19:43:35.640142] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-02T19:43:35.679508] [DEBUG] [LOCAL ] JMIA: Loaded 50668 existing records from primary storage. [2025-10-02T19:43:35.678672] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-02T19:43:35.699694] [INFO ] [MAIN ] JMIA: Loaded 50668 existing records. [2025-10-02T19:43:35.875460] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:35.938879] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-10-02T19:43:36.222360] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:43:36.320204] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-02T19:43:36.350891] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-02T19:43:36.401845] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:43:36.421109] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-10-02T19:43:36.417898] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-02T19:43:36.427537] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-02T19:43:36.427627] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-02T19:43:36.421000] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-02T19:43:36.447983] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-02T19:43:36.476011] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-02T19:43:36.539914] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-02T19:43:36.691276] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:36.722581] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-10-02T19:43:36.902790] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-02T19:43:36.988393] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-02T19:43:37.323441] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:37.336636] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-10-02T19:43:37.383889] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:37.389468] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-10-02T19:43:37.389146] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-10-02T19:43:37.392210] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-02T19:43:37.593138] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T19:43:37.594296] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-02T19:43:37.808470] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-02T19:43:37.873050] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-02T19:43:37.922007] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-02T19:43:38.441055] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T19:43:38.673063] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-02T19:43:38.952723] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-10-02T19:43:39.095986] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-02T19:43:39.473044] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-02T19:43:39.687977] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-10-02T19:43:40.273033] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-02T19:43:40.819510] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-02T19:43:41.073009] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-02T19:43:41.248044] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-02T19:43:41.873056] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-02T19:43:42.673007] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-02T19:43:43.262195] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T19:43:43.366391] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-10-02T19:43:43.473042] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-02T19:43:43.627673] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-02T19:43:43.977834] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-02T19:43:44.273001] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-02T19:43:45.073005] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-02T19:43:45.735993] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-02T19:43:45.873035] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-02T19:43:46.313562] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-02T19:43:46.673011] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-02T19:43:47.473005] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-02T19:43:47.673448] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-02T19:43:48.069446] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-02T19:43:48.273033] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-02T19:43:48.838893] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T19:43:48.862542] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-10-02T19:43:49.073001] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-10-02T19:43:49.423244] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-02T19:43:49.873044] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-02T19:43:50.673007] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-10-02T19:43:51.277850] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-02T19:43:51.473043] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-10-02T19:43:52.028838] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-02T19:43:52.215811] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-02T19:43:52.272989] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-02T19:43:52.721169] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-02T19:43:53.072995] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-02T19:43:53.873008] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-02T19:43:54.309968] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-02T19:43:54.673014] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-02T19:43:55.358662] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-10-02T19:43:55.472994] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-10-02T19:43:56.054380] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-02T19:43:56.273003] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-02T19:43:56.341421] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T19:43:57.073002] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-02T19:43:57.533054] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T19:43:57.534068] [INFO ] [REMOTE ] JMM: Full fetch complete (2316 records). [2025-10-02T19:43:57.534204] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-02T19:43:57.764017] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-02T19:43:57.764266] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:43:57.764342] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:43:57.764417] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-02T19:43:57.764519] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-02T19:43:57.764578] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-02T19:43:57.764625] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-02T19:43:57.764725] [INFO ] [MAIN ] Update Progress: 1161/2370 symbols completed. JMM took 23.6s. Estimated remaining: 2h 50m 41s. Rate: 7.1 symbols/min [2025-10-02T19:43:57.881289] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-02T19:43:57.967390] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:58.026344] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-10-02T19:43:58.026810] [INFO ] [MAIN ] JOBY: Loaded 53799 existing records. [2025-10-02T19:43:58.256403] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:43:58.256740] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-02T19:43:58.256895] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-02T19:43:58.268474] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-02T19:43:58.287193] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-02T19:43:58.294694] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-10-02T19:43:58.678130] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-10-02T19:43:58.747172] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:43:59.217513] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T19:43:59.218335] [INFO ] [REMOTE ] JLS: Full fetch complete (5832 records). [2025-10-02T19:43:59.218409] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-10-02T19:43:59.476226] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-10-02T19:43:59.653920] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-10-02T19:43:59.654008] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-10-02T19:43:59.654195] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-10-02T19:43:59.654236] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-10-02T19:43:59.654628] [DEBUG] [LOCAL ] JLS: Trimmed 5832 records to 4162 (keeping 200 days of data) [2025-10-02T19:43:59.684796] [DEBUG] [LOCAL ] JLS: Primary data saved (4162 records). [2025-10-02T19:43:59.684936] [INFO ] [MAIN ] JLS: Full history saved. [2025-10-02T19:43:59.685021] [INFO ] [MAIN ] Update Progress: 1162/2370 symbols completed. JLS took 25.5s. Estimated remaining: 2h 50m 25s. Rate: 7.1 symbols/min [2025-10-02T19:43:59.910798] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:43:59.913465] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-10-02T19:43:59.950238] [DEBUG] [LOCAL ] JOE: Loaded 24154 existing records from primary storage. [2025-10-02T19:43:59.950562] [INFO ] [MAIN ] JOE: Loaded 24154 existing records. [2025-10-02T19:44:00.170453] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:00.170756] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-02T19:44:00.170819] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-02T19:44:00.171880] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-02T19:44:00.171942] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-02T19:44:00.281255] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-02T19:44:00.567963] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:01.073030] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-10-02T19:44:01.873059] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-02T19:44:02.125422] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-10-02T19:44:02.283101] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-10-02T19:44:02.673044] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-02T19:44:02.720498] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-02T19:44:03.324349] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-02T19:44:03.473018] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-02T19:44:04.273040] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-02T19:44:04.819911] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-10-02T19:44:05.073046] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-02T19:44:05.873011] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-02T19:44:06.191087] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T19:44:06.673026] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-02T19:44:06.979084] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-02T19:44:07.472993] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-02T19:44:08.427755] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-10-02T19:44:08.440202] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-02T19:44:08.667810] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-02T19:44:09.073042] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-02T19:44:09.482146] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (6.01 seconds). [2025-10-02T19:44:09.726611] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-02T19:44:09.872995] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-02T19:44:10.673035] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-02T19:44:10.910348] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-02T19:44:11.162446] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-02T19:44:11.473042] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-02T19:44:11.766958] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T19:44:11.827613] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-02T19:44:11.829828] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-10-02T19:44:11.830005] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-02T19:44:12.279019] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-02T19:44:12.281088] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-02T19:44:12.281214] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-02T19:44:12.282577] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-02T19:44:12.282841] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-02T19:44:12.284962] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 54143 (keeping 200 days of data) [2025-10-02T19:44:12.667219] [DEBUG] [LOCAL ] JNJ: Primary data saved (54143 records). [2025-10-02T19:44:12.667375] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-02T19:44:12.668584] [INFO ] [MAIN ] Update Progress: 1163/2370 symbols completed. JNJ took 38.5s. Estimated remaining: 2h 50m 21s. Rate: 7.1 symbols/min [2025-10-02T19:44:12.856188] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:44:12.867626] [DEBUG] [LOCAL ] JOF: Loaded 7000 existing records from primary storage. [2025-10-02T19:44:12.867894] [INFO ] [MAIN ] JOF: Loaded 7000 existing records. [2025-10-02T19:44:13.067902] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:13.068201] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-02T19:44:13.068265] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-02T19:44:13.068680] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-02T19:44:13.068744] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-02T19:44:13.074712] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-02T19:44:13.486439] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:13.873041] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-10-02T19:44:13.966313] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-02T19:44:14.063278] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-02T19:44:14.065383] [INFO ] [REMOTE ] JMIA: Full fetch complete (73265 records). [2025-10-02T19:44:14.065510] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-02T19:44:14.481280] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T19:44:14.528618] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-02T19:44:14.528797] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-02T19:44:14.529943] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-02T19:44:14.530162] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-02T19:44:14.531979] [DEBUG] [LOCAL ] JMIA: Trimmed 73265 records to 51046 (keeping 200 days of data) [2025-10-02T19:44:14.626275] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-10-02T19:44:14.711688] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-02T19:44:14.859703] [DEBUG] [LOCAL ] JMIA: Primary data saved (51046 records). [2025-10-02T19:44:14.859859] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-02T19:44:14.859950] [INFO ] [MAIN ] Update Progress: 1164/2370 symbols completed. JMIA took 40.7s. Estimated remaining: 2h 50m 6s. Rate: 7.1 symbols/min [2025-10-02T19:44:15.056540] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:44:15.112242] [DEBUG] [LOCAL ] JPC: Loaded 37095 existing records from primary storage. [2025-10-02T19:44:15.113402] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-02T19:44:15.114912] [INFO ] [MAIN ] JPC: Loaded 37095 existing records. [2025-10-02T19:44:15.314039] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:15.314367] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-02T19:44:15.314447] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-02T19:44:15.315379] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-02T19:44:15.315459] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-02T19:44:15.478812] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-02T19:44:15.713396] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:15.928742] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-02T19:44:16.273008] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-02T19:44:16.977519] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T19:44:17.073017] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-02T19:44:17.830387] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-02T19:44:17.872959] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-02T19:44:18.478795] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-02T19:44:18.672985] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-02T19:44:19.280855] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-02T19:44:19.473015] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-02T19:44:20.273050] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-02T19:44:20.802692] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-02T19:44:21.073045] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-10-02T19:44:21.856160] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-10-02T19:44:21.872950] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-02T19:44:22.607522] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T19:44:22.673001] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-02T19:44:23.473054] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-02T19:44:24.022124] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T19:44:24.149590] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-02T19:44:24.272956] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-02T19:44:24.748476] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-02T19:44:25.072603] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T19:44:25.074736] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-02T19:44:25.873033] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-02T19:44:26.380236] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-02T19:44:26.622175] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-02T19:44:26.673020] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-02T19:44:27.171822] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-02T19:44:27.172703] [INFO ] [REMOTE ] JOF: Full fetch complete (9476 records). [2025-10-02T19:44:27.172791] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-02T19:44:27.478194] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-02T19:44:27.587669] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-02T19:44:27.587788] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-02T19:44:27.588047] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-02T19:44:27.588100] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-02T19:44:27.588887] [DEBUG] [LOCAL ] JOF: Trimmed 9476 records to 7036 (keeping 200 days of data) [2025-10-02T19:44:27.640026] [DEBUG] [LOCAL ] JOF: Primary data saved (7036 records). [2025-10-02T19:44:27.640175] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-02T19:44:27.640362] [INFO ] [MAIN ] Update Progress: 1165/2370 symbols completed. JOF took 15.0s. Estimated remaining: 2h 50m 2s. Rate: 7.1 symbols/min [2025-10-02T19:44:27.841561] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:44:27.917280] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-02T19:44:27.917712] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-02T19:44:28.122678] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:28.122929] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-02T19:44:28.122991] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-02T19:44:28.124342] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-02T19:44:28.124404] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-02T19:44:28.285874] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-02T19:44:28.561933] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:28.665627] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-02T19:44:29.073017] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-02T19:44:29.878267] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-02T19:44:29.889520] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-02T19:44:30.673027] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-10-02T19:44:30.820058] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-02T19:44:31.361920] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-02T19:44:31.473001] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-02T19:44:32.273050] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-02T19:44:32.556508] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T19:44:32.762488] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-02T19:44:33.072998] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-02T19:44:33.872993] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-02T19:44:34.673033] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-02T19:44:35.070202] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-10-02T19:44:35.093877] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T19:44:35.217443] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-02T19:44:35.473042] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-02T19:44:36.062991] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-02T19:44:36.273043] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-02T19:44:36.514207] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-02T19:44:37.073000] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-02T19:44:37.465175] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T19:44:37.873004] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-02T19:44:38.170420] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-02T19:44:38.672993] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-02T19:44:39.089628] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-02T19:44:39.473043] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-02T19:44:40.273075] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-02T19:44:40.664838] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-02T19:44:40.989021] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-02T19:44:40.991047] [INFO ] [REMOTE ] JOE: Full fetch complete (36047 records). [2025-10-02T19:44:40.991354] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-02T19:44:41.078964] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-02T19:44:41.411678] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-02T19:44:41.411811] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-02T19:44:41.412514] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-02T19:44:41.412558] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-02T19:44:41.415082] [DEBUG] [LOCAL ] JOE: Trimmed 36047 records to 24297 (keeping 200 days of data) [2025-10-02T19:44:41.591597] [DEBUG] [LOCAL ] JOE: Primary data saved (24297 records). [2025-10-02T19:44:41.591799] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-02T19:44:41.591918] [INFO ] [MAIN ] Update Progress: 1166/2370 symbols completed. JOE took 41.9s. Estimated remaining: 2h 49m 60s. Rate: 7.1 symbols/min [2025-10-02T19:44:41.788211] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:44:41.823784] [DEBUG] [LOCAL ] JQC: Loaded 34263 existing records from primary storage. [2025-10-02T19:44:41.824093] [INFO ] [MAIN ] JQC: Loaded 34263 existing records. [2025-10-02T19:44:41.875079] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-02T19:44:42.027391] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:42.027808] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-02T19:44:42.028061] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-02T19:44:42.029131] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-02T19:44:42.029206] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-02T19:44:42.456304] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.98 seconds). [2025-10-02T19:44:42.474134] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:42.672986] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-02T19:44:43.379575] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T19:44:43.473013] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-10-02T19:44:43.545394] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-10-02T19:44:44.272981] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-02T19:44:44.700386] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-10-02T19:44:44.974008] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.30 seconds). [2025-10-02T19:44:44.978567] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-10-02T19:44:44.978769] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-02T19:44:45.082721] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-02T19:44:45.425222] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-02T19:44:45.425340] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-02T19:44:45.426544] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-02T19:44:45.426623] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-02T19:44:45.430517] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 54189 (keeping 200 days of data) [2025-10-02T19:44:45.811949] [DEBUG] [LOCAL ] JOBY: Primary data saved (54189 records). [2025-10-02T19:44:45.812088] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-02T19:44:45.812207] [INFO ] [MAIN ] Update Progress: 1167/2370 symbols completed. JOBY took 48.0s. Estimated remaining: 2h 49m 47s. Rate: 7.1 symbols/min [2025-10-02T19:44:45.887081] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-02T19:44:46.009371] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:44:46.028336] [DEBUG] [LOCAL ] JRI: Loaded 14885 existing records from primary storage. [2025-10-02T19:44:46.028614] [INFO ] [MAIN ] JRI: Loaded 14885 existing records. [2025-10-02T19:44:46.228087] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:46.228314] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-02T19:44:46.228366] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-02T19:44:46.228966] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-02T19:44:46.229037] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-02T19:44:46.668518] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T19:44:46.666782] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:46.677216] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-10-02T19:44:46.726628] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-10-02T19:44:47.407046] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-02T19:44:47.472986] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-02T19:44:47.680001] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-10-02T19:44:48.273049] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-02T19:44:49.073050] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-02T19:44:49.536410] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:44:49.872972] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-02T19:44:49.974625] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-10-02T19:44:50.115407] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-02T19:44:50.672998] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-02T19:44:51.094606] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-02T19:44:51.473054] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-02T19:44:51.949809] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T19:44:51.951821] [INFO ] [REMOTE ] JPC: Full fetch complete (55628 records). [2025-10-02T19:44:51.951999] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-02T19:44:52.278120] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-02T19:44:52.418359] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-02T19:44:52.418452] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-02T19:44:52.419361] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-02T19:44:52.419428] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-02T19:44:52.420757] [DEBUG] [LOCAL ] JPC: Trimmed 55628 records to 37383 (keeping 200 days of data) [2025-10-02T19:44:52.663490] [DEBUG] [LOCAL ] JPC: Primary data saved (37383 records). [2025-10-02T19:44:52.663661] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-02T19:44:52.663806] [INFO ] [MAIN ] Update Progress: 1168/2370 symbols completed. JPC took 37.8s. Estimated remaining: 2h 49m 37s. Rate: 7.1 symbols/min [2025-10-02T19:44:52.846892] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:44:52.860317] [DEBUG] [LOCAL ] JRS: Loaded 11305 existing records from primary storage. [2025-10-02T19:44:52.860560] [INFO ] [MAIN ] JRS: Loaded 11305 existing records. [2025-10-02T19:44:53.054721] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:44:53.054968] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-02T19:44:53.055020] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-02T19:44:53.055446] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-02T19:44:53.055510] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-02T19:44:53.079379] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-02T19:44:53.379814] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:44:53.503703] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:44:53.539283] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-02T19:44:53.872992] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-10-02T19:44:54.560900] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-02T19:44:54.577801] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-10-02T19:44:54.672983] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-02T19:44:55.472988] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-02T19:44:56.273003] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-02T19:44:56.488090] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-02T19:44:57.032854] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T19:44:57.073052] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-02T19:44:57.151995] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-10-02T19:44:57.872977] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-02T19:44:57.893940] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-02T19:44:58.673035] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-02T19:44:59.250720] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-02T19:44:59.472981] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-02T19:44:59.484195] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-02T19:45:00.273005] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-02T19:45:01.073051] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-02T19:45:01.301950] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-02T19:45:01.870182] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-10-02T19:45:01.881054] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-02T19:45:02.143102] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-02T19:45:02.673019] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-02T19:45:03.050708] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-02T19:45:03.473059] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-02T19:45:04.273005] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-02T19:45:04.474038] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T19:45:04.856151] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-02T19:45:05.002962] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-02T19:45:05.073046] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-02T19:45:05.873037] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-02T19:45:06.673000] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-02T19:45:07.158317] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-02T19:45:07.160472] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-10-02T19:45:07.160779] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-02T19:45:07.475376] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-02T19:45:07.547532] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-02T19:45:07.681112] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:45:07.681437] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-02T19:45:07.686069] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-02T19:45:07.688427] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-02T19:45:07.688510] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-02T19:45:07.690041] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 54184 (keeping 200 days of data) [2025-10-02T19:45:08.047024] [DEBUG] [LOCAL ] JPM: Primary data saved (54184 records). [2025-10-02T19:45:08.047175] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-02T19:45:08.047262] [INFO ] [MAIN ] Update Progress: 1169/2370 symbols completed. JPM took 40.4s. Estimated remaining: 2h 49m 35s. Rate: 7.1 symbols/min [2025-10-02T19:45:08.239335] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:08.282129] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-02T19:45:08.285890] [DEBUG] [LOCAL ] JXN: Loaded 45580 existing records from primary storage. [2025-10-02T19:45:08.286325] [INFO ] [MAIN ] JXN: Loaded 45580 existing records. [2025-10-02T19:45:08.416678] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-02T19:45:08.501085] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:08.501324] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-02T19:45:08.501374] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-02T19:45:08.502367] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-02T19:45:08.502429] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-02T19:45:08.896205] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:09.073015] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-10-02T19:45:09.403913] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-02T19:45:09.873004] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-02T19:45:10.526457] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:45:10.672986] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-02T19:45:11.251333] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T19:45:11.473068] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-02T19:45:12.264615] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T19:45:12.278694] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-02T19:45:12.301131] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T19:45:12.941836] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-02T19:45:13.073005] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-02T19:45:13.872983] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-02T19:45:14.092623] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-02T19:45:14.673003] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-02T19:45:15.045734] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T19:45:15.473023] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-02T19:45:16.178547] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-02T19:45:16.179976] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T19:45:16.188287] [INFO ] [REMOTE ] JRI: Full fetch complete (23264 records). [2025-10-02T19:45:16.189052] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-02T19:45:16.278161] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-02T19:45:16.595614] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-02T19:45:16.595729] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-02T19:45:16.596274] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-02T19:45:16.596361] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-02T19:45:16.597023] [DEBUG] [LOCAL ] JRI: Trimmed 23264 records to 14997 (keeping 200 days of data) [2025-10-02T19:45:16.691790] [DEBUG] [LOCAL ] JRI: Primary data saved (14997 records). [2025-10-02T19:45:16.691967] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-02T19:45:16.692165] [INFO ] [MAIN ] Update Progress: 1170/2370 symbols completed. JRI took 30.9s. Estimated remaining: 2h 49m 27s. Rate: 7.1 symbols/min [2025-10-02T19:45:16.874568] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:16.922286] [DEBUG] [LOCAL ] K: Loaded 49977 existing records from primary storage. [2025-10-02T19:45:16.922665] [INFO ] [MAIN ] K: Loaded 49977 existing records. [2025-10-02T19:45:17.078119] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-02T19:45:17.109302] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:17.109687] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-02T19:45:17.109748] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-02T19:45:17.110837] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-02T19:45:17.110897] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-02T19:45:17.501427] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:17.514112] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-02T19:45:17.516065] [INFO ] [REMOTE ] JQC: Full fetch complete (49237 records). [2025-10-02T19:45:17.516161] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-02T19:45:17.734737] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-02T19:45:17.878123] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-10-02T19:45:17.954921] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-02T19:45:17.955020] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-02T19:45:17.956132] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-02T19:45:17.956227] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-02T19:45:17.957894] [DEBUG] [LOCAL ] JQC: Trimmed 49237 records to 34592 (keeping 200 days of data) [2025-10-02T19:45:18.190542] [DEBUG] [LOCAL ] JQC: Primary data saved (34592 records). [2025-10-02T19:45:18.190721] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-02T19:45:18.190819] [INFO ] [MAIN ] Update Progress: 1171/2370 symbols completed. JQC took 36.6s. Estimated remaining: 2h 49m 11s. Rate: 7.1 symbols/min [2025-10-02T19:45:18.382252] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:18.399216] [DEBUG] [LOCAL ] KAI: Loaded 13309 existing records from primary storage. [2025-10-02T19:45:18.399489] [INFO ] [MAIN ] KAI: Loaded 13309 existing records. [2025-10-02T19:45:18.602798] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:18.603084] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-02T19:45:18.603151] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-02T19:45:18.603733] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-02T19:45:18.603800] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-02T19:45:18.678144] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-02T19:45:19.006359] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:19.473041] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-10-02T19:45:19.635998] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T19:45:20.109457] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T19:45:20.273014] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-02T19:45:20.333591] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-10-02T19:45:20.861407] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-02T19:45:20.862483] [INFO ] [REMOTE ] JRS: Full fetch complete (16298 records). [2025-10-02T19:45:20.862556] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-02T19:45:21.078987] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-02T19:45:21.273688] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-02T19:45:21.273778] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-02T19:45:21.274205] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-02T19:45:21.274248] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-02T19:45:21.274895] [DEBUG] [LOCAL ] JRS: Trimmed 16298 records to 11452 (keeping 200 days of data) [2025-10-02T19:45:21.345419] [DEBUG] [LOCAL ] JRS: Primary data saved (11452 records). [2025-10-02T19:45:21.345556] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-02T19:45:21.345639] [INFO ] [MAIN ] Update Progress: 1172/2370 symbols completed. JRS took 28.7s. Estimated remaining: 2h 48m 58s. Rate: 7.1 symbols/min [2025-10-02T19:45:21.558220] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:21.610264] [DEBUG] [LOCAL ] KAR: Loaded 39968 existing records from primary storage. [2025-10-02T19:45:21.610592] [INFO ] [MAIN ] KAR: Loaded 39968 existing records. [2025-10-02T19:45:21.812601] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:21.812888] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-02T19:45:21.812952] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-02T19:45:21.813883] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-02T19:45:21.813949] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-02T19:45:21.878108] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-02T19:45:22.213111] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:22.502900] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T19:45:22.672972] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-02T19:45:22.740945] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T19:45:23.473027] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-02T19:45:24.019639] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-02T19:45:24.273003] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-02T19:45:24.832337] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-02T19:45:25.072999] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-02T19:45:25.249491] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-02T19:45:25.873053] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-02T19:45:26.652892] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-02T19:45:26.672954] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-02T19:45:26.712532] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T19:45:27.472982] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-02T19:45:28.027986] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T19:45:28.272973] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-02T19:45:28.577229] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T19:45:29.073011] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-02T19:45:29.863449] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T19:45:29.878587] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-02T19:45:29.899703] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T19:45:30.673014] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-02T19:45:30.888100] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:45:31.473087] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-02T19:45:32.191365] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-02T19:45:32.273003] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-02T19:45:32.470050] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:45:33.073006] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-02T19:45:33.878257] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-02T19:45:33.884212] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-02T19:45:34.496388] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-02T19:45:34.673004] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-02T19:45:34.735371] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T19:45:35.473011] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-02T19:45:35.513418] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T19:45:36.273000] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-02T19:45:36.957272] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-02T19:45:36.958415] [INFO ] [REMOTE ] KAI: Full fetch complete (18852 records). [2025-10-02T19:45:36.958501] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-02T19:45:37.075225] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-10-02T19:45:37.401764] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-02T19:45:37.401988] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-02T19:45:37.402615] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-02T19:45:37.421402] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-02T19:45:37.436966] [DEBUG] [LOCAL ] KAI: Trimmed 18852 records to 13381 (keeping 200 days of data) [2025-10-02T19:45:37.439308] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T19:45:37.547207] [DEBUG] [LOCAL ] KAI: Primary data saved (13381 records). [2025-10-02T19:45:37.547370] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-02T19:45:37.547481] [INFO ] [MAIN ] Update Progress: 1173/2370 symbols completed. KAI took 19.4s. Estimated remaining: 2h 48m 57s. Rate: 7.1 symbols/min [2025-10-02T19:45:37.726624] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:37.750402] [DEBUG] [LOCAL ] KB: Loaded 23969 existing records from primary storage. [2025-10-02T19:45:37.750682] [INFO ] [MAIN ] KB: Loaded 23969 existing records. [2025-10-02T19:45:37.878219] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-02T19:45:37.948333] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:37.948539] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-02T19:45:37.948633] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-02T19:45:37.949605] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-02T19:45:37.949691] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-02T19:45:38.334968] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:38.582398] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T19:45:38.673058] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-10-02T19:45:39.381617] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-02T19:45:39.473013] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-02T19:45:39.897747] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T19:45:40.273012] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-02T19:45:40.834097] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-02T19:45:41.073015] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-02T19:45:41.436832] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-02T19:45:41.872999] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-02T19:45:42.159150] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T19:45:42.672971] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-02T19:45:42.895956] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-02T19:45:43.473072] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-02T19:45:44.273078] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-02T19:45:44.439160] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T19:45:45.065317] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-02T19:45:45.072956] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-02T19:45:45.109695] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T19:45:45.873079] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-02T19:45:46.238745] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T19:45:46.672997] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-02T19:45:47.472965] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-02T19:45:47.518696] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T19:45:48.181198] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-02T19:45:48.272977] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-02T19:45:48.376335] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T19:45:49.072996] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-02T19:45:49.708354] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:45:49.872997] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-02T19:45:50.471915] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T19:45:50.673006] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-02T19:45:51.391364] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-02T19:45:51.472995] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-02T19:45:52.103023] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T19:45:52.105185] [INFO ] [REMOTE ] K: Full fetch complete (72096 records). [2025-10-02T19:45:52.105410] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-02T19:45:52.278106] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-02T19:45:52.560240] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-02T19:45:52.560387] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-02T19:45:52.561503] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-02T19:45:52.561576] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-02T19:45:52.563332] [DEBUG] [LOCAL ] K: Trimmed 72096 records to 50366 (keeping 200 days of data) [2025-10-02T19:45:52.907598] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-02T19:45:52.932354] [DEBUG] [LOCAL ] K: Primary data saved (50366 records). [2025-10-02T19:45:52.932530] [INFO ] [MAIN ] K: Full history saved. [2025-10-02T19:45:52.932673] [INFO ] [MAIN ] Update Progress: 1174/2370 symbols completed. K took 36.2s. Estimated remaining: 2h 48m 56s. Rate: 7.1 symbols/min [2025-10-02T19:45:53.078122] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-02T19:45:53.131839] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:53.154830] [DEBUG] [LOCAL ] KBDC: Loaded 21161 existing records from primary storage. [2025-10-02T19:45:53.155100] [INFO ] [MAIN ] KBDC: Loaded 21161 existing records. [2025-10-02T19:45:53.351380] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:53.351813] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-02T19:45:53.351878] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-02T19:45:53.352483] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-02T19:45:53.352545] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-02T19:45:53.678893] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:45:53.791120] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:53.873031] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-02T19:45:54.553585] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T19:45:54.672996] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-02T19:45:55.098860] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T19:45:55.473035] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-10-02T19:45:55.708969] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-02T19:45:55.710720] [INFO ] [REMOTE ] JXN: Full fetch complete (65216 records). [2025-10-02T19:45:55.710822] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-02T19:45:56.152043] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-02T19:45:56.152236] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-02T19:45:56.153314] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-02T19:45:56.153445] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-02T19:45:56.155559] [DEBUG] [LOCAL ] JXN: Trimmed 65216 records to 45845 (keeping 200 days of data) [2025-10-02T19:45:56.273215] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-02T19:45:56.398897] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-10-02T19:45:56.480116] [DEBUG] [LOCAL ] JXN: Primary data saved (45845 records). [2025-10-02T19:45:56.480274] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-02T19:45:56.480365] [INFO ] [MAIN ] Update Progress: 1175/2370 symbols completed. JXN took 48.4s. Estimated remaining: 2h 48m 42s. Rate: 7.1 symbols/min [2025-10-02T19:45:56.686869] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:45:56.736756] [DEBUG] [LOCAL ] KBH: Loaded 48894 existing records from primary storage. [2025-10-02T19:45:56.737136] [INFO ] [MAIN ] KBH: Loaded 48894 existing records. [2025-10-02T19:45:56.930888] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:45:56.931165] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-02T19:45:56.931221] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-02T19:45:56.932371] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-02T19:45:56.932436] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-02T19:45:57.082126] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-02T19:45:57.324204] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:45:57.881522] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-02T19:45:57.887027] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T19:45:58.248565] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-02T19:45:58.673000] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-02T19:45:59.131279] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T19:45:59.473025] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-10-02T19:46:00.184277] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-02T19:46:00.272995] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-02T19:46:00.934251] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T19:46:01.061097] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-02T19:46:01.072950] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-02T19:46:01.873016] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-02T19:46:02.245822] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-02T19:46:02.672985] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-02T19:46:02.844781] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T19:46:03.473046] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-02T19:46:03.784583] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-02T19:46:03.786436] [INFO ] [REMOTE ] KAR: Full fetch complete (56823 records). [2025-10-02T19:46:03.786565] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-02T19:46:04.203989] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-02T19:46:04.204074] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-02T19:46:04.204891] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-02T19:46:04.204956] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-02T19:46:04.206226] [DEBUG] [LOCAL ] KAR: Trimmed 56823 records to 40252 (keeping 200 days of data) [2025-10-02T19:46:04.290171] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-02T19:46:04.439181] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T19:46:04.475552] [DEBUG] [LOCAL ] KAR: Primary data saved (40252 records). [2025-10-02T19:46:04.475764] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-02T19:46:04.475865] [INFO ] [MAIN ] Update Progress: 1176/2370 symbols completed. KAR took 43.1s. Estimated remaining: 2h 48m 33s. Rate: 7.1 symbols/min [2025-10-02T19:46:04.676634] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:04.726469] [DEBUG] [LOCAL ] KBR: Loaded 48025 existing records from primary storage. [2025-10-02T19:46:04.726941] [INFO ] [MAIN ] KBR: Loaded 48025 existing records. [2025-10-02T19:46:04.936312] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:46:04.936525] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-02T19:46:04.936577] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-02T19:46:04.937710] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-02T19:46:04.937772] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-02T19:46:05.086139] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-02T19:46:05.345617] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:05.359989] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T19:46:05.873031] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-02T19:46:06.137558] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T19:46:06.672997] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-10-02T19:46:07.473005] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-02T19:46:07.507744] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T19:46:08.254232] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T19:46:08.272976] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-02T19:46:08.502080] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T19:46:09.073074] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-02T19:46:09.537028] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:46:09.872978] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-02T19:46:10.107950] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-02T19:46:10.672991] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-02T19:46:11.473027] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-02T19:46:11.742589] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-10-02T19:46:12.093554] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T19:46:12.119289] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-02T19:46:12.273038] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-02T19:46:13.074529] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T19:46:13.074400] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-02T19:46:13.077133] [INFO ] [REMOTE ] KB: Full fetch complete (34031 records). [2025-10-02T19:46:13.077230] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-02T19:46:13.496676] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-02T19:46:13.496776] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-02T19:46:13.497489] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-02T19:46:13.497534] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-02T19:46:13.498605] [DEBUG] [LOCAL ] KB: Trimmed 34031 records to 24074 (keeping 200 days of data) [2025-10-02T19:46:13.655749] [DEBUG] [LOCAL ] KB: Primary data saved (24074 records). [2025-10-02T19:46:13.655887] [INFO ] [MAIN ] KB: Full history saved. [2025-10-02T19:46:13.655972] [INFO ] [MAIN ] Update Progress: 1177/2370 symbols completed. KB took 36.1s. Estimated remaining: 2h 48m 25s. Rate: 7.1 symbols/min [2025-10-02T19:46:13.872742] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:13.873293] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-02T19:46:13.927837] [DEBUG] [LOCAL ] KD: Loaded 52309 existing records from primary storage. [2025-10-02T19:46:13.928230] [INFO ] [MAIN ] KD: Loaded 52309 existing records. [2025-10-02T19:46:14.131585] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:46:14.131860] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-02T19:46:14.131910] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-02T19:46:14.132978] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-02T19:46:14.133041] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-02T19:46:14.523410] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:14.672979] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-02T19:46:14.757788] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-02T19:46:14.911431] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-02T19:46:15.473008] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-02T19:46:16.273009] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-02T19:46:16.503806] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-10-02T19:46:17.073070] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-02T19:46:17.242868] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-02T19:46:17.241419] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-02T19:46:17.254378] [INFO ] [REMOTE ] KBDC: Full fetch complete (28952 records). [2025-10-02T19:46:17.254877] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-02T19:46:17.660268] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-02T19:46:17.660356] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-02T19:46:17.661026] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-02T19:46:17.661092] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-02T19:46:17.662067] [DEBUG] [LOCAL ] KBDC: Trimmed 28952 records to 21392 (keeping 200 days of data) [2025-10-02T19:46:17.797352] [DEBUG] [LOCAL ] KBDC: Primary data saved (21392 records). [2025-10-02T19:46:17.797484] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-02T19:46:17.797565] [INFO ] [MAIN ] Update Progress: 1178/2370 symbols completed. KBDC took 24.9s. Estimated remaining: 2h 48m 13s. Rate: 7.1 symbols/min [2025-10-02T19:46:17.880737] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-02T19:46:17.985266] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:17.992155] [DEBUG] [LOCAL ] KEN: Loaded 4732 existing records from primary storage. [2025-10-02T19:46:17.992356] [INFO ] [MAIN ] KEN: Loaded 4732 existing records. [2025-10-02T19:46:18.191793] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:46:18.192012] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-02T19:46:18.192084] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-02T19:46:18.192347] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-02T19:46:18.192409] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-02T19:46:18.655794] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-02T19:46:18.691240] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:18.678583] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-10-02T19:46:19.472985] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-02T19:46:19.522259] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:46:20.272983] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-10-02T19:46:20.309094] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-10-02T19:46:21.073000] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-02T19:46:21.091278] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T19:46:21.131417] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-02T19:46:21.873009] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-02T19:46:22.672998] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-02T19:46:22.900433] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-02T19:46:23.473024] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-02T19:46:23.525674] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T19:46:24.042812] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T19:46:24.122216] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T19:46:24.273029] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-02T19:46:25.073044] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-02T19:46:25.433801] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-02T19:46:25.739265] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T19:46:25.873034] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-02T19:46:26.673002] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-02T19:46:27.473044] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-02T19:46:27.623255] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-02T19:46:28.056425] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-02T19:46:28.089602] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T19:46:28.273023] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-02T19:46:29.073034] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-02T19:46:29.842961] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-02T19:46:29.873026] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-02T19:46:29.932830] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T19:46:30.673003] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-02T19:46:31.311124] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-02T19:46:31.472987] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-02T19:46:31.794323] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T19:46:32.172006] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-02T19:46:32.273000] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-02T19:46:33.073048] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-02T19:46:33.652264] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T19:46:33.873002] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-02T19:46:34.650588] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-02T19:46:34.678144] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-02T19:46:34.699277] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-02T19:46:35.473031] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-02T19:46:36.037584] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-02T19:46:36.273055] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-02T19:46:36.516898] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-10-02T19:46:36.629930] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-02T19:46:37.072999] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-02T19:46:37.873002] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-02T19:46:38.522040] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T19:46:38.673021] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-02T19:46:39.473037] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-02T19:46:39.560040] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-02T19:46:40.085333] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:46:40.087448] [INFO ] [REMOTE ] KBH: Full fetch complete (70724 records). [2025-10-02T19:46:40.087589] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-02T19:46:40.273340] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-02T19:46:40.544129] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-02T19:46:40.544364] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-02T19:46:40.545486] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-02T19:46:40.545621] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-02T19:46:40.547367] [DEBUG] [LOCAL ] KBH: Trimmed 70724 records to 49218 (keeping 200 days of data) [2025-10-02T19:46:40.868344] [DEBUG] [LOCAL ] KBH: Primary data saved (49218 records). [2025-10-02T19:46:40.868496] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-02T19:46:40.870225] [INFO ] [MAIN ] Update Progress: 1179/2370 symbols completed. KBH took 44.4s. Estimated remaining: 2h 48m 19s. Rate: 7.1 symbols/min [2025-10-02T19:46:41.059036] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:41.074579] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-02T19:46:41.096553] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-02T19:46:41.134784] [DEBUG] [LOCAL ] KEP: Loaded 31109 existing records from primary storage. [2025-10-02T19:46:41.135088] [INFO ] [MAIN ] KEP: Loaded 31109 existing records. [2025-10-02T19:46:41.325117] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:46:41.325492] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-02T19:46:41.325611] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-02T19:46:41.326610] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-02T19:46:41.326705] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-02T19:46:41.590431] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T19:46:41.606295] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-02T19:46:41.617006] [INFO ] [REMOTE ] KEN: Full fetch complete (5943 records). [2025-10-02T19:46:41.637454] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-02T19:46:41.643256] [INFO ] [REMOTE ] KBR: Full fetch complete (69809 records). [2025-10-02T19:46:41.659256] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-02T19:46:41.820618] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:41.882166] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-02T19:46:42.574732] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-02T19:46:42.578576] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-02T19:46:42.578444] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-02T19:46:42.578931] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-02T19:46:42.578984] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-02T19:46:42.579097] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-02T19:46:42.580106] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-02T19:46:42.580380] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-02T19:46:42.581182] [DEBUG] [LOCAL ] KEN: Trimmed 5943 records to 4749 (keeping 200 days of data) [2025-10-02T19:46:42.603225] [DEBUG] [LOCAL ] KBR: Trimmed 69809 records to 48339 (keeping 200 days of data) [2025-10-02T19:46:42.698729] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-10-02T19:46:42.710113] [DEBUG] [LOCAL ] KEN: Primary data saved (4749 records). [2025-10-02T19:46:42.714497] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-02T19:46:42.715347] [INFO ] [MAIN ] Update Progress: 1180/2370 symbols completed. KEN took 24.9s. Estimated remaining: 2h 48m 4s. Rate: 7.1 symbols/min [2025-10-02T19:46:42.963953] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:43.115762] [DEBUG] [LOCAL ] KEX: Loaded 38135 existing records from primary storage. [2025-10-02T19:46:43.117381] [INFO ] [MAIN ] KEX: Loaded 38135 existing records. [2025-10-02T19:46:43.331314] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:46:43.334856] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-02T19:46:43.334981] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-02T19:46:43.357203] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-02T19:46:43.372809] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-02T19:46:43.687185] [DEBUG] [LOCAL ] KBR: Primary data saved (48339 records). [2025-10-02T19:46:43.708331] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-02T19:46:43.712738] [INFO ] [MAIN ] Update Progress: 1181/2370 symbols completed. KBR took 39.2s. Estimated remaining: 2h 47m 48s. Rate: 7.1 symbols/min [2025-10-02T19:46:43.896305] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:43.916894] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-10-02T19:46:44.040998] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:44.041583] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-02T19:46:44.041764] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-02T19:46:44.042142] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-02T19:46:44.042555] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-02T19:46:44.042702] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-02T19:46:44.050326] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-02T19:46:44.087274] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-10-02T19:46:44.281518] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-02T19:46:44.331481] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-10-02T19:46:44.547863] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:45.073005] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-10-02T19:46:45.201048] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-10-02T19:46:45.264038] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T19:46:45.873008] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-02T19:46:46.672968] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-02T19:46:46.953082] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-10-02T19:46:47.402037] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-02T19:46:47.472996] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-02T19:46:47.771467] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:46:48.272994] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-02T19:46:49.047843] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-02T19:46:49.072958] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-02T19:46:49.133906] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-02T19:46:49.872996] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-02T19:46:50.321345] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-02T19:46:50.673026] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-02T19:46:51.447837] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-02T19:46:51.473015] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-02T19:46:52.272993] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-02T19:46:52.543183] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-10-02T19:46:52.972881] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:46:53.072980] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-02T19:46:53.872975] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-02T19:46:54.001051] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-02T19:46:54.357959] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T19:46:54.673017] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-02T19:46:55.167956] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:46:55.170832] [INFO ] [REMOTE ] KD: Full fetch complete (75650 records). [2025-10-02T19:46:55.171069] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-02T19:46:55.481513] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-02T19:46:55.618296] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-02T19:46:55.618388] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-02T19:46:55.619465] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-02T19:46:55.619574] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-02T19:46:55.621202] [DEBUG] [LOCAL ] KD: Trimmed 75650 records to 52682 (keeping 200 days of data) [2025-10-02T19:46:55.956967] [DEBUG] [LOCAL ] KD: Primary data saved (52682 records). [2025-10-02T19:46:55.957119] [INFO ] [MAIN ] KD: Full history saved. [2025-10-02T19:46:55.957250] [INFO ] [MAIN ] Update Progress: 1182/2370 symbols completed. KD took 42.3s. Estimated remaining: 2h 47m 43s. Rate: 7.1 symbols/min [2025-10-02T19:46:56.143318] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:46:56.189267] [DEBUG] [LOCAL ] KEYS: Loaded 43152 existing records from primary storage. [2025-10-02T19:46:56.189595] [INFO ] [MAIN ] KEYS: Loaded 43152 existing records. [2025-10-02T19:46:56.277309] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-02T19:46:56.410219] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-02T19:46:56.416024] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:46:56.424513] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-02T19:46:56.425079] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-02T19:46:56.426375] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-02T19:46:56.426454] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-02T19:46:56.847397] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:46:57.073024] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-02T19:46:57.369409] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T19:46:57.501796] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-02T19:46:57.873033] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-10-02T19:46:58.610793] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-02T19:46:58.673026] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-02T19:46:59.472978] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-02T19:46:59.521795] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-10-02T19:47:00.180288] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T19:47:00.272946] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-02T19:47:01.073020] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-02T19:47:01.488206] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-02T19:47:01.526629] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T19:47:01.873062] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-02T19:47:02.672995] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-02T19:47:03.473052] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-02T19:47:04.134044] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T19:47:04.273031] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-02T19:47:05.258373] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-02T19:47:05.270764] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-02T19:47:05.313965] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (4.24 seconds). [2025-10-02T19:47:05.873029] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-02T19:47:05.963005] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T19:47:06.604776] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (4.73 seconds). [2025-10-02T19:47:06.673047] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-02T19:47:06.961333] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-02T19:47:07.073290] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-02T19:47:07.473019] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-02T19:47:08.051749] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-02T19:47:08.273069] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-02T19:47:08.959487] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T19:47:09.072999] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-02T19:47:09.872974] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-02T19:47:09.917691] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-02T19:47:10.073271] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T19:47:10.672995] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-02T19:47:11.473058] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-02T19:47:11.742220] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-02T19:47:12.273020] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-02T19:47:12.412111] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-02T19:47:12.545153] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-02T19:47:12.547687] [INFO ] [REMOTE ] KEP: Full fetch complete (41742 records). [2025-10-02T19:47:12.547776] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-02T19:47:12.966899] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-02T19:47:12.966983] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-02T19:47:12.967685] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-02T19:47:12.967748] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-02T19:47:12.968797] [DEBUG] [LOCAL ] KEP: Trimmed 41742 records to 31283 (keeping 200 days of data) [2025-10-02T19:47:13.073539] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-02T19:47:13.189593] [DEBUG] [LOCAL ] KEP: Primary data saved (31283 records). [2025-10-02T19:47:13.189792] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-02T19:47:13.191936] [INFO ] [MAIN ] Update Progress: 1183/2370 symbols completed. KEP took 32.3s. Estimated remaining: 2h 47m 43s. Rate: 7.1 symbols/min [2025-10-02T19:47:13.391250] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:13.397000] [DEBUG] [LOCAL ] KF: Loaded 2447 existing records from primary storage. [2025-10-02T19:47:13.397308] [INFO ] [MAIN ] KF: Loaded 2447 existing records. [2025-10-02T19:47:13.606909] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:13.607161] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-02T19:47:13.607252] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-02T19:47:13.607500] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-02T19:47:13.607603] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-02T19:47:13.700042] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-02T19:47:13.731211] [INFO ] [REMOTE ] KEX: Full fetch complete (55839 records). [2025-10-02T19:47:13.746933] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-02T19:47:13.874533] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-02T19:47:14.246399] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:14.473377] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-02T19:47:14.473500] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-02T19:47:14.474465] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-02T19:47:14.474563] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-02T19:47:14.476505] [DEBUG] [LOCAL ] KEX: Trimmed 55839 records to 38410 (keeping 200 days of data) [2025-10-02T19:47:14.558984] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-02T19:47:14.689886] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-10-02T19:47:14.757685] [DEBUG] [LOCAL ] KEX: Primary data saved (38410 records). [2025-10-02T19:47:14.757853] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-02T19:47:14.757949] [INFO ] [MAIN ] Update Progress: 1184/2370 symbols completed. KEX took 32.0s. Estimated remaining: 2h 47m 28s. Rate: 7.1 symbols/min [2025-10-02T19:47:14.940370] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:14.960889] [DEBUG] [LOCAL ] KFRC: Loaded 19595 existing records from primary storage. [2025-10-02T19:47:14.961192] [INFO ] [MAIN ] KFRC: Loaded 19595 existing records. [2025-10-02T19:47:15.155891] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:15.160116] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-02T19:47:15.160789] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-02T19:47:15.160616] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-02T19:47:15.163273] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-02T19:47:15.163337] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-02T19:47:15.478165] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-02T19:47:15.555181] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:16.116977] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-10-02T19:47:16.273054] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-10-02T19:47:16.892046] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-02T19:47:17.073003] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-02T19:47:17.155369] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-02T19:47:17.389685] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-02T19:47:17.873033] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-02T19:47:18.673046] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-02T19:47:18.720359] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-02T19:47:19.473064] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-02T19:47:20.272988] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-02T19:47:20.382086] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T19:47:20.462770] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T19:47:21.073016] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-02T19:47:21.591051] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-02T19:47:21.872984] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-02T19:47:22.077777] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-02T19:47:22.291463] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-02T19:47:22.673011] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-02T19:47:23.473003] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-02T19:47:23.963893] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-02T19:47:24.018388] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-02T19:47:24.273014] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-02T19:47:25.073021] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-02T19:47:25.423944] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-02T19:47:25.594931] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T19:47:25.597424] [INFO ] [REMOTE ] KEY: Full fetch complete (77257 records). [2025-10-02T19:47:25.597837] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-02T19:47:25.818449] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T19:47:25.819323] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:47:25.819399] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:47:25.819473] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-02T19:47:25.819544] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-02T19:47:25.819581] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-02T19:47:25.819637] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-02T19:47:25.819784] [INFO ] [MAIN ] Update Progress: 1185/2370 symbols completed. KEY took 42.1s. Estimated remaining: 2h 47m 22s. Rate: 7.1 symbols/min [2025-10-02T19:47:25.879693] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-02T19:47:26.036582] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:26.048084] [DEBUG] [LOCAL ] KFS: Loaded 8478 existing records from primary storage. [2025-10-02T19:47:26.048572] [INFO ] [MAIN ] KFS: Loaded 8478 existing records. [2025-10-02T19:47:26.238108] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:26.238380] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-02T19:47:26.238438] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-02T19:47:26.238859] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-02T19:47:26.238920] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-02T19:47:26.359456] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-02T19:47:26.632100] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:26.673009] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-02T19:47:27.473010] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-02T19:47:28.186752] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T19:47:28.220852] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-02T19:47:28.273013] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-02T19:47:29.073072] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-02T19:47:29.376973] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T19:47:29.873048] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-02T19:47:30.128042] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T19:47:30.129986] [INFO ] [REMOTE ] KEYS: Full fetch complete (62841 records). [2025-10-02T19:47:30.130125] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-02T19:47:30.558046] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-02T19:47:30.558292] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-02T19:47:30.559624] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-02T19:47:30.559845] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-02T19:47:30.561634] [DEBUG] [LOCAL ] KEYS: Trimmed 62841 records to 43450 (keeping 200 days of data) [2025-10-02T19:47:30.674711] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-10-02T19:47:30.681266] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T19:47:30.866678] [DEBUG] [LOCAL ] KEYS: Primary data saved (43450 records). [2025-10-02T19:47:30.866824] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-02T19:47:30.866932] [INFO ] [MAIN ] Update Progress: 1186/2370 symbols completed. KEYS took 34.9s. Estimated remaining: 2h 47m 10s. Rate: 7.1 symbols/min [2025-10-02T19:47:31.058803] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:31.089887] [DEBUG] [LOCAL ] KFY: Loaded 29999 existing records from primary storage. [2025-10-02T19:47:31.090200] [INFO ] [MAIN ] KFY: Loaded 29999 existing records. [2025-10-02T19:47:31.288612] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-02T19:47:31.292683] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:31.294915] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-02T19:47:31.294967] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-02T19:47:31.295611] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-10-02T19:47:31.295701] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-02T19:47:31.487610] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-02T19:47:31.710371] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:32.059915] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T19:47:32.273032] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-10-02T19:47:33.073024] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-02T19:47:33.648438] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T19:47:33.670206] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T19:47:33.873005] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-02T19:47:34.671363] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-02T19:47:34.675377] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-02T19:47:35.138029] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-02T19:47:35.473101] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-02T19:47:36.077178] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-02T19:47:36.272998] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-02T19:47:37.072979] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-02T19:47:37.468339] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-02T19:47:37.469701] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T19:47:37.470576] [INFO ] [REMOTE ] KF: Full fetch complete (3564 records). [2025-10-02T19:47:37.476463] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-02T19:47:37.879639] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-02T19:47:37.889117] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-02T19:47:37.889202] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-02T19:47:37.889395] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-02T19:47:37.889477] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-02T19:47:37.890004] [DEBUG] [LOCAL ] KF: Trimmed 3564 records to 2452 (keeping 200 days of data) [2025-10-02T19:47:37.908699] [DEBUG] [LOCAL ] KF: Primary data saved (2452 records). [2025-10-02T19:47:37.908804] [INFO ] [MAIN ] KF: Full history saved. [2025-10-02T19:47:37.909056] [INFO ] [MAIN ] Update Progress: 1187/2370 symbols completed. KF took 24.7s. Estimated remaining: 2h 47m 0s. Rate: 7.1 symbols/min [2025-10-02T19:47:38.093491] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:38.160370] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-02T19:47:38.160766] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-10-02T19:47:38.356674] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:38.356906] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-02T19:47:38.356956] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-02T19:47:38.358503] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-02T19:47:38.358580] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-02T19:47:38.678154] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-02T19:47:38.758861] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:39.010177] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T19:47:39.472979] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-02T19:47:39.766825] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T19:47:40.273007] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-02T19:47:40.633337] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-02T19:47:41.073001] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-02T19:47:41.450962] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-02T19:47:41.872999] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-02T19:47:42.513730] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:47:42.673018] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-02T19:47:43.026566] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T19:47:43.073804] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-02T19:47:43.473008] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-02T19:47:44.075175] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-02T19:47:44.273009] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-10-02T19:47:45.073010] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-02T19:47:45.873023] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-02T19:47:45.970172] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T19:47:46.176380] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-10-02T19:47:46.673018] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-02T19:47:46.788952] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-02T19:47:46.790178] [INFO ] [REMOTE ] KFRC: Full fetch complete (25704 records). [2025-10-02T19:47:46.790258] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-02T19:47:47.208194] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-02T19:47:47.208289] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-02T19:47:47.208913] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-02T19:47:47.208982] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-02T19:47:47.209886] [DEBUG] [LOCAL ] KFRC: Trimmed 25704 records to 19732 (keeping 200 days of data) [2025-10-02T19:47:47.338478] [DEBUG] [LOCAL ] KFRC: Primary data saved (19732 records). [2025-10-02T19:47:47.338761] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-02T19:47:47.338902] [INFO ] [MAIN ] Update Progress: 1188/2370 symbols completed. KFRC took 32.6s. Estimated remaining: 2h 46m 53s. Rate: 7.1 symbols/min [2025-10-02T19:47:47.489564] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-02T19:47:47.525978] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:47.574085] [DEBUG] [LOCAL ] KGS: Loaded 45668 existing records from primary storage. [2025-10-02T19:47:47.574394] [INFO ] [MAIN ] KGS: Loaded 45668 existing records. [2025-10-02T19:47:47.767977] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:47.768492] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-02T19:47:47.768681] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-02T19:47:47.770005] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-02T19:47:47.770070] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-02T19:47:48.070793] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-02T19:47:48.194482] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:48.272989] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-02T19:47:48.356629] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-02T19:47:49.073003] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-02T19:47:49.645893] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-02T19:47:49.856311] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-02T19:47:49.872961] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-02T19:47:50.621778] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-02T19:47:50.673011] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-02T19:47:51.405815] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T19:47:51.473060] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-10-02T19:47:52.272973] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-02T19:47:53.075740] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-02T19:47:53.092782] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T19:47:53.542318] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T19:47:53.872997] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-02T19:47:54.670138] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-02T19:47:54.680389] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-02T19:47:55.101417] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-02T19:47:55.473040] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-02T19:47:55.472833] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-02T19:47:56.273041] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-02T19:47:57.028202] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T19:47:57.029081] [INFO ] [REMOTE ] KFS: Full fetch complete (10584 records). [2025-10-02T19:47:57.029158] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-02T19:47:57.078469] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-02T19:47:57.444899] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-02T19:47:57.445049] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-02T19:47:57.445383] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-02T19:47:57.445480] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-02T19:47:57.446387] [DEBUG] [LOCAL ] KFS: Trimmed 10584 records to 8523 (keeping 200 days of data) [2025-10-02T19:47:57.511576] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-10-02T19:47:57.548775] [DEBUG] [LOCAL ] KFS: Primary data saved (8523 records). [2025-10-02T19:47:57.549357] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-02T19:47:57.549482] [INFO ] [MAIN ] Update Progress: 1189/2370 symbols completed. KFS took 31.7s. Estimated remaining: 2h 46m 46s. Rate: 7.1 symbols/min [2025-10-02T19:47:57.731971] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:47:57.797200] [DEBUG] [LOCAL ] KIM: Loaded 53045 existing records from primary storage. [2025-10-02T19:47:57.797631] [INFO ] [MAIN ] KIM: Loaded 53045 existing records. [2025-10-02T19:47:57.880446] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-02T19:47:57.996033] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:47:57.996282] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-02T19:47:57.996340] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-02T19:47:57.997816] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-02T19:47:57.997886] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-02T19:47:58.385170] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:47:58.647139] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:47:58.672968] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-02T19:47:59.472974] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-02T19:47:59.971268] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T19:48:00.003328] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-10-02T19:48:00.273011] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-02T19:48:00.639092] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T19:48:01.073084] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-02T19:48:01.873043] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-02T19:48:02.241540] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-10-02T19:48:02.673000] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-02T19:48:03.018506] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-02T19:48:03.473158] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-02T19:48:03.581449] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-10-02T19:48:03.966048] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T19:48:04.273025] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-02T19:48:04.534116] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-02T19:48:04.535736] [INFO ] [REMOTE ] KFY: Full fetch complete (43491 records). [2025-10-02T19:48:04.535842] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-02T19:48:04.968684] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-02T19:48:04.968794] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-02T19:48:04.969519] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-02T19:48:04.969598] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-02T19:48:04.970795] [DEBUG] [LOCAL ] KFY: Trimmed 43491 records to 30268 (keeping 200 days of data) [2025-10-02T19:48:05.073299] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-02T19:48:05.178343] [DEBUG] [LOCAL ] KFY: Primary data saved (30268 records). [2025-10-02T19:48:05.178492] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-02T19:48:05.178602] [INFO ] [MAIN ] Update Progress: 1190/2370 symbols completed. KFY took 34.3s. Estimated remaining: 2h 46m 37s. Rate: 7.1 symbols/min [2025-10-02T19:48:05.361978] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:05.384070] [DEBUG] [LOCAL ] KIO: Loaded 21220 existing records from primary storage. [2025-10-02T19:48:05.384343] [INFO ] [MAIN ] KIO: Loaded 21220 existing records. [2025-10-02T19:48:05.571925] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:48:05.572127] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-02T19:48:05.572176] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-02T19:48:05.572864] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-02T19:48:05.572925] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-02T19:48:05.878085] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-10-02T19:48:05.959409] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:06.415075] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-02T19:48:06.555473] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:48:06.673000] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-02T19:48:07.473016] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-02T19:48:07.674200] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-10-02T19:48:08.278227] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-02T19:48:08.293249] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-02T19:48:09.073001] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-02T19:48:09.463569] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-02T19:48:09.872985] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-10-02T19:48:10.056374] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-02T19:48:10.580181] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-10-02T19:48:10.673067] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-02T19:48:10.725686] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T19:48:11.472976] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-02T19:48:11.848216] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-02T19:48:12.273017] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-02T19:48:13.072997] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-02T19:48:13.822181] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-02T19:48:13.874273] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-02T19:48:13.894830] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-02T19:48:14.111917] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-02T19:48:14.673052] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-02T19:48:15.472972] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-02T19:48:15.829509] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T19:48:15.895307] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-02T19:48:15.897416] [INFO ] [REMOTE ] KGS: Full fetch complete (66336 records). [2025-10-02T19:48:15.897591] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-02T19:48:16.279599] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-02T19:48:16.340209] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-02T19:48:16.340299] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-02T19:48:16.341286] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-02T19:48:16.341363] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-02T19:48:16.342947] [DEBUG] [LOCAL ] KGS: Trimmed 66336 records to 46001 (keeping 200 days of data) [2025-10-02T19:48:16.579624] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-02T19:48:16.656794] [DEBUG] [LOCAL ] KGS: Primary data saved (46001 records). [2025-10-02T19:48:16.656928] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-02T19:48:16.657012] [INFO ] [MAIN ] Update Progress: 1191/2370 symbols completed. KGS took 29.3s. Estimated remaining: 2h 46m 31s. Rate: 7.1 symbols/min [2025-10-02T19:48:16.841743] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:16.899122] [DEBUG] [LOCAL ] KKR: Loaded 53500 existing records from primary storage. [2025-10-02T19:48:16.899457] [INFO ] [MAIN ] KKR: Loaded 53500 existing records. [2025-10-02T19:48:17.091267] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-02T19:48:17.097257] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:48:17.097472] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-02T19:48:17.097540] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-02T19:48:17.099741] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-02T19:48:17.099844] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-02T19:48:17.470319] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:17.873004] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-02T19:48:18.192021] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-02T19:48:18.451130] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-02T19:48:18.673053] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-10-02T19:48:19.218802] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-02T19:48:19.473015] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-02T19:48:20.273043] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-02T19:48:20.597233] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-10-02T19:48:21.073036] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-02T19:48:21.292265] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-02T19:48:21.873028] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-02T19:48:22.270493] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T19:48:22.672987] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-02T19:48:22.860820] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-02T19:48:22.955828] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-02T19:48:23.472992] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-02T19:48:24.235221] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-02T19:48:24.273018] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-02T19:48:24.973388] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-02T19:48:25.073063] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-02T19:48:25.271509] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-02T19:48:25.873079] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-02T19:48:26.672961] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-02T19:48:27.010444] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-02T19:48:27.174570] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-02T19:48:27.473034] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-02T19:48:28.272999] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-02T19:48:28.439080] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-02T19:48:29.073052] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-02T19:48:29.453362] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-02T19:48:29.455764] [INFO ] [REMOTE ] KGC: Full fetch complete (77696 records). [2025-10-02T19:48:29.456104] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-02T19:48:29.876540] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-02T19:48:29.896716] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-02T19:48:29.897919] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-02T19:48:29.899072] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-02T19:48:29.899293] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-02T19:48:29.901245] [DEBUG] [LOCAL ] KGC: Trimmed 77696 records to 54089 (keeping 200 days of data) [2025-10-02T19:48:30.196210] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-02T19:48:30.300479] [DEBUG] [LOCAL ] KGC: Primary data saved (54089 records). [2025-10-02T19:48:30.300620] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-02T19:48:30.301578] [INFO ] [MAIN ] Update Progress: 1192/2370 symbols completed. KGC took 52.4s. Estimated remaining: 2h 46m 28s. Rate: 7.1 symbols/min [2025-10-02T19:48:30.486710] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:30.496458] [DEBUG] [LOCAL ] KKRS: Loaded 5710 existing records from primary storage. [2025-10-02T19:48:30.496731] [INFO ] [MAIN ] KKRS: Loaded 5710 existing records. [2025-10-02T19:48:30.672977] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-02T19:48:30.701503] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:48:30.702698] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-02T19:48:30.702832] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-02T19:48:30.703325] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-02T19:48:30.703388] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-02T19:48:31.147478] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:31.151451] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-10-02T19:48:31.179622] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-02T19:48:31.473014] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-02T19:48:32.272972] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-02T19:48:32.527207] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T19:48:33.072979] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-02T19:48:33.182467] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T19:48:33.322472] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-02T19:48:33.872999] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-02T19:48:34.672998] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-02T19:48:35.127299] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-02T19:48:35.186563] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T19:48:35.190880] [INFO ] [REMOTE ] KIM: Full fetch complete (76828 records). [2025-10-02T19:48:35.191071] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-02T19:48:35.479413] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-02T19:48:35.535807] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:48:35.554110] [INFO ] [REMOTE ] KIO: Full fetch complete (31296 records). [2025-10-02T19:48:35.564627] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-02T19:48:35.742472] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-02T19:48:35.766170] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-02T19:48:35.770521] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-02T19:48:35.776435] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-02T19:48:35.836884] [DEBUG] [LOCAL ] KIM: Trimmed 76828 records to 53419 (keeping 200 days of data) [2025-10-02T19:48:36.278601] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-10-02T19:48:36.317227] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-02T19:48:36.317843] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-02T19:48:36.318720] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-02T19:48:36.318807] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-02T19:48:36.386377] [DEBUG] [LOCAL ] KIO: Trimmed 31296 records to 21442 (keeping 200 days of data) [2025-10-02T19:48:36.404296] [DEBUG] [LOCAL ] KIM: Primary data saved (53419 records). [2025-10-02T19:48:36.404846] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-02T19:48:36.405226] [INFO ] [MAIN ] Update Progress: 1193/2370 symbols completed. KIM took 38.9s. Estimated remaining: 2h 46m 17s. Rate: 7.1 symbols/min [2025-10-02T19:48:36.735239] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:36.742722] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-02T19:48:36.751473] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-02T19:48:36.753143] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-02T19:48:36.752971] [DEBUG] [LOCAL ] KIO: Primary data saved (21442 records). [2025-10-02T19:48:36.753396] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-02T19:48:36.753309] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-02T19:48:36.753579] [INFO ] [MAIN ] Update Progress: 1194/2370 symbols completed. KIO took 31.6s. Estimated remaining: 2h 46m 0s. Rate: 7.1 symbols/min [2025-10-02T19:48:36.753714] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-02T19:48:36.771756] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-02T19:48:37.058842] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-10-02T19:48:37.086639] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-02T19:48:37.102280] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:37.142231] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-02T19:48:37.155070] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-02T19:48:37.231396] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-02T19:48:37.249105] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-02T19:48:37.254511] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-02T19:48:37.259861] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-02T19:48:37.496682] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:37.776476] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-02T19:48:37.837886] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-10-02T19:48:37.882525] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-02T19:48:37.934553] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:38.600402] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-02T19:48:38.673014] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-10-02T19:48:38.874003] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:48:38.874428] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-10-02T19:48:38.874544] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:48:38.874613] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-02T19:48:38.874711] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:48:38.874801] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-02T19:48:38.874885] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-02T19:48:38.874933] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-02T19:48:38.875015] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-02T19:48:38.875106] [INFO ] [MAIN ] Update Progress: 1195/2370 symbols completed. KLAR took 2.1s. Estimated remaining: 2h 45m 46s. Rate: 7.1 symbols/min [2025-10-02T19:48:39.088833] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:39.125275] [DEBUG] [LOCAL ] KLC: Loaded 36723 existing records from primary storage. [2025-10-02T19:48:39.125616] [INFO ] [MAIN ] KLC: Loaded 36723 existing records. [2025-10-02T19:48:39.320067] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:48:39.320317] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-02T19:48:39.320368] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-02T19:48:39.321161] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-02T19:48:39.321223] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-02T19:48:39.478165] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-10-02T19:48:39.748042] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:39.752152] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:48:39.752531] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-10-02T19:48:39.752665] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:48:39.752740] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-02T19:48:39.752851] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:48:39.752937] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-02T19:48:39.753004] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-02T19:48:39.753045] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-02T19:48:39.753116] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-02T19:48:39.753189] [INFO ] [MAIN ] Update Progress: 1196/2370 symbols completed. KKRT took 3.3s. Estimated remaining: 2h 45m 30s. Rate: 7.1 symbols/min [2025-10-02T19:48:39.937329] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:48:39.989871] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-02T19:48:39.990292] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-02T19:48:40.184032] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:48:40.184238] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-02T19:48:40.184287] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-02T19:48:40.185460] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-02T19:48:40.185525] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-02T19:48:40.278092] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-02T19:48:40.568842] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:48:40.712117] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-02T19:48:41.072998] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-02T19:48:41.844439] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-02T19:48:41.872974] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-02T19:48:42.529809] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-02T19:48:42.673022] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-10-02T19:48:43.473003] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-02T19:48:44.272965] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-02T19:48:44.785386] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-10-02T19:48:44.797946] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-02T19:48:45.073042] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-02T19:48:45.418232] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-02T19:48:45.873024] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-02T19:48:46.673023] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-02T19:48:47.172877] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-02T19:48:47.189710] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-02T19:48:47.473044] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-02T19:48:47.776732] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-10-02T19:48:48.273011] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-10-02T19:48:49.072997] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-02T19:48:49.570834] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-10-02T19:48:49.656014] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-02T19:48:49.872963] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-02T19:48:49.967628] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-10-02T19:48:50.433219] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T19:48:50.673019] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-02T19:48:51.473033] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-02T19:48:51.936543] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-02T19:48:51.937377] [INFO ] [REMOTE ] KKRS: Full fetch complete (7898 records). [2025-10-02T19:48:51.937480] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-02T19:48:52.273726] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-02T19:48:52.332856] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-02T19:48:52.333047] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-02T19:48:52.333350] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-02T19:48:52.333498] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-02T19:48:52.334121] [DEBUG] [LOCAL ] KKRS: Trimmed 7898 records to 5729 (keeping 200 days of data) [2025-10-02T19:48:52.371982] [DEBUG] [LOCAL ] KKRS: Primary data saved (5729 records). [2025-10-02T19:48:52.372109] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-02T19:48:52.372195] [INFO ] [MAIN ] Update Progress: 1197/2370 symbols completed. KKRS took 22.1s. Estimated remaining: 2h 45m 25s. Rate: 7.1 symbols/min [2025-10-02T19:48:52.608978] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-02T19:48:53.073003] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-02T19:48:53.872986] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-02T19:48:54.340894] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-02T19:48:54.590706] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-02T19:48:54.593075] [INFO ] [REMOTE ] KKR: Full fetch complete (77445 records). [2025-10-02T19:48:54.593500] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-02T19:48:54.680949] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-02T19:48:55.026731] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-02T19:48:55.026895] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-02T19:48:55.028017] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-02T19:48:55.028142] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-02T19:48:55.029945] [DEBUG] [LOCAL ] KKR: Trimmed 77445 records to 53890 (keeping 200 days of data) [2025-10-02T19:48:55.162187] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T19:48:55.410004] [DEBUG] [LOCAL ] KKR: Primary data saved (53890 records). [2025-10-02T19:48:55.410149] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-02T19:48:55.410232] [INFO ] [MAIN ] Update Progress: 1198/2370 symbols completed. KKR took 38.8s. Estimated remaining: 2h 45m 12s. Rate: 7.1 symbols/min [2025-10-02T19:48:55.472997] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-02T19:48:56.306914] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-02T19:48:56.312971] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-02T19:48:56.480797] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-10-02T19:48:57.073026] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-02T19:48:57.727617] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-02T19:48:57.873046] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-02T19:48:59.061309] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T19:48:59.073133] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-02T19:48:59.315366] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:48:59.473049] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-02T19:49:00.921340] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-02T19:49:00.930090] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-02T19:49:01.777882] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-10-02T19:49:01.789746] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-02T19:49:02.050229] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-02T19:49:02.059250] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-02T19:49:03.399612] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-02T19:49:03.407692] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-02T19:49:03.621280] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-02T19:49:03.633496] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-02T19:49:04.855580] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T19:49:04.864802] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-02T19:49:05.501532] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T19:49:05.514930] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-02T19:49:06.329219] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-02T19:49:06.342610] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-02T19:49:07.481555] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-02T19:49:07.494126] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-02T19:49:07.687111] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-02T19:49:07.688951] [INFO ] [REMOTE ] KLC: Full fetch complete (50690 records). [2025-10-02T19:49:07.689100] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-02T19:49:08.105897] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-02T19:49:08.105985] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-02T19:49:08.106880] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-02T19:49:08.106950] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-02T19:49:08.108290] [DEBUG] [LOCAL ] KLC: Trimmed 50690 records to 36984 (keeping 200 days of data) [2025-10-02T19:49:08.328266] [DEBUG] [LOCAL ] KLC: Primary data saved (36984 records). [2025-10-02T19:49:08.328415] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-02T19:49:08.328521] [INFO ] [MAIN ] Update Progress: 1199/2370 symbols completed. KLC took 29.5s. Estimated remaining: 2h 45m 8s. Rate: 7.1 symbols/min [2025-10-02T19:49:08.972725] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T19:49:08.974969] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-10-02T19:49:08.975109] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-02T19:49:09.392130] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-02T19:49:09.392222] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-02T19:49:09.393465] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-02T19:49:09.393535] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-02T19:49:09.395186] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 54083 (keeping 200 days of data) [2025-10-02T19:49:09.745217] [DEBUG] [LOCAL ] KMI: Primary data saved (54083 records). [2025-10-02T19:49:09.745371] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-02T19:49:09.745459] [INFO ] [MAIN ] Update Progress: 1200/2370 symbols completed. KMI took 30.0s. Estimated remaining: 2h 44m 52s. Rate: 7.1 symbols/min [2025-10-02T19:49:10.315608] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:10.435183] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:10.512887] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:10.536779] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:10.545487] [DEBUG] [LOCAL ] KMPB: Loaded 3780 existing records from primary storage. [2025-10-02T19:49:10.546043] [INFO ] [MAIN ] KMPB: Loaded 3780 existing records. [2025-10-02T19:49:10.795027] [DEBUG] [LOCAL ] KMPR: Loaded 38886 existing records from primary storage. [2025-10-02T19:49:10.817432] [DEBUG] [LOCAL ] KMT: Loaded 42939 existing records from primary storage. [2025-10-02T19:49:10.817947] [INFO ] [MAIN ] KMPR: Loaded 38886 existing records. [2025-10-02T19:49:10.847121] [DEBUG] [LOCAL ] KMX: Loaded 53161 existing records from primary storage. [2025-10-02T19:49:10.846233] [INFO ] [MAIN ] KMT: Loaded 42939 existing records. [2025-10-02T19:49:10.845862] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:10.857926] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-02T19:49:10.858063] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-02T19:49:10.871912] [INFO ] [MAIN ] KMX: Loaded 53161 existing records. [2025-10-02T19:49:10.971168] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-02T19:49:11.018525] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-02T19:49:11.530450] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:11.600737] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-02T19:49:11.600441] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:11.604840] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-02T19:49:11.638066] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-02T19:49:11.655982] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:11.661465] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-02T19:49:11.661570] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-02T19:49:11.686924] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-02T19:49:11.692279] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-02T19:49:11.723915] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-02T19:49:11.723785] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-02T19:49:11.754811] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-02T19:49:11.774573] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-02T19:49:11.803417] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-02T19:49:12.332818] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:12.406211] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-10-02T19:49:13.146464] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:13.149630] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:13.183621] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-10-02T19:49:13.189841] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:13.191861] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-10-02T19:49:13.192367] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T19:49:13.192843] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-10-02T19:49:13.195517] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-02T19:49:13.628946] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-02T19:49:13.630258] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-02T19:49:14.139980] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-02T19:49:14.140785] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T19:49:14.142316] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-02T19:49:14.149589] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-02T19:49:14.523972] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T19:49:14.532798] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-02T19:49:14.604417] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T19:49:14.672995] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-02T19:49:14.709238] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-02T19:49:15.279107] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-02T19:49:15.473049] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-02T19:49:15.922608] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-02T19:49:16.278996] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-02T19:49:16.303091] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T19:49:16.720637] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-02T19:49:16.862140] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-02T19:49:17.073001] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-02T19:49:17.873014] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-02T19:49:18.322633] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-02T19:49:18.368818] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T19:49:18.673014] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-02T19:49:19.473012] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-02T19:49:20.262042] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-02T19:49:20.272948] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-02T19:49:20.677428] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-02T19:49:21.073066] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-02T19:49:21.873009] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-02T19:49:22.258948] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-02T19:49:22.334798] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:49:22.672958] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-02T19:49:23.145598] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T19:49:23.473017] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-02T19:49:24.273002] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-02T19:49:24.595588] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T19:49:24.806542] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-02T19:49:24.852784] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T19:49:25.073007] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-02T19:49:25.873001] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-02T19:49:26.672982] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-02T19:49:26.794222] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T19:49:27.058109] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-02T19:49:27.122896] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-02T19:49:27.473005] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-02T19:49:28.023495] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-02T19:49:28.273016] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-02T19:49:29.073013] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-02T19:49:29.696194] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-02T19:49:29.872998] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-02T19:49:30.628614] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-02T19:49:30.673066] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-02T19:49:31.210311] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-02T19:49:31.478317] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-02T19:49:31.497797] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-02T19:49:32.273012] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-02T19:49:33.072972] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-02T19:49:33.147618] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-02T19:49:33.873963] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-02T19:49:33.877120] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-02T19:49:34.425799] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-02T19:49:34.673005] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-02T19:49:35.027672] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-02T19:49:35.472995] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-02T19:49:35.905771] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-02T19:49:35.908083] [INFO ] [REMOTE ] KMPR: Full fetch complete (51562 records). [2025-10-02T19:49:35.908279] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-02T19:49:36.288374] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-02T19:49:36.347121] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-02T19:49:36.347235] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-02T19:49:36.348210] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-02T19:49:36.348280] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-02T19:49:36.349731] [DEBUG] [LOCAL ] KMPR: Trimmed 51562 records to 39204 (keeping 200 days of data) [2025-10-02T19:49:36.604119] [DEBUG] [LOCAL ] KMPR: Primary data saved (39204 records). [2025-10-02T19:49:36.604274] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-02T19:49:36.604406] [INFO ] [MAIN ] Update Progress: 1201/2370 symbols completed. KMPR took 26.9s. Estimated remaining: 2h 45m 2s. Rate: 7.1 symbols/min [2025-10-02T19:49:36.785351] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:36.826338] [DEBUG] [LOCAL ] KN: Loaded 38555 existing records from primary storage. [2025-10-02T19:49:36.826683] [INFO ] [MAIN ] KN: Loaded 38555 existing records. [2025-10-02T19:49:37.020869] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:37.021155] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-02T19:49:37.021208] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-02T19:49:37.022210] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-02T19:49:37.022273] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-02T19:49:37.092564] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-02T19:49:37.426836] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:37.461234] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-02T19:49:37.500475] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-02T19:49:37.663409] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-02T19:49:37.664514] [INFO ] [REMOTE ] KMPB: Full fetch complete (5134 records). [2025-10-02T19:49:37.664615] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-02T19:49:37.886314] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-02T19:49:38.091487] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-02T19:49:38.091570] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-02T19:49:38.091759] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-02T19:49:38.091823] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-02T19:49:38.092213] [DEBUG] [LOCAL ] KMPB: Trimmed 5134 records to 3795 (keeping 200 days of data) [2025-10-02T19:49:38.115748] [DEBUG] [LOCAL ] KMPB: Primary data saved (3795 records). [2025-10-02T19:49:38.115854] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-02T19:49:38.115932] [INFO ] [MAIN ] Update Progress: 1202/2370 symbols completed. KMPB took 28.4s. Estimated remaining: 2h 44m 47s. Rate: 7.1 symbols/min [2025-10-02T19:49:38.303478] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:38.341363] [DEBUG] [LOCAL ] KNF: Loaded 35852 existing records from primary storage. [2025-10-02T19:49:38.341679] [INFO ] [MAIN ] KNF: Loaded 35852 existing records. [2025-10-02T19:49:38.534992] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:38.535229] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-02T19:49:38.535279] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-02T19:49:38.539130] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-02T19:49:38.539205] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-02T19:49:38.678311] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-02T19:49:38.988981] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:39.473063] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-10-02T19:49:39.997844] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-02T19:49:40.256972] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-02T19:49:40.272947] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-02T19:49:40.734011] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-10-02T19:49:41.073011] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-02T19:49:41.782538] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-02T19:49:41.873040] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-02T19:49:41.937236] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-02T19:49:42.673045] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-10-02T19:49:43.435249] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-02T19:49:43.437473] [INFO ] [REMOTE ] KMX: Full fetch complete (76053 records). [2025-10-02T19:49:43.437632] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-02T19:49:43.478216] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-02T19:49:43.891782] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-02T19:49:43.891980] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-02T19:49:43.893200] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-02T19:49:43.893316] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-02T19:49:43.896384] [DEBUG] [LOCAL ] KMX: Trimmed 76053 records to 53551 (keeping 200 days of data) [2025-10-02T19:49:44.151679] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T19:49:44.264637] [DEBUG] [LOCAL ] KMX: Primary data saved (53551 records). [2025-10-02T19:49:44.264813] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-02T19:49:44.264958] [INFO ] [MAIN ] Update Progress: 1203/2370 symbols completed. KMX took 34.5s. Estimated remaining: 2h 44m 36s. Rate: 7.1 symbols/min [2025-10-02T19:49:44.278082] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-02T19:49:44.446415] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:44.460300] [DEBUG] [LOCAL ] KNOP: Loaded 10442 existing records from primary storage. [2025-10-02T19:49:44.460528] [INFO ] [MAIN ] KNOP: Loaded 10442 existing records. [2025-10-02T19:49:44.651127] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:44.651439] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-02T19:49:44.651559] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-02T19:49:44.652156] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-10-02T19:49:44.652261] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-02T19:49:45.061244] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:45.063556] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-02T19:49:45.073013] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-02T19:49:45.341943] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-02T19:49:45.873032] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-10-02T19:49:46.477095] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-02T19:49:46.494582] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-10-02T19:49:46.673078] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-02T19:49:47.473034] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-02T19:49:47.749323] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-02T19:49:47.751029] [INFO ] [REMOTE ] KMT: Full fetch complete (62091 records). [2025-10-02T19:49:47.751327] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-02T19:49:48.188951] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-02T19:49:48.189143] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-02T19:49:48.190034] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-02T19:49:48.190098] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-02T19:49:48.191704] [DEBUG] [LOCAL ] KMT: Trimmed 62091 records to 43222 (keeping 200 days of data) [2025-10-02T19:49:48.297276] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-02T19:49:48.300716] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-02T19:49:48.488506] [DEBUG] [LOCAL ] KMT: Primary data saved (43222 records). [2025-10-02T19:49:48.488676] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-02T19:49:48.488819] [INFO ] [MAIN ] Update Progress: 1204/2370 symbols completed. KMT took 38.7s. Estimated remaining: 2h 44m 23s. Rate: 7.1 symbols/min [2025-10-02T19:49:48.680044] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:49:48.701777] [DEBUG] [LOCAL ] KNSL: Loaded 18181 existing records from primary storage. [2025-10-02T19:49:48.702092] [INFO ] [MAIN ] KNSL: Loaded 18181 existing records. [2025-10-02T19:49:48.902292] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:49:48.902519] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-02T19:49:48.902567] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-02T19:49:48.903192] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-02T19:49:48.903253] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-02T19:49:49.073996] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-02T19:49:49.294771] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:49:49.802555] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T19:49:49.864477] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-02T19:49:49.872951] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-02T19:49:50.467748] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-02T19:49:50.673033] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-02T19:49:51.473035] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-02T19:49:51.716826] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-02T19:49:52.273023] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-10-02T19:49:52.890922] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-02T19:49:53.073019] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-02T19:49:53.372694] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-10-02T19:49:53.873000] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-02T19:49:54.517173] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:49:54.673043] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-02T19:49:55.116841] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-02T19:49:55.473046] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-02T19:49:55.633628] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-02T19:49:56.273006] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-02T19:49:56.378301] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-02T19:49:57.072965] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-02T19:49:57.744578] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-02T19:49:57.872984] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-02T19:49:57.891273] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T19:49:58.673011] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-02T19:49:59.272130] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-02T19:49:59.473021] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-02T19:49:59.483106] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-02T19:50:00.272983] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-02T19:50:00.953303] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:50:01.072978] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-02T19:50:01.224382] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-02T19:50:01.873046] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-02T19:50:02.494863] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-02T19:50:02.673026] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-02T19:50:02.828353] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T19:50:03.472987] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-02T19:50:03.807241] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T19:50:04.205379] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-02T19:50:04.273005] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-02T19:50:05.073004] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-02T19:50:05.179133] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-02T19:50:05.873058] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-02T19:50:06.401097] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-02T19:50:06.673002] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-02T19:50:06.936995] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-02T19:50:07.473013] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-02T19:50:08.119067] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-02T19:50:08.273010] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-02T19:50:08.633317] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-02T19:50:09.058229] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T19:50:09.059253] [INFO ] [REMOTE ] KNOP: Full fetch complete (14778 records). [2025-10-02T19:50:09.059335] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-02T19:50:09.078134] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-02T19:50:09.472855] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-02T19:50:09.472941] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-02T19:50:09.473316] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-02T19:50:09.473378] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-02T19:50:09.473975] [DEBUG] [LOCAL ] KNOP: Trimmed 14778 records to 10514 (keeping 200 days of data) [2025-10-02T19:50:09.542249] [DEBUG] [LOCAL ] KNOP: Primary data saved (10514 records). [2025-10-02T19:50:09.542392] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-02T19:50:09.542498] [INFO ] [MAIN ] Update Progress: 1205/2370 symbols completed. KNOP took 25.3s. Estimated remaining: 2h 44m 27s. Rate: 7.1 symbols/min [2025-10-02T19:50:09.742208] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:50:09.795221] [DEBUG] [LOCAL ] KNTK: Loaded 46161 existing records from primary storage. [2025-10-02T19:50:09.795678] [INFO ] [MAIN ] KNTK: Loaded 46161 existing records. [2025-10-02T19:50:09.879122] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-02T19:50:09.996220] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:50:09.996483] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-02T19:50:09.996541] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-02T19:50:09.998519] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-02T19:50:09.998592] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-02T19:50:10.378985] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:50:10.394251] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T19:50:10.396573] [INFO ] [REMOTE ] KN: Full fetch complete (56533 records). [2025-10-02T19:50:10.396742] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-02T19:50:10.678237] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-02T19:50:10.814337] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-02T19:50:10.814425] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-02T19:50:10.815374] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-02T19:50:10.815456] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-02T19:50:10.817061] [DEBUG] [LOCAL ] KN: Trimmed 56533 records to 38880 (keeping 200 days of data) [2025-10-02T19:50:11.066509] [DEBUG] [LOCAL ] KN: Primary data saved (38880 records). [2025-10-02T19:50:11.066681] [INFO ] [MAIN ] KN: Full history saved. [2025-10-02T19:50:11.066802] [INFO ] [MAIN ] Update Progress: 1206/2370 symbols completed. KN took 34.5s. Estimated remaining: 2h 44m 12s. Rate: 7.1 symbols/min [2025-10-02T19:50:11.270270] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:50:11.327419] [DEBUG] [LOCAL ] KNX: Loaded 52589 existing records from primary storage. [2025-10-02T19:50:11.327832] [INFO ] [MAIN ] KNX: Loaded 52589 existing records. [2025-10-02T19:50:11.480322] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-10-02T19:50:11.539214] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T19:50:11.563397] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:50:11.572776] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-02T19:50:11.573745] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-02T19:50:11.580434] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-02T19:50:11.590100] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-02T19:50:11.590779] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-02T19:50:11.998613] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:50:12.273041] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-10-02T19:50:12.962342] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-10-02T19:50:13.073010] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-02T19:50:13.872972] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-02T19:50:13.917443] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T19:50:14.276293] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T19:50:14.673003] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-02T19:50:15.196101] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-02T19:50:15.198266] [INFO ] [REMOTE ] KNF: Full fetch complete (50857 records). [2025-10-02T19:50:15.198580] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-02T19:50:15.486628] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-02T19:50:15.635489] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-02T19:50:15.635581] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-02T19:50:15.636491] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-02T19:50:15.636559] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-02T19:50:15.637903] [DEBUG] [LOCAL ] KNF: Trimmed 50857 records to 36189 (keeping 200 days of data) [2025-10-02T19:50:15.877611] [DEBUG] [LOCAL ] KNF: Primary data saved (36189 records). [2025-10-02T19:50:15.877772] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-02T19:50:15.878695] [INFO ] [MAIN ] Update Progress: 1207/2370 symbols completed. KNF took 37.8s. Estimated remaining: 2h 43m 60s. Rate: 7.1 symbols/min [2025-10-02T19:50:16.065115] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:50:16.065342] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-02T19:50:16.065414] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-02T19:50:16.065664] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-02T19:50:16.065740] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-02T19:50:16.065884] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-02T19:50:16.065936] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-02T19:50:16.283997] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-02T19:50:16.490143] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:50:16.514751] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-02T19:50:17.072978] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-02T19:50:17.157328] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-02T19:50:17.182714] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T19:50:17.873003] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-02T19:50:18.640465] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:50:18.661841] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-02T19:50:18.672966] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-02T19:50:19.384155] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-02T19:50:19.473019] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-10-02T19:50:20.273019] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-02T19:50:21.072994] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-02T19:50:21.373112] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-02T19:50:21.879244] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-02T19:50:21.883209] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-10-02T19:50:22.602920] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-02T19:50:22.640480] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-02T19:50:22.673066] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-02T19:50:23.478405] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-02T19:50:23.496613] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-02T19:50:24.273013] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-02T19:50:25.073055] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-02T19:50:25.850422] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-02T19:50:25.872977] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-02T19:50:26.002046] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-10-02T19:50:26.433715] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-02T19:50:26.672998] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-02T19:50:27.506386] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-02T19:50:27.529883] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T19:50:28.273010] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-02T19:50:28.366691] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:50:28.368414] [INFO ] [REMOTE ] KNSL: Full fetch complete (26695 records). [2025-10-02T19:50:28.368684] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-02T19:50:28.814470] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-02T19:50:28.814555] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-02T19:50:28.815143] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-02T19:50:28.815230] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-02T19:50:28.816107] [DEBUG] [LOCAL ] KNSL: Trimmed 26695 records to 18336 (keeping 200 days of data) [2025-10-02T19:50:28.949337] [DEBUG] [LOCAL ] KNSL: Primary data saved (18336 records). [2025-10-02T19:50:28.949498] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-02T19:50:28.949588] [INFO ] [MAIN ] Update Progress: 1208/2370 symbols completed. KNSL took 40.5s. Estimated remaining: 2h 43m 56s. Rate: 7.1 symbols/min [2025-10-02T19:50:29.073516] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-02T19:50:29.144385] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:50:29.179822] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-10-02T19:50:29.227061] [DEBUG] [LOCAL ] KODK: Loaded 43459 existing records from primary storage. [2025-10-02T19:50:29.227376] [INFO ] [MAIN ] KODK: Loaded 43459 existing records. [2025-10-02T19:50:29.424724] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:50:29.424939] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-02T19:50:29.424987] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-02T19:50:29.426232] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-02T19:50:29.426294] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-02T19:50:29.827322] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:50:29.872969] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-10-02T19:50:29.969325] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-02T19:50:30.673034] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-02T19:50:30.806275] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T19:50:31.233329] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-10-02T19:50:31.472998] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-02T19:50:32.272971] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-02T19:50:32.333191] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-02T19:50:33.072971] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-02T19:50:33.133098] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T19:50:33.591977] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-02T19:50:33.872993] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-02T19:50:34.672991] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-02T19:50:35.472979] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-02T19:50:35.596818] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-02T19:50:35.749240] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-10-02T19:50:35.803237] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-02T19:50:36.273072] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-02T19:50:37.053345] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:50:37.072981] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-02T19:50:37.730633] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-02T19:50:37.873012] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-02T19:50:38.319066] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-02T19:50:38.673012] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-02T19:50:39.473083] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-02T19:50:40.273049] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-02T19:50:40.452904] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-02T19:50:40.515606] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-10-02T19:50:40.683673] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-02T19:50:41.073045] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-02T19:50:41.388980] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-02T19:50:41.391056] [INFO ] [REMOTE ] KNTK: Full fetch complete (64649 records). [2025-10-02T19:50:41.391204] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-02T19:50:41.876098] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-02T19:50:41.875824] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-02T19:50:41.876245] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-02T19:50:41.879322] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-02T19:50:41.879499] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-02T19:50:41.881513] [DEBUG] [LOCAL ] KNTK: Trimmed 64649 records to 46533 (keeping 200 days of data) [2025-10-02T19:50:42.179347] [DEBUG] [LOCAL ] KNTK: Primary data saved (46533 records). [2025-10-02T19:50:42.179493] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-02T19:50:42.179706] [INFO ] [MAIN ] Update Progress: 1209/2370 symbols completed. KNTK took 32.6s. Estimated remaining: 2h 43m 52s. Rate: 7.1 symbols/min [2025-10-02T19:50:42.365426] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:50:42.393147] [DEBUG] [LOCAL ] KOF: Loaded 26133 existing records from primary storage. [2025-10-02T19:50:42.393417] [INFO ] [MAIN ] KOF: Loaded 26133 existing records. [2025-10-02T19:50:42.589793] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:50:42.590332] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-02T19:50:42.590389] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-02T19:50:42.591264] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-02T19:50:42.591341] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-02T19:50:42.678132] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-02T19:50:43.009783] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:50:43.043228] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-02T19:50:43.472989] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-10-02T19:50:43.513173] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-02T19:50:44.273019] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-02T19:50:44.289687] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-10-02T19:50:45.078156] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-02T19:50:45.103147] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-10-02T19:50:45.406760] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-02T19:50:45.408956] [INFO ] [REMOTE ] KNX: Full fetch complete (75786 records). [2025-10-02T19:50:45.409217] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-02T19:50:45.875428] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-02T19:50:45.875157] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-02T19:50:45.876361] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-02T19:50:45.877447] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-02T19:50:45.877606] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-02T19:50:45.879345] [DEBUG] [LOCAL ] KNX: Trimmed 75786 records to 52978 (keeping 200 days of data) [2025-10-02T19:50:46.239116] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-02T19:50:46.266893] [DEBUG] [LOCAL ] KNX: Primary data saved (52978 records). [2025-10-02T19:50:46.267049] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-02T19:50:46.267246] [INFO ] [MAIN ] Update Progress: 1210/2370 symbols completed. KNX took 35.2s. Estimated remaining: 2h 43m 39s. Rate: 7.1 symbols/min [2025-10-02T19:50:46.448354] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:50:46.467435] [DEBUG] [LOCAL ] KOP: Loaded 17610 existing records from primary storage. [2025-10-02T19:50:46.467725] [INFO ] [MAIN ] KOP: Loaded 17610 existing records. [2025-10-02T19:50:46.667385] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:50:46.667743] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-02T19:50:46.667806] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-02T19:50:46.668520] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-02T19:50:46.668580] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-02T19:50:46.679984] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-02T19:50:47.058336] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:50:47.478124] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-02T19:50:47.500558] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T19:50:47.831771] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T19:50:48.272997] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-02T19:50:49.072983] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-02T19:50:49.340229] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-02T19:50:49.692778] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-10-02T19:50:49.873013] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-10-02T19:50:50.512563] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T19:50:50.673058] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-02T19:50:50.841014] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T19:50:51.473024] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-02T19:50:51.613309] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-02T19:50:52.273055] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-02T19:50:53.073009] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-02T19:50:53.873073] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-02T19:50:53.927634] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-02T19:50:54.124737] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-02T19:50:54.332776] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-02T19:50:54.495055] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-02T19:50:54.673038] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-02T19:50:55.473048] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-02T19:50:56.273018] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-02T19:50:56.371553] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T19:50:57.073021] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-02T19:50:57.549635] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T19:50:57.666616] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-10-02T19:50:57.873028] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-02T19:50:58.028182] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-02T19:50:58.673009] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-02T19:50:59.142235] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-02T19:50:59.371041] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-02T19:50:59.473023] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-02T19:51:00.273027] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-02T19:51:00.577876] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-02T19:51:01.073016] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-02T19:51:01.873049] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-02T19:51:02.152598] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-02T19:51:02.672998] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-02T19:51:02.740488] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-02T19:51:03.473054] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-02T19:51:03.734696] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-02T19:51:04.273070] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-02T19:51:04.526181] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T19:51:04.528042] [INFO ] [REMOTE ] KOF: Full fetch complete (37312 records). [2025-10-02T19:51:04.528165] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-02T19:51:04.960120] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-02T19:51:04.960342] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-02T19:51:04.961248] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-02T19:51:04.961331] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-02T19:51:04.962747] [DEBUG] [LOCAL ] KOF: Trimmed 37312 records to 26353 (keeping 200 days of data) [2025-10-02T19:51:04.995051] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (3.12 seconds). [2025-10-02T19:51:05.097271] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-02T19:51:05.176280] [DEBUG] [LOCAL ] KOF: Primary data saved (26353 records). [2025-10-02T19:51:05.176444] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-02T19:51:05.176556] [INFO ] [MAIN ] Update Progress: 1211/2370 symbols completed. KOF took 23.0s. Estimated remaining: 2h 43m 41s. Rate: 7.1 symbols/min [2025-10-02T19:51:05.319704] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-02T19:51:05.384234] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:05.384401] [DEBUG] [LOCAL ] KORE: No existing data file found in primary storage. [2025-10-02T19:51:05.384440] [WARN ] [MAIN ] KORE: No existing data found, performing full refresh instead. [2025-10-02T19:51:05.384555] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-02T19:51:05.384596] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-02T19:51:05.384711] [DEBUG] [LOCAL ] KORE: No primary data file found to delete. [2025-10-02T19:51:05.384755] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-02T19:51:05.802024] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:05.873026] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-10-02T19:51:06.351221] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-02T19:51:06.353910] [INFO ] [REMOTE ] KODK: Full fetch complete (63433 records). [2025-10-02T19:51:06.354047] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-02T19:51:06.681421] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-02T19:51:06.801362] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-02T19:51:06.801527] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-02T19:51:06.802682] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-02T19:51:06.802832] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-02T19:51:06.804987] [DEBUG] [LOCAL ] KODK: Trimmed 63433 records to 43779 (keeping 200 days of data) [2025-10-02T19:51:07.023710] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T19:51:07.090201] [DEBUG] [LOCAL ] KODK: Primary data saved (43779 records). [2025-10-02T19:51:07.090344] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-02T19:51:07.090444] [INFO ] [MAIN ] Update Progress: 1212/2370 symbols completed. KODK took 38.1s. Estimated remaining: 2h 43m 26s. Rate: 7.1 symbols/min [2025-10-02T19:51:07.286110] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:07.352708] [DEBUG] [LOCAL ] KOS: Loaded 53059 existing records from primary storage. [2025-10-02T19:51:07.353176] [INFO ] [MAIN ] KOS: Loaded 53059 existing records. [2025-10-02T19:51:07.478110] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-02T19:51:07.555426] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:07.555954] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-02T19:51:07.556200] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-02T19:51:07.558465] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-02T19:51:07.558545] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-02T19:51:07.689673] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:51:07.985577] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:08.273016] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-02T19:51:09.073005] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-02T19:51:09.096068] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-02T19:51:09.847119] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.37 seconds). [2025-10-02T19:51:09.850414] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-10-02T19:51:09.850572] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-02T19:51:09.884958] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-10-02T19:51:10.062423] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-02T19:51:10.081242] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-02T19:51:10.088364] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:51:10.088534] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:51:10.088633] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-02T19:51:10.088782] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-02T19:51:10.088870] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-02T19:51:10.088966] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-02T19:51:10.089079] [INFO ] [MAIN ] Update Progress: 1213/2370 symbols completed. KO took 54.2s. Estimated remaining: 2h 43m 12s. Rate: 7.1 symbols/min [2025-10-02T19:51:10.283200] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:10.345027] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-02T19:51:10.345438] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-02T19:51:10.547245] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:10.547528] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-02T19:51:10.547589] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-02T19:51:10.549999] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-02T19:51:10.550094] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-02T19:51:10.678119] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-02T19:51:10.975195] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:11.349206] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-10-02T19:51:11.472977] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-02T19:51:11.784460] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-02T19:51:11.838738] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-02T19:51:12.273046] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-02T19:51:13.073037] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-02T19:51:13.355416] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T19:51:13.873002] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-02T19:51:14.621568] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-02T19:51:14.623287] [INFO ] [REMOTE ] KOP: Full fetch complete (25484 records). [2025-10-02T19:51:14.623392] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-02T19:51:14.697990] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-10-02T19:51:14.830070] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-02T19:51:15.082182] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-02T19:51:15.082272] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-02T19:51:15.083039] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-02T19:51:15.083164] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-02T19:51:15.084125] [DEBUG] [LOCAL ] KOP: Trimmed 25484 records to 17741 (keeping 200 days of data) [2025-10-02T19:51:15.204158] [DEBUG] [LOCAL ] KOP: Primary data saved (17741 records). [2025-10-02T19:51:15.204315] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-02T19:51:15.204404] [INFO ] [MAIN ] Update Progress: 1214/2370 symbols completed. KOP took 28.9s. Estimated remaining: 2h 43m 1s. Rate: 7.1 symbols/min [2025-10-02T19:51:15.480959] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-02T19:51:15.486860] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:15.557960] [DEBUG] [LOCAL ] KRC: Loaded 48262 existing records from primary storage. [2025-10-02T19:51:15.558459] [INFO ] [MAIN ] KRC: Loaded 48262 existing records. [2025-10-02T19:51:15.821961] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:15.822222] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-02T19:51:15.822279] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-02T19:51:15.824124] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-02T19:51:15.824194] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-02T19:51:15.961192] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-02T19:51:16.275956] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-02T19:51:16.325580] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:16.627610] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-10-02T19:51:16.788885] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-02T19:51:17.073014] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-02T19:51:17.873017] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-02T19:51:18.520633] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-02T19:51:18.673020] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-10-02T19:51:19.473039] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-02T19:51:19.519010] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-02T19:51:19.834394] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T19:51:20.272993] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-02T19:51:21.073027] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-02T19:51:21.279223] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-02T19:51:21.873033] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-02T19:51:22.085108] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-02T19:51:22.623464] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T19:51:22.673025] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-02T19:51:23.473021] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-02T19:51:23.868039] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T19:51:24.273002] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-02T19:51:24.590228] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-02T19:51:25.075860] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-02T19:51:25.081373] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-02T19:51:25.873011] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-02T19:51:26.203105] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-02T19:51:26.367412] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-10-02T19:51:26.511810] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-02T19:51:26.673015] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-02T19:51:27.472999] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-02T19:51:27.922718] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-02T19:51:28.273011] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-02T19:51:28.422052] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-02T19:51:28.756953] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-02T19:51:29.073003] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-02T19:51:29.873005] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-02T19:51:30.672988] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-02T19:51:31.060333] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-10-02T19:51:31.172114] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-02T19:51:31.179767] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-02T19:51:31.472995] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-02T19:51:31.924284] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-02T19:51:32.273011] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-02T19:51:33.073032] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-02T19:51:33.465572] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-02T19:51:33.466348] [INFO ] [REMOTE ] KORE: Full fetch complete (5936 records). [2025-10-02T19:51:33.466422] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-02T19:51:33.871519] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-02T19:51:33.871734] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-02T19:51:33.872111] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-02T19:51:33.872232] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-02T19:51:33.872978] [DEBUG] [LOCAL ] KORE: Trimmed 5936 records to 2034 (keeping 200 days of data) [2025-10-02T19:51:33.873058] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-02T19:51:33.887070] [DEBUG] [LOCAL ] KORE: Primary data saved (2034 records). [2025-10-02T19:51:33.887264] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-02T19:51:33.887361] [INFO ] [MAIN ] Update Progress: 1215/2370 symbols completed. KORE took 28.7s. Estimated remaining: 2h 43m 2s. Rate: 7.1 symbols/min [2025-10-02T19:51:34.116598] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:34.120232] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-02T19:51:34.167278] [DEBUG] [LOCAL ] KREF: Loaded 37580 existing records from primary storage. [2025-10-02T19:51:34.167585] [INFO ] [MAIN ] KREF: Loaded 37580 existing records. [2025-10-02T19:51:34.359671] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:34.359907] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-02T19:51:34.359965] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-02T19:51:34.361388] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-02T19:51:34.361452] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-02T19:51:34.678171] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-02T19:51:34.785607] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:35.473057] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-02T19:51:35.594840] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-02T19:51:36.272962] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-02T19:51:36.644718] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T19:51:37.072981] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-10-02T19:51:37.256302] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-02T19:51:37.623278] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T19:51:37.873005] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-02T19:51:38.417229] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-10-02T19:51:38.673060] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-02T19:51:39.460176] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-02T19:51:39.473081] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-02T19:51:39.918912] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-02T19:51:40.273010] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-02T19:51:41.072995] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-02T19:51:41.341965] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-02T19:51:41.713875] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-02T19:51:41.873016] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-02T19:51:42.672984] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-02T19:51:42.764587] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-02T19:51:43.473019] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-02T19:51:43.919946] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-02T19:51:44.001070] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-02T19:51:44.273000] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-02T19:51:44.677101] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T19:51:45.073018] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-02T19:51:45.873004] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-02T19:51:46.012615] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-02T19:51:46.014801] [INFO ] [REMOTE ] KR: Full fetch complete (77678 records). [2025-10-02T19:51:46.014977] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-02T19:51:46.440257] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-02T19:51:46.440347] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-02T19:51:46.441609] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-02T19:51:46.441707] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-02T19:51:46.443556] [DEBUG] [LOCAL ] KR: Trimmed 77678 records to 54071 (keeping 200 days of data) [2025-10-02T19:51:46.682486] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-02T19:51:46.684039] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-02T19:51:46.689027] [INFO ] [REMOTE ] KOS: Full fetch complete (76886 records). [2025-10-02T19:51:46.690180] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-02T19:51:47.145375] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-02T19:51:47.145732] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-02T19:51:47.147486] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-02T19:51:47.147919] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-02T19:51:47.151591] [DEBUG] [LOCAL ] KOS: Trimmed 76886 records to 53441 (keeping 200 days of data) [2025-10-02T19:51:47.256453] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-02T19:51:47.260358] [INFO ] [REMOTE ] KRC: Full fetch complete (69858 records). [2025-10-02T19:51:47.260771] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-02T19:51:47.950005] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-02T19:51:47.950446] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-02T19:51:47.952704] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-02T19:51:47.954615] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-02T19:51:47.983026] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T19:51:47.994061] [DEBUG] [LOCAL ] KRC: Trimmed 69858 records to 48621 (keeping 200 days of data) [2025-10-02T19:51:47.994410] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-02T19:51:48.110241] [DEBUG] [LOCAL ] KR: Primary data saved (54071 records). [2025-10-02T19:51:48.111871] [INFO ] [MAIN ] KR: Full history saved. [2025-10-02T19:51:48.113580] [INFO ] [MAIN ] Update Progress: 1216/2370 symbols completed. KR took 38.0s. Estimated remaining: 2h 42m 59s. Rate: 7.1 symbols/min [2025-10-02T19:51:48.339722] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:48.539100] [DEBUG] [LOCAL ] KOS: Primary data saved (53441 records). [2025-10-02T19:51:48.549903] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-02T19:51:48.552506] [INFO ] [MAIN ] Update Progress: 1217/2370 symbols completed. KOS took 41.5s. Estimated remaining: 2h 42m 43s. Rate: 7.1 symbols/min [2025-10-02T19:51:48.685620] [DEBUG] [LOCAL ] KRG: Loaded 49159 existing records from primary storage. [2025-10-02T19:51:48.714880] [INFO ] [MAIN ] KRG: Loaded 49159 existing records. [2025-10-02T19:51:48.779143] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:48.843537] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-02T19:51:48.855736] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-02T19:51:48.874098] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-02T19:51:48.945666] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-02T19:51:48.979612] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-02T19:51:49.001794] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-02T19:51:49.073383] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:49.103583] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-02T19:51:49.109705] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-02T19:51:49.159704] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-02T19:51:49.173344] [DEBUG] [LOCAL ] KRC: Primary data saved (48621 records). [2025-10-02T19:51:49.173517] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-02T19:51:49.173627] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-02T19:51:49.184469] [INFO ] [MAIN ] Update Progress: 1218/2370 symbols completed. KRC took 34.0s. Estimated remaining: 2h 42m 27s. Rate: 7.1 symbols/min [2025-10-02T19:51:49.222198] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-02T19:51:49.386509] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-02T19:51:49.880380] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:50.078611] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:50.100439] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-10-02T19:51:50.164385] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:50.165079] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-10-02T19:51:50.185294] [DEBUG] [LOCAL ] KRO: Loaded 26074 existing records from primary storage. [2025-10-02T19:51:50.185555] [INFO ] [MAIN ] KRO: Loaded 26074 existing records. [2025-10-02T19:51:50.369466] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:50.369831] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:51:50.370292] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-02T19:51:50.370624] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-02T19:51:50.370739] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-10-02T19:51:50.371003] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:51:50.371091] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-02T19:51:50.371159] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:51:50.371231] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-02T19:51:50.371304] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-02T19:51:50.371348] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-02T19:51:50.371391] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-02T19:51:50.371450] [INFO ] [MAIN ] Update Progress: 1219/2370 symbols completed. KRMN took 1.8s. Estimated remaining: 2h 42m 12s. Rate: 7.1 symbols/min [2025-10-02T19:51:50.376762] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-02T19:51:50.411705] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-02T19:51:50.734444] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:51:51.039442] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:51.040425] [DEBUG] [LOCAL ] KRP: Loaded 37049 existing records from primary storage. [2025-10-02T19:51:51.040979] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-10-02T19:51:51.041467] [INFO ] [MAIN ] KRP: Loaded 37049 existing records. [2025-10-02T19:51:51.202073] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-10-02T19:51:51.290151] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:51:51.290404] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-02T19:51:51.290483] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-02T19:51:51.291861] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-02T19:51:51.291941] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-02T19:51:51.473920] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-02T19:51:51.696381] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:51:51.771409] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-10-02T19:51:52.201165] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-10-02T19:51:52.273029] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-02T19:51:52.797994] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-02T19:51:53.073037] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-10-02T19:51:53.826204] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-02T19:51:53.873010] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-02T19:51:54.456618] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-10-02T19:51:54.673056] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-02T19:51:54.853428] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-02T19:51:55.473011] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-02T19:51:56.145511] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-02T19:51:56.272994] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-02T19:51:57.005595] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T19:51:57.072996] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-02T19:51:57.590498] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-02T19:51:57.873004] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-02T19:51:58.354044] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-02T19:51:58.673016] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-02T19:51:59.297490] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-02T19:51:59.473025] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-02T19:52:00.278098] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-02T19:52:00.300117] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-02T19:52:00.964508] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-02T19:52:01.073038] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-02T19:52:01.175681] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-02T19:52:01.872995] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-02T19:52:02.447788] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-02T19:52:02.673053] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-02T19:52:03.339222] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T19:52:03.473032] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-02T19:52:03.872439] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T19:52:04.273009] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-02T19:52:04.571396] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-02T19:52:05.073046] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-02T19:52:05.766188] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T19:52:05.873060] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-02T19:52:06.450018] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-02T19:52:06.673029] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-02T19:52:07.365604] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-02T19:52:07.472994] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-02T19:52:08.272994] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-02T19:52:08.431240] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-02T19:52:08.814916] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-02T19:52:09.073012] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-02T19:52:09.132930] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T19:52:09.873008] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-02T19:52:10.366702] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:52:10.372176] [INFO ] [REMOTE ] KREF: Full fetch complete (52603 records). [2025-10-02T19:52:10.372315] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-02T19:52:10.678242] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-02T19:52:10.825572] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-02T19:52:10.825717] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-02T19:52:10.826803] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-02T19:52:10.826885] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-02T19:52:10.828239] [DEBUG] [LOCAL ] KREF: Trimmed 52603 records to 37907 (keeping 200 days of data) [2025-10-02T19:52:11.067795] [DEBUG] [LOCAL ] KREF: Primary data saved (37907 records). [2025-10-02T19:52:11.067955] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-02T19:52:11.068047] [INFO ] [MAIN ] Update Progress: 1220/2370 symbols completed. KREF took 37.2s. Estimated remaining: 2h 42m 15s. Rate: 7.1 symbols/min [2025-10-02T19:52:11.266494] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:52:11.322463] [DEBUG] [LOCAL ] KSS: Loaded 53603 existing records from primary storage. [2025-10-02T19:52:11.322843] [INFO ] [MAIN ] KSS: Loaded 53603 existing records. [2025-10-02T19:52:11.479975] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-02T19:52:11.528599] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:52:11.529410] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-02T19:52:11.529700] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-02T19:52:11.540354] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-02T19:52:11.545789] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-02T19:52:11.599958] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-02T19:52:11.973105] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:52:11.998433] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-02T19:52:12.273005] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-10-02T19:52:12.681198] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-02T19:52:13.073005] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-02T19:52:13.873014] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-02T19:52:14.301909] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-10-02T19:52:14.673003] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-02T19:52:14.778175] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-02T19:52:14.878079] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-02T19:52:15.473007] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-02T19:52:16.273017] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-02T19:52:16.619870] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-02T19:52:16.677325] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-02T19:52:17.073008] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-02T19:52:17.567224] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:52:17.569347] [INFO ] [REMOTE ] KRG: Full fetch complete (71121 records). [2025-10-02T19:52:17.569579] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-02T19:52:17.880322] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-02T19:52:18.025663] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-02T19:52:18.025838] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-02T19:52:18.026830] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-02T19:52:18.026900] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-02T19:52:18.028795] [DEBUG] [LOCAL ] KRG: Trimmed 71121 records to 49512 (keeping 200 days of data) [2025-10-02T19:52:18.350097] [DEBUG] [LOCAL ] KRG: Primary data saved (49512 records). [2025-10-02T19:52:18.350329] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-02T19:52:18.352023] [INFO ] [MAIN ] Update Progress: 1221/2370 symbols completed. KRG took 30.2s. Estimated remaining: 2h 42m 5s. Rate: 7.1 symbols/min [2025-10-02T19:52:18.545232] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:52:18.594357] [DEBUG] [LOCAL ] KT: Loaded 45686 existing records from primary storage. [2025-10-02T19:52:18.594707] [INFO ] [MAIN ] KT: Loaded 45686 existing records. [2025-10-02T19:52:18.678060] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-02T19:52:18.794233] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:52:18.794545] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-02T19:52:18.794629] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-02T19:52:18.798890] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-02T19:52:18.798957] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-02T19:52:19.186554] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-10-02T19:52:19.238482] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:52:19.346711] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-02T19:52:19.472993] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-02T19:52:19.615729] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-02T19:52:20.272995] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-02T19:52:20.961300] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-02T19:52:21.073013] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-02T19:52:21.705198] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-02T19:52:21.872998] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-02T19:52:22.433027] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-02T19:52:22.672999] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-10-02T19:52:23.473013] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-02T19:52:23.876447] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-02T19:52:24.181243] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-10-02T19:52:24.262614] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-02T19:52:24.264213] [INFO ] [REMOTE ] KRP: Full fetch complete (54946 records). [2025-10-02T19:52:24.264317] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-02T19:52:24.278183] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-02T19:52:24.682940] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-02T19:52:24.683039] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-02T19:52:24.683968] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-02T19:52:24.684040] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-02T19:52:24.685371] [DEBUG] [LOCAL ] KRP: Trimmed 54946 records to 37273 (keeping 200 days of data) [2025-10-02T19:52:24.921575] [DEBUG] [LOCAL ] KRP: Primary data saved (37273 records). [2025-10-02T19:52:24.921763] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-02T19:52:24.921892] [INFO ] [MAIN ] Update Progress: 1222/2370 symbols completed. KRP took 34.6s. Estimated remaining: 2h 41m 55s. Rate: 7.1 symbols/min [2025-10-02T19:52:25.079189] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-02T19:52:25.108351] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:52:25.149951] [DEBUG] [LOCAL ] KTB: Loaded 41046 existing records from primary storage. [2025-10-02T19:52:25.150290] [INFO ] [MAIN ] KTB: Loaded 41046 existing records. [2025-10-02T19:52:25.340767] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:52:25.341034] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-02T19:52:25.341094] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-02T19:52:25.342283] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-02T19:52:25.342348] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-02T19:52:25.746152] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:52:25.775248] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-02T19:52:25.872994] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-02T19:52:26.673024] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-10-02T19:52:26.827733] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-02T19:52:27.129787] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-02T19:52:27.473064] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-02T19:52:27.627526] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-10-02T19:52:28.272992] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-02T19:52:28.650123] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-02T19:52:29.073058] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-02T19:52:29.838275] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-02T19:52:29.873009] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-02T19:52:30.672978] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-02T19:52:31.004133] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T19:52:31.472975] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-02T19:52:31.600221] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-02T19:52:31.638030] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-02T19:52:32.273012] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-02T19:52:33.078179] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-02T19:52:33.099105] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-02T19:52:33.609337] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-02T19:52:33.873016] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-02T19:52:33.954677] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-02T19:52:33.957394] [INFO ] [REMOTE ] KRO: Full fetch complete (34963 records). [2025-10-02T19:52:33.957531] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-02T19:52:34.373211] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-02T19:52:34.373291] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-02T19:52:34.374073] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-02T19:52:34.374167] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-02T19:52:34.375412] [DEBUG] [LOCAL ] KRO: Trimmed 34963 records to 26251 (keeping 200 days of data) [2025-10-02T19:52:34.556768] [DEBUG] [LOCAL ] KRO: Primary data saved (26251 records). [2025-10-02T19:52:34.556995] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-02T19:52:34.557153] [INFO ] [MAIN ] Update Progress: 1223/2370 symbols completed. KRO took 45.3s. Estimated remaining: 2h 41m 48s. Rate: 7.1 symbols/min [2025-10-02T19:52:34.678115] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-02T19:52:34.744398] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:52:34.760570] [DEBUG] [LOCAL ] KTF: Loaded 12567 existing records from primary storage. [2025-10-02T19:52:34.760884] [INFO ] [MAIN ] KTF: Loaded 12567 existing records. [2025-10-02T19:52:34.950799] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:52:34.951016] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-02T19:52:34.951076] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-02T19:52:34.951992] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-02T19:52:34.952064] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-02T19:52:35.371722] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:52:35.473030] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-10-02T19:52:36.171504] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-10-02T19:52:36.219487] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T19:52:36.273016] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-02T19:52:36.447922] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-10-02T19:52:37.073019] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-02T19:52:37.823062] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-02T19:52:37.872999] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-02T19:52:38.331788] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-02T19:52:38.673024] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-02T19:52:39.438182] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-02T19:52:39.472959] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-02T19:52:40.272995] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-02T19:52:40.599104] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-10-02T19:52:41.000885] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-02T19:52:41.054992] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-02T19:52:41.072968] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-02T19:52:41.873027] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-02T19:52:42.018184] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T19:52:42.673032] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-02T19:52:43.118523] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-02T19:52:43.473023] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-02T19:52:43.578811] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-02T19:52:44.273039] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-02T19:52:45.011303] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T19:52:45.073064] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-02T19:52:45.270175] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-02T19:52:45.272378] [INFO ] [REMOTE ] KSS: Full fetch complete (77634 records). [2025-10-02T19:52:45.272517] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-02T19:52:45.704999] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-02T19:52:45.705098] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-02T19:52:45.706508] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-02T19:52:45.706590] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-02T19:52:45.708747] [DEBUG] [LOCAL ] KSS: Trimmed 77634 records to 53992 (keeping 200 days of data) [2025-10-02T19:52:45.900804] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-02T19:52:45.973587] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-02T19:52:46.076804] [DEBUG] [LOCAL ] KSS: Primary data saved (53992 records). [2025-10-02T19:52:46.076949] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-02T19:52:46.077084] [INFO ] [MAIN ] Update Progress: 1224/2370 symbols completed. KSS took 35.0s. Estimated remaining: 2h 41m 42s. Rate: 7.1 symbols/min [2025-10-02T19:52:46.261860] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:52:46.262050] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-10-02T19:52:46.262089] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-10-02T19:52:46.262204] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-10-02T19:52:46.262248] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-02T19:52:46.262291] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-02T19:52:46.262339] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-10-02T19:52:46.642621] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:52:46.673006] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-10-02T19:52:47.021353] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-10-02T19:52:47.399033] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-02T19:52:47.473018] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-02T19:52:48.272994] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-10-02T19:52:48.914430] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T19:52:49.073019] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-02T19:52:49.179074] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-02T19:52:49.873001] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-02T19:52:50.549321] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-02T19:52:50.673014] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-02T19:52:51.311379] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-02T19:52:51.473050] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-02T19:52:52.215850] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-02T19:52:52.272979] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-02T19:52:52.352483] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-02T19:52:53.073011] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-10-02T19:52:53.533492] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T19:52:53.715762] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-02T19:52:53.872992] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-02T19:52:54.667011] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-02T19:52:54.672953] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-02T19:52:55.338621] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T19:52:55.473012] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-10-02T19:52:56.273013] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-02T19:52:56.318829] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-02T19:52:57.073053] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-02T19:52:57.873033] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-10-02T19:52:58.046579] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T19:52:58.353362] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-02T19:52:58.459275] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-02T19:52:58.672989] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-02T19:52:59.473054] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-02T19:52:59.979497] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-02T19:52:59.981496] [INFO ] [REMOTE ] KT: Full fetch complete (66696 records). [2025-10-02T19:52:59.981618] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-02T19:53:00.269904] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-02T19:53:00.281334] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-02T19:53:00.299882] [INFO ] [REMOTE ] KTF: Full fetch complete (17825 records). [2025-10-02T19:53:00.312907] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-02T19:53:00.590296] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-02T19:53:00.617139] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-02T19:53:00.644407] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-02T19:53:00.655258] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-02T19:53:00.781483] [DEBUG] [LOCAL ] KT: Trimmed 66696 records to 46056 (keeping 200 days of data) [2025-10-02T19:53:00.930493] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-02T19:53:00.930932] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-02T19:53:00.931358] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-02T19:53:00.931441] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-02T19:53:00.960811] [DEBUG] [LOCAL ] KTF: Trimmed 17825 records to 12632 (keeping 200 days of data) [2025-10-02T19:53:01.069563] [DEBUG] [LOCAL ] KTF: Primary data saved (12632 records). [2025-10-02T19:53:01.070249] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-02T19:53:01.070716] [INFO ] [MAIN ] Update Progress: 1225/2370 symbols completed. KTF took 26.5s. Estimated remaining: 2h 41m 40s. Rate: 7.1 symbols/min [2025-10-02T19:53:01.076919] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-10-02T19:53:01.364477] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:01.457339] [DEBUG] [LOCAL ] KT: Primary data saved (46056 records). [2025-10-02T19:53:01.458374] [INFO ] [MAIN ] KT: Full history saved. [2025-10-02T19:53:01.461342] [INFO ] [MAIN ] Update Progress: 1226/2370 symbols completed. KT took 43.1s. Estimated remaining: 2h 41m 24s. Rate: 7.1 symbols/min [2025-10-02T19:53:01.570245] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-02T19:53:01.595782] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-02T19:53:01.672532] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-02T19:53:01.792280] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:01.851732] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-02T19:53:01.876031] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-10-02T19:53:01.894875] [INFO ] [REMOTE ] KTB: Full fetch complete (57901 records). [2025-10-02T19:53:01.902234] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-02T19:53:01.951423] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:01.984949] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-02T19:53:02.010568] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-02T19:53:02.072550] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-02T19:53:02.077522] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-02T19:53:02.205679] [DEBUG] [LOCAL ] KVYO: Loaded 50071 existing records from primary storage. [2025-10-02T19:53:02.258956] [INFO ] [MAIN ] KVYO: Loaded 50071 existing records. [2025-10-02T19:53:02.519500] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-02T19:53:02.689949] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-10-02T19:53:02.816459] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:02.858943] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-02T19:53:02.874444] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-02T19:53:02.961690] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-02T19:53:02.990867] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-02T19:53:03.043821] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-02T19:53:03.077880] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-02T19:53:03.110147] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:03.144924] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-02T19:53:03.151616] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-02T19:53:03.208218] [DEBUG] [LOCAL ] KTB: Trimmed 57901 records to 41321 (keeping 200 days of data) [2025-10-02T19:53:03.445949] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-02T19:53:03.476065] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-10-02T19:53:03.586114] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:03.760552] [DEBUG] [LOCAL ] KTB: Primary data saved (41321 records). [2025-10-02T19:53:03.760720] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-02T19:53:03.760895] [INFO ] [MAIN ] Update Progress: 1227/2370 symbols completed. KTB took 38.8s. Estimated remaining: 2h 41m 9s. Rate: 7.1 symbols/min [2025-10-02T19:53:03.945273] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:03.950367] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-02T19:53:03.992327] [DEBUG] [LOCAL ] KW: Loaded 40529 existing records from primary storage. [2025-10-02T19:53:03.992637] [INFO ] [MAIN ] KW: Loaded 40529 existing records. [2025-10-02T19:53:04.178735] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:04.179329] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-02T19:53:04.179386] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-02T19:53:04.180625] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-02T19:53:04.180750] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-02T19:53:04.278380] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-10-02T19:53:04.570166] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:05.073010] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-10-02T19:53:05.872986] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-10-02T19:53:06.008843] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-10-02T19:53:06.657850] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-10-02T19:53:06.672946] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-02T19:53:07.121569] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-10-02T19:53:07.473054] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-02T19:53:08.273040] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-02T19:53:08.495788] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-02T19:53:08.915715] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:53:09.073017] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-10-02T19:53:09.533933] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T19:53:09.872998] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-02T19:53:09.916920] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-02T19:53:10.673049] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-02T19:53:11.397156] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:53:11.473008] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-10. [2025-10-02T19:53:12.044528] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-02T19:53:12.272996] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-02T19:53:12.314215] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-02T19:53:12.315237] [INFO ] [REMOTE ] KUKE: Full fetch complete (8508 records). [2025-10-02T19:53:12.315341] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-10-02T19:53:12.511198] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-02T19:53:12.511437] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-10-02T19:53:12.511507] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-10-02T19:53:12.511580] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-10-02T19:53:12.511665] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-10-02T19:53:12.511723] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-10-02T19:53:12.511785] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-10-02T19:53:12.511866] [INFO ] [MAIN ] Update Progress: 1228/2370 symbols completed. KUKE took 26.4s. Estimated remaining: 2h 41m 1s. Rate: 7.1 symbols/min [2025-10-02T19:53:12.703397] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:12.723246] [DEBUG] [LOCAL ] KWR: Loaded 16535 existing records from primary storage. [2025-10-02T19:53:12.723585] [INFO ] [MAIN ] KWR: Loaded 16535 existing records. [2025-10-02T19:53:12.930192] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:12.930482] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-02T19:53:12.930556] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-02T19:53:12.931360] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-02T19:53:12.931424] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-02T19:53:13.078214] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-02T19:53:13.351613] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:13.872984] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-02T19:53:14.063089] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T19:53:14.566330] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-02T19:53:14.673049] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-02T19:53:15.429697] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-02T19:53:15.472969] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-02T19:53:16.191102] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-02T19:53:16.273005] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-02T19:53:17.072999] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-02T19:53:17.127530] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-02T19:53:17.634884] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-02T19:53:17.873009] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-02T19:53:18.515249] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-02T19:53:18.673015] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-02T19:53:19.402079] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-02T19:53:19.473066] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-02T19:53:20.181774] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T19:53:20.273027] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-02T19:53:21.072999] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-10-02T19:53:21.331841] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T19:53:21.694511] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-02T19:53:21.873002] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-02T19:53:22.219536] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-10-02T19:53:22.673003] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-02T19:53:23.478028] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-02T19:53:23.483233] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-02T19:53:24.124853] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-02T19:53:24.272996] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-02T19:53:24.563765] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-02T19:53:25.072992] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-02T19:53:25.584976] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-02T19:53:25.697357] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-02T19:53:25.872972] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-02T19:53:26.673002] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-02T19:53:26.936141] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-02T19:53:27.473042] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-02T19:53:28.272997] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-02T19:53:28.476377] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-02T19:53:28.893946] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-02T19:53:29.073005] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-02T19:53:29.679463] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-02T19:53:29.873036] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-02T19:53:30.577362] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T19:53:30.673062] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-02T19:53:30.918850] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-02T19:53:30.921142] [INFO ] [REMOTE ] KW: Full fetch complete (57126 records). [2025-10-02T19:53:30.921241] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-02T19:53:31.327151] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-02T19:53:31.327254] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-02T19:53:31.328210] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-02T19:53:31.328283] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-02T19:53:31.329623] [DEBUG] [LOCAL ] KW: Trimmed 57126 records to 40831 (keeping 200 days of data) [2025-10-02T19:53:31.506814] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-02T19:53:31.586751] [DEBUG] [LOCAL ] KW: Primary data saved (40831 records). [2025-10-02T19:53:31.586967] [INFO ] [MAIN ] KW: Full history saved. [2025-10-02T19:53:31.587083] [INFO ] [MAIN ] Update Progress: 1229/2370 symbols completed. KW took 27.8s. Estimated remaining: 2h 41m 3s. Rate: 7.1 symbols/min [2025-10-02T19:53:31.772857] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:31.786601] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T19:53:31.821472] [DEBUG] [LOCAL ] KYN: Loaded 30010 existing records from primary storage. [2025-10-02T19:53:31.821767] [INFO ] [MAIN ] KYN: Loaded 30010 existing records. [2025-10-02T19:53:32.013696] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:32.013951] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-02T19:53:32.014000] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-02T19:53:32.014797] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-02T19:53:32.014856] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-02T19:53:32.278127] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-02T19:53:32.389285] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:33.073050] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-10-02T19:53:33.121065] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-02T19:53:33.261323] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-02T19:53:33.873004] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-02T19:53:34.440297] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-10-02T19:53:34.672991] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-02T19:53:34.803270] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-02T19:53:35.473025] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-02T19:53:36.273054] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-02T19:53:36.759223] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-02T19:53:36.813228] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-02T19:53:37.073004] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-02T19:53:37.835279] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-02T19:53:37.872965] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-02T19:53:38.239737] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-02T19:53:38.673005] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-02T19:53:39.473010] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-02T19:53:39.617287] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-02T19:53:40.118817] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-02T19:53:40.272999] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-02T19:53:40.379638] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-02T19:53:40.381829] [INFO ] [REMOTE ] KVUE: Full fetch complete (77673 records). [2025-10-02T19:53:40.381933] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-02T19:53:40.845846] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-02T19:53:40.845932] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-02T19:53:40.847014] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-02T19:53:40.847101] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-02T19:53:40.849226] [DEBUG] [LOCAL ] KVUE: Trimmed 77673 records to 54057 (keeping 200 days of data) [2025-10-02T19:53:41.075300] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-02T19:53:41.201290] [DEBUG] [LOCAL ] KVUE: Primary data saved (54057 records). [2025-10-02T19:53:41.201478] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-02T19:53:41.201579] [INFO ] [MAIN ] Update Progress: 1230/2370 symbols completed. KVUE took 40.1s. Estimated remaining: 2h 40m 55s. Rate: 7.1 symbols/min [2025-10-02T19:53:41.387099] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:41.426820] [DEBUG] [LOCAL ] L: Loaded 40991 existing records from primary storage. [2025-10-02T19:53:41.427137] [INFO ] [MAIN ] L: Loaded 40991 existing records. [2025-10-02T19:53:41.640589] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:41.640944] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-02T19:53:41.641011] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-02T19:53:41.642155] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-02T19:53:41.642220] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-02T19:53:41.752698] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-02T19:53:41.791190] [INFO ] [REMOTE ] KVYO: Full fetch complete (71669 records). [2025-10-02T19:53:41.796633] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-02T19:53:41.874736] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-02T19:53:42.096352] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-02T19:53:42.411878] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:42.540122] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-02T19:53:42.540211] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-02T19:53:42.541207] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-02T19:53:42.541276] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-02T19:53:42.542922] [DEBUG] [LOCAL ] KVYO: Trimmed 71669 records to 50458 (keeping 200 days of data) [2025-10-02T19:53:42.673007] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-02T19:53:42.864887] [DEBUG] [LOCAL ] KVYO: Primary data saved (50458 records). [2025-10-02T19:53:42.865036] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-02T19:53:42.865135] [INFO ] [MAIN ] Update Progress: 1231/2370 symbols completed. KVYO took 41.4s. Estimated remaining: 2h 40m 40s. Rate: 7.1 symbols/min [2025-10-02T19:53:43.056348] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:43.110565] [DEBUG] [LOCAL ] LAC: Loaded 52362 existing records from primary storage. [2025-10-02T19:53:43.110933] [INFO ] [MAIN ] LAC: Loaded 52362 existing records. [2025-10-02T19:53:43.312589] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:43.327561] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-02T19:53:43.327683] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-02T19:53:43.335735] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-02T19:53:43.338797] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-02T19:53:43.413188] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-02T19:53:43.478109] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-02T19:53:43.674353] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-02T19:53:43.758266] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:44.273030] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-02T19:53:44.854281] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-02T19:53:44.855313] [INFO ] [REMOTE ] KWR: Full fetch complete (23974 records). [2025-10-02T19:53:44.855386] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-02T19:53:45.034142] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T19:53:45.077507] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-10-02T19:53:45.288180] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-02T19:53:45.288295] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-02T19:53:45.288818] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-02T19:53:45.288881] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-02T19:53:45.289835] [DEBUG] [LOCAL ] KWR: Trimmed 23974 records to 16654 (keeping 200 days of data) [2025-10-02T19:53:45.397633] [DEBUG] [LOCAL ] KWR: Primary data saved (16654 records). [2025-10-02T19:53:45.397831] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-02T19:53:45.397920] [INFO ] [MAIN ] Update Progress: 1232/2370 symbols completed. KWR took 32.9s. Estimated remaining: 2h 40m 26s. Rate: 7.1 symbols/min [2025-10-02T19:53:45.575168] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:53:45.598842] [DEBUG] [LOCAL ] LAD: Loaded 23471 existing records from primary storage. [2025-10-02T19:53:45.599122] [INFO ] [MAIN ] LAD: Loaded 23471 existing records. [2025-10-02T19:53:45.784288] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:53:45.784512] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-02T19:53:45.784560] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-02T19:53:45.785274] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-02T19:53:45.785335] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-02T19:53:45.878156] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-10-02T19:53:46.169158] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:53:46.608986] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-10-02T19:53:46.673000] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-02T19:53:47.473089] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-10-02T19:53:47.519154] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T19:53:47.917555] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-02T19:53:48.272991] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-02T19:53:48.646010] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-10-02T19:53:49.073020] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-02T19:53:49.103316] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-02T19:53:49.872975] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-02T19:53:50.285820] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-02T19:53:50.673009] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-02T19:53:51.179465] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-02T19:53:51.473035] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-02T19:53:51.770333] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:53:52.273003] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-02T19:53:53.072971] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-02T19:53:53.456104] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-02T19:53:53.529759] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-02T19:53:53.873044] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-02T19:53:54.213475] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-02T19:53:54.672980] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-02T19:53:54.844489] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-02T19:53:55.473013] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-02T19:53:55.965018] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-02T19:53:56.272995] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-02T19:53:56.873599] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-02T19:53:57.073000] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-02T19:53:57.603488] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-02T19:53:57.873021] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-02T19:53:58.673019] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-02T19:53:59.301079] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-02T19:53:59.370731] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-02T19:53:59.470300] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-02T19:53:59.477062] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-02T19:54:00.273027] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-02T19:54:01.073021] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-02T19:54:01.366971] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-02T19:54:01.873012] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-02T19:54:02.057234] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-02T19:54:02.059022] [INFO ] [REMOTE ] KYN: Full fetch complete (44571 records). [2025-10-02T19:54:02.059194] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-02T19:54:02.489870] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-02T19:54:02.489958] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-02T19:54:02.490704] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-02T19:54:02.490771] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-02T19:54:02.491969] [DEBUG] [LOCAL ] KYN: Trimmed 44571 records to 30181 (keeping 200 days of data) [2025-10-02T19:54:02.673170] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-02T19:54:02.691996] [DEBUG] [LOCAL ] KYN: Primary data saved (30181 records). [2025-10-02T19:54:02.692150] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-02T19:54:02.692252] [INFO ] [MAIN ] Update Progress: 1233/2370 symbols completed. KYN took 31.1s. Estimated remaining: 2h 40m 26s. Rate: 7.1 symbols/min [2025-10-02T19:54:02.876876] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:02.916719] [DEBUG] [LOCAL ] LADR: Loaded 38885 existing records from primary storage. [2025-10-02T19:54:02.917076] [INFO ] [MAIN ] LADR: Loaded 38885 existing records. [2025-10-02T19:54:03.107737] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:03.107951] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-02T19:54:03.108002] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-02T19:54:03.108971] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-02T19:54:03.109067] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-02T19:54:03.499215] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:03.499925] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-10-02T19:54:03.670076] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-02T19:54:03.801873] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T19:54:04.273037] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-02T19:54:04.922189] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T19:54:05.073000] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-02T19:54:05.376574] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-02T19:54:05.498769] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (5.23 seconds). [2025-10-02T19:54:05.873048] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-02T19:54:06.384883] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-02T19:54:06.673020] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-02T19:54:07.058150] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-02T19:54:07.473054] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-02T19:54:08.272973] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-02T19:54:08.700518] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T19:54:08.733471] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-02T19:54:09.072978] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-02T19:54:09.364286] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-02T19:54:09.873006] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-02T19:54:10.221937] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-02T19:54:10.673013] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-02T19:54:11.473002] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-02T19:54:11.741337] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-02T19:54:12.273012] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-02T19:54:12.336104] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-02T19:54:12.986793] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-02T19:54:13.073002] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-02T19:54:13.134930] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-02T19:54:13.136351] [INFO ] [REMOTE ] LAD: Full fetch complete (35439 records). [2025-10-02T19:54:13.136429] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-02T19:54:13.549408] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-02T19:54:13.549497] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-02T19:54:13.550236] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-02T19:54:13.550300] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-02T19:54:13.551286] [DEBUG] [LOCAL ] LAD: Trimmed 35439 records to 23644 (keeping 200 days of data) [2025-10-02T19:54:13.704320] [DEBUG] [LOCAL ] LAD: Primary data saved (23644 records). [2025-10-02T19:54:13.704461] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-02T19:54:13.704549] [INFO ] [MAIN ] Update Progress: 1234/2370 symbols completed. LAD took 28.3s. Estimated remaining: 2h 40m 20s. Rate: 7.1 symbols/min [2025-10-02T19:54:13.888942] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-02T19:54:13.893700] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:13.899683] [DEBUG] [LOCAL ] LANV: Loaded 2826 existing records from primary storage. [2025-10-02T19:54:13.900082] [INFO ] [MAIN ] LANV: Loaded 2826 existing records. [2025-10-02T19:54:14.114610] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:14.114874] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-02T19:54:14.114923] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-02T19:54:14.115217] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-02T19:54:14.115277] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-02T19:54:14.517991] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:14.615553] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:54:14.673026] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-10-02T19:54:15.279992] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-02T19:54:15.280237] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-10-02T19:54:15.473006] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-02T19:54:16.273010] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-02T19:54:17.065423] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T19:54:17.075087] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-02T19:54:17.437735] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-02T19:54:17.741068] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-02T19:54:17.873007] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-02T19:54:18.330205] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-02T19:54:18.673013] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-02T19:54:19.118710] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-02T19:54:19.473005] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-02T19:54:19.946056] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-02T19:54:20.273008] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-02T19:54:20.684141] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-02T19:54:21.073001] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-02T19:54:21.872993] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-02T19:54:22.650539] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-02T19:54:22.672959] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-02T19:54:23.207589] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-02T19:54:23.473000] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-02T19:54:23.778863] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-02T19:54:24.273013] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-02T19:54:24.736906] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-02T19:54:24.911262] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-02T19:54:25.073042] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-02T19:54:25.873006] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-02T19:54:26.428011] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-02T19:54:26.673016] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-02T19:54:27.018939] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-02T19:54:27.021457] [INFO ] [REMOTE ] LAC: Full fetch complete (75986 records). [2025-10-02T19:54:27.021591] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-02T19:54:27.457382] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-02T19:54:27.461347] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-02T19:54:27.461426] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-02T19:54:27.464912] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-02T19:54:27.465000] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-02T19:54:27.466449] [DEBUG] [LOCAL ] LAC: Trimmed 75986 records to 52752 (keeping 200 days of data) [2025-10-02T19:54:27.472988] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-02T19:54:27.796416] [DEBUG] [LOCAL ] LAC: Primary data saved (52752 records). [2025-10-02T19:54:27.796572] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-02T19:54:27.796680] [INFO ] [MAIN ] Update Progress: 1235/2370 symbols completed. LAC took 44.9s. Estimated remaining: 2h 40m 17s. Rate: 7.1 symbols/min [2025-10-02T19:54:27.985368] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:27.988008] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-02T19:54:27.988260] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-02T19:54:27.988382] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-02T19:54:27.989294] [INFO ] [REMOTE ] LANV: Full fetch complete (4452 records). [2025-10-02T19:54:27.989473] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-02T19:54:27.989601] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-02T19:54:27.989712] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-02T19:54:28.059149] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-02T19:54:28.071347] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-02T19:54:28.273851] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-02T19:54:28.829631] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-02T19:54:28.837533] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-02T19:54:28.841290] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-02T19:54:28.841760] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-02T19:54:28.858094] [DEBUG] [LOCAL ] LANV: Trimmed 4452 records to 2845 (keeping 200 days of data) [2025-10-02T19:54:28.865840] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:28.883597] [DEBUG] [LOCAL ] LANV: Primary data saved (2845 records). [2025-10-02T19:54:28.883769] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-02T19:54:28.883868] [INFO ] [MAIN ] Update Progress: 1236/2370 symbols completed. LANV took 15.2s. Estimated remaining: 2h 40m 1s. Rate: 7.1 symbols/min [2025-10-02T19:54:29.073144] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:29.073257] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-10-02T19:54:29.089281] [DEBUG] [LOCAL ] LAW: Loaded 14021 existing records from primary storage. [2025-10-02T19:54:29.089519] [INFO ] [MAIN ] LAW: Loaded 14021 existing records. [2025-10-02T19:54:29.285405] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-02T19:54:29.285222] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:29.285889] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-02T19:54:29.286015] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-10-02T19:54:29.286230] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-02T19:54:29.286141] [FATAL] [REMOTE ] LAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:54:29.286430] [FATAL] [MAIN ] LAR: Failed to fetch primary data. [2025-10-02T19:54:29.286505] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:54:29.286560] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-02T19:54:29.286623] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-02T19:54:29.286701] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-02T19:54:29.286818] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-02T19:54:29.286777] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-02T19:54:29.287017] [INFO ] [MAIN ] Update Progress: 1237/2370 symbols completed. LAR took 1.5s. Estimated remaining: 2h 39m 46s. Rate: 7.1 symbols/min [2025-10-02T19:54:29.287105] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-02T19:54:29.693426] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:29.872990] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-02T19:54:29.934850] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-02T19:54:30.673027] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-10-02T19:54:31.250071] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-02T19:54:31.473060] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-02T19:54:31.593232] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-10-02T19:54:32.273028] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-02T19:54:32.978771] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-02T19:54:33.073056] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-02T19:54:33.456899] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T19:54:33.458915] [INFO ] [REMOTE ] L: Full fetch complete (59496 records). [2025-10-02T19:54:33.459016] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-02T19:54:33.878172] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-02T19:54:33.879018] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-02T19:54:33.880024] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-02T19:54:33.881085] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-02T19:54:33.881295] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-02T19:54:33.882931] [DEBUG] [LOCAL ] L: Trimmed 59496 records to 41305 (keeping 200 days of data) [2025-10-02T19:54:34.159711] [DEBUG] [LOCAL ] L: Primary data saved (41305 records). [2025-10-02T19:54:34.159840] [INFO ] [MAIN ] L: Full history saved. [2025-10-02T19:54:34.159922] [INFO ] [MAIN ] Update Progress: 1238/2370 symbols completed. L took 53.0s. Estimated remaining: 2h 39m 34s. Rate: 7.1 symbols/min [2025-10-02T19:54:34.226686] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-02T19:54:34.445406] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-02T19:54:34.673026] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-02T19:54:35.473034] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-02T19:54:35.663886] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-02T19:54:36.273044] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-02T19:54:36.896566] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-02T19:54:36.948230] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-02T19:54:37.073001] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-02T19:54:37.873009] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-02T19:54:37.922671] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-02T19:54:38.673021] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-02T19:54:39.145971] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-02T19:54:39.148276] [INFO ] [REMOTE ] LADR: Full fetch complete (55479 records). [2025-10-02T19:54:39.148465] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-02T19:54:39.572361] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-02T19:54:39.581863] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-02T19:54:39.583344] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-02T19:54:39.583840] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-02T19:54:39.583757] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-02T19:54:39.588826] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-02T19:54:39.590371] [DEBUG] [LOCAL ] LADR: Trimmed 55479 records to 39182 (keeping 200 days of data) [2025-10-02T19:54:39.839014] [DEBUG] [LOCAL ] LADR: Primary data saved (39182 records). [2025-10-02T19:54:39.839161] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-02T19:54:39.839244] [INFO ] [MAIN ] Update Progress: 1239/2370 symbols completed. LADR took 37.1s. Estimated remaining: 2h 39m 23s. Rate: 7.1 symbols/min [2025-10-02T19:54:40.740083] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-02T19:54:40.744198] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-02T19:54:41.711437] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-02T19:54:41.715487] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-02T19:54:42.641393] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-02T19:54:42.647679] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-02T19:54:43.607504] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T19:54:43.612045] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-02T19:54:44.271379] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-02T19:54:44.272557] [INFO ] [REMOTE ] LAW: Full fetch complete (20562 records). [2025-10-02T19:54:44.272679] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-02T19:54:44.697177] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-02T19:54:44.697259] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-02T19:54:44.697758] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-02T19:54:44.697822] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-02T19:54:44.698467] [DEBUG] [LOCAL ] LAW: Trimmed 20562 records to 14185 (keeping 200 days of data) [2025-10-02T19:54:44.783589] [DEBUG] [LOCAL ] LAW: Primary data saved (14185 records). [2025-10-02T19:54:44.783757] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-02T19:54:44.783849] [INFO ] [MAIN ] Update Progress: 1240/2370 symbols completed. LAW took 15.9s. Estimated remaining: 2h 39m 11s. Rate: 7.1 symbols/min [2025-10-02T19:54:45.542756] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:45.561298] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:45.481703] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:45.590407] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:54:45.644102] [DEBUG] [LOCAL ] LB: Loaded 37751 existing records from primary storage. [2025-10-02T19:54:45.644632] [INFO ] [MAIN ] LB: Loaded 37751 existing records. [2025-10-02T19:54:45.817264] [DEBUG] [LOCAL ] LC: Loaded 47835 existing records from primary storage. [2025-10-02T19:54:45.831068] [INFO ] [MAIN ] LC: Loaded 47835 existing records. [2025-10-02T19:54:45.833584] [DEBUG] [LOCAL ] LAZ: Loaded 44922 existing records from primary storage. [2025-10-02T19:54:45.832529] [DEBUG] [LOCAL ] LBRT: Loaded 52912 existing records from primary storage. [2025-10-02T19:54:45.844492] [INFO ] [MAIN ] LBRT: Loaded 52912 existing records. [2025-10-02T19:54:45.871379] [INFO ] [MAIN ] LAZ: Loaded 44922 existing records. [2025-10-02T19:54:46.151595] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:46.245992] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-02T19:54:46.334803] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-02T19:54:46.408851] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-02T19:54:46.445979] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:46.465814] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-02T19:54:46.465734] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-02T19:54:46.466316] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-02T19:54:46.488349] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:46.537145] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-02T19:54:46.536958] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-02T19:54:46.569025] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-02T19:54:46.542434] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-02T19:54:46.617510] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-02T19:54:46.657190] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-02T19:54:46.747217] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:54:46.820519] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-02T19:54:46.913356] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-02T19:54:46.982023] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-02T19:54:47.067861] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-02T19:54:47.879911] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:47.917706] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-10-02T19:54:48.045835] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:48.054067] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-10-02T19:54:48.103627] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:48.158794] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-10-02T19:54:48.269232] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:54:48.269532] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-10-02T19:54:49.519622] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T19:54:49.529011] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-02T19:54:49.594897] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-10-02T19:54:49.604680] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-02T19:54:49.843631] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-10-02T19:54:49.854392] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-02T19:54:49.899530] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-10-02T19:54:49.909770] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-02T19:54:51.158383] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-02T19:54:51.167925] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-02T19:54:51.215957] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T19:54:51.226364] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-02T19:54:51.261154] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-02T19:54:51.393209] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-02T19:54:51.472984] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-02T19:54:52.273003] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-02T19:54:52.349513] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-02T19:54:52.660861] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-02T19:54:53.072995] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-02T19:54:53.134159] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-02T19:54:53.872986] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-02T19:54:54.153203] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-10-02T19:54:54.329624] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-02T19:54:54.673051] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-02T19:54:55.479893] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-02T19:54:55.486312] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-02T19:54:56.070353] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-02T19:54:56.273038] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-02T19:54:57.072988] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-02T19:54:57.264089] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-02T19:54:57.459980] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-02T19:54:57.873052] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-02T19:54:58.673002] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-02T19:54:58.975886] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-02T19:54:59.153065] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-02T19:54:59.473004] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-02T19:55:00.272986] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-02T19:55:00.375806] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-02T19:55:01.073076] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-02T19:55:01.403441] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-02T19:55:01.873018] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-02T19:55:01.910810] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T19:55:02.673016] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-02T19:55:02.886751] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-02T19:55:03.473004] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-02T19:55:03.517986] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-02T19:55:04.273088] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-02T19:55:04.418060] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-02T19:55:05.000221] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-02T19:55:05.073038] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-02T19:55:05.731635] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-02T19:55:05.873019] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-02T19:55:06.673020] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-02T19:55:07.031633] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-02T19:55:07.485618] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-02T19:55:07.515401] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T19:55:07.943326] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-02T19:55:08.272992] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-02T19:55:09.073002] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-02T19:55:09.405349] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-02T19:55:09.440285] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T19:55:09.873010] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-02T19:55:10.672986] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-02T19:55:10.708070] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-02T19:55:11.472980] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-02T19:55:11.716116] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-02T19:55:11.756295] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T19:55:12.273043] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-02T19:55:12.997083] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-02T19:55:13.073002] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-02T19:55:13.738545] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-02T19:55:13.872997] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-02T19:55:14.672999] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-02T19:55:14.754993] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-02T19:55:15.473131] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-02T19:55:15.473244] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-02T19:55:15.937546] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T19:55:15.939743] [INFO ] [REMOTE ] LBRT: Full fetch complete (76539 records). [2025-10-02T19:55:15.939856] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-02T19:55:16.278088] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-02T19:55:16.403320] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-02T19:55:16.403422] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-02T19:55:16.404497] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-02T19:55:16.404569] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-02T19:55:16.406246] [DEBUG] [LOCAL ] LBRT: Trimmed 76539 records to 53299 (keeping 200 days of data) [2025-10-02T19:55:16.777325] [DEBUG] [LOCAL ] LBRT: Primary data saved (53299 records). [2025-10-02T19:55:16.777528] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-02T19:55:16.777868] [INFO ] [MAIN ] Update Progress: 1241/2370 symbols completed. LBRT took 32.0s. Estimated remaining: 2h 39m 24s. Rate: 7.1 symbols/min [2025-10-02T19:55:16.978797] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:17.015493] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-02T19:55:17.052535] [DEBUG] [LOCAL ] LCII: Loaded 28050 existing records from primary storage. [2025-10-02T19:55:17.053039] [INFO ] [MAIN ] LCII: Loaded 28050 existing records. [2025-10-02T19:55:17.078128] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-02T19:55:17.251679] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:17.251911] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-02T19:55:17.251959] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-02T19:55:17.252742] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-02T19:55:17.252845] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-02T19:55:17.540926] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-02T19:55:17.587812] [INFO ] [REMOTE ] LB: Full fetch complete (55881 records). [2025-10-02T19:55:17.598526] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-02T19:55:17.710333] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:17.874561] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-02T19:55:18.106157] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-02T19:55:18.106283] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-02T19:55:18.107191] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-02T19:55:18.107260] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-02T19:55:18.109108] [DEBUG] [LOCAL ] LB: Trimmed 55881 records to 37995 (keeping 200 days of data) [2025-10-02T19:55:18.352885] [DEBUG] [LOCAL ] LB: Primary data saved (37995 records). [2025-10-02T19:55:18.353059] [INFO ] [MAIN ] LB: Full history saved. [2025-10-02T19:55:18.353156] [INFO ] [MAIN ] Update Progress: 1242/2370 symbols completed. LB took 33.6s. Estimated remaining: 2h 39m 9s. Rate: 7.1 symbols/min [2025-10-02T19:55:18.487737] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:55:18.536277] [INFO ] [REMOTE ] LC: Full fetch complete (70565 records). [2025-10-02T19:55:18.539289] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-02T19:55:18.561872] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:18.682334] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-10-02T19:55:18.942895] [DEBUG] [LOCAL ] LDI: Loaded 44137 existing records from primary storage. [2025-10-02T19:55:18.943270] [INFO ] [MAIN ] LDI: Loaded 44137 existing records. [2025-10-02T19:55:19.182128] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-02T19:55:19.182745] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-02T19:55:19.203059] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-02T19:55:19.233355] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-02T19:55:19.233275] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-02T19:55:19.286248] [DEBUG] [LOCAL ] LC: Trimmed 70565 records to 48187 (keeping 200 days of data) [2025-10-02T19:55:19.263927] [INFO ] [REMOTE ] LAZ: Full fetch complete (65835 records). [2025-10-02T19:55:19.290898] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:19.291817] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-02T19:55:19.292531] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-02T19:55:19.292633] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-02T19:55:19.294096] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-02T19:55:19.294198] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-02T19:55:20.083473] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-10-02T19:55:20.140170] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-02T19:55:20.188912] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:20.288024] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-10-02T19:55:20.431231] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-02T19:55:20.436492] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-02T19:55:20.446108] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-02T19:55:20.449101] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-02T19:55:20.485285] [DEBUG] [LOCAL ] LAZ: Trimmed 65835 records to 45182 (keeping 200 days of data) [2025-10-02T19:55:20.501686] [DEBUG] [LOCAL ] LC: Primary data saved (48187 records). [2025-10-02T19:55:20.501828] [INFO ] [MAIN ] LC: Full history saved. [2025-10-02T19:55:20.501940] [INFO ] [MAIN ] Update Progress: 1243/2370 symbols completed. LC took 35.7s. Estimated remaining: 2h 38m 55s. Rate: 7.1 symbols/min [2025-10-02T19:55:20.797086] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:21.024335] [DEBUG] [LOCAL ] LDOS: Loaded 45597 existing records from primary storage. [2025-10-02T19:55:21.026962] [DEBUG] [LOCAL ] LAZ: Primary data saved (45182 records). [2025-10-02T19:55:21.027584] [INFO ] [MAIN ] LDOS: Loaded 45597 existing records. [2025-10-02T19:55:21.027418] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-02T19:55:21.044673] [INFO ] [MAIN ] Update Progress: 1244/2370 symbols completed. LAZ took 36.2s. Estimated remaining: 2h 38m 40s. Rate: 7.1 symbols/min [2025-10-02T19:55:21.380607] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:21.447451] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:21.447979] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-02T19:55:21.448324] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-02T19:55:21.454668] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-02T19:55:21.462564] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-02T19:55:21.469012] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-02T19:55:21.534760] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-02T19:55:21.579289] [DEBUG] [LOCAL ] LDP: Loaded 12928 existing records from primary storage. [2025-10-02T19:55:21.596552] [INFO ] [MAIN ] LDP: Loaded 12928 existing records. [2025-10-02T19:55:22.012268] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:22.019922] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-02T19:55:22.020125] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-02T19:55:22.031122] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-02T19:55:22.074135] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-02T19:55:22.121049] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:22.160448] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-10-02T19:55:22.233636] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-10-02T19:55:22.554139] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:22.672978] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-10-02T19:55:22.753809] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-02T19:55:23.472984] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-02T19:55:23.581203] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-10-02T19:55:23.683565] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-10-02T19:55:24.273023] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-02T19:55:24.806879] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T19:55:25.073013] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-02T19:55:25.173972] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-02T19:55:25.873024] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-02T19:55:26.374776] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-02T19:55:26.673009] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-02T19:55:27.296167] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-02T19:55:27.473051] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-02T19:55:28.108713] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-02T19:55:28.273041] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-02T19:55:29.072540] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-02T19:55:29.079416] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-02T19:55:29.610629] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-02T19:55:29.872978] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-02T19:55:29.947221] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-02T19:55:30.673024] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-02T19:55:30.811940] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-02T19:55:31.473063] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-02T19:55:32.273035] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-02T19:55:32.328850] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-02T19:55:32.478373] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-02T19:55:33.073008] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-02T19:55:33.439481] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-02T19:55:33.873016] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-02T19:55:34.626402] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-02T19:55:34.673050] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-02T19:55:35.474001] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-02T19:55:35.476891] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-02T19:55:35.568075] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-02T19:55:36.273042] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-02T19:55:37.073009] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-02T19:55:37.089244] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-02T19:55:37.219692] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-02T19:55:37.873058] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-02T19:55:38.203201] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-02T19:55:38.615427] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-02T19:55:38.673047] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-02T19:55:39.473004] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-02T19:55:40.152131] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-02T19:55:40.272984] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-02T19:55:40.655426] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-02T19:55:40.846905] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T19:55:41.073022] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-02T19:55:41.767019] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-02T19:55:41.873036] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-02T19:55:42.673046] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-02T19:55:42.823929] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T19:55:43.473087] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-02T19:55:44.273039] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-02T19:55:44.408374] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-10-02T19:55:44.677799] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-02T19:55:45.073036] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-02T19:55:45.093559] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-02T19:55:45.873002] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-02T19:55:46.270692] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-02T19:55:46.572110] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-02T19:55:46.573169] [INFO ] [REMOTE ] LDP: Full fetch complete (19413 records). [2025-10-02T19:55:46.573244] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-02T19:55:46.678120] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-02T19:55:46.992347] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-02T19:55:46.992437] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-02T19:55:46.992970] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-02T19:55:46.993073] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-02T19:55:46.993865] [DEBUG] [LOCAL ] LDP: Trimmed 19413 records to 13028 (keeping 200 days of data) [2025-10-02T19:55:47.078513] [DEBUG] [LOCAL ] LDP: Primary data saved (13028 records). [2025-10-02T19:55:47.078684] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-02T19:55:47.078815] [INFO ] [MAIN ] Update Progress: 1245/2370 symbols completed. LDP took 26.0s. Estimated remaining: 2h 38m 47s. Rate: 7.1 symbols/min [2025-10-02T19:55:47.266583] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:47.315364] [DEBUG] [LOCAL ] LEA: Loaded 41746 existing records from primary storage. [2025-10-02T19:55:47.315747] [INFO ] [MAIN ] LEA: Loaded 41746 existing records. [2025-10-02T19:55:47.479020] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-02T19:55:47.517796] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:47.518127] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-02T19:55:47.518243] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-02T19:55:47.519275] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-02T19:55:47.519352] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-02T19:55:47.928950] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:47.939513] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-02T19:55:48.273011] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-10-02T19:55:49.073039] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-02T19:55:49.222330] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-02T19:55:49.888369] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-02T19:55:49.892156] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T19:55:49.945366] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-02T19:55:49.947803] [INFO ] [REMOTE ] LCII: Full fetch complete (39223 records). [2025-10-02T19:55:49.947925] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-02T19:55:50.480617] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-02T19:55:50.480734] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-02T19:55:50.481501] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-02T19:55:50.481552] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-02T19:55:50.482603] [DEBUG] [LOCAL ] LCII: Trimmed 39223 records to 28181 (keeping 200 days of data) [2025-10-02T19:55:50.676425] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-02T19:55:50.680384] [DEBUG] [LOCAL ] LCII: Primary data saved (28181 records). [2025-10-02T19:55:50.680552] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-02T19:55:50.680770] [INFO ] [MAIN ] Update Progress: 1246/2370 symbols completed. LCII took 33.9s. Estimated remaining: 2h 38m 34s. Rate: 7.1 symbols/min [2025-10-02T19:55:50.891013] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:50.939633] [DEBUG] [LOCAL ] LEG: Loaded 50265 existing records from primary storage. [2025-10-02T19:55:50.940031] [INFO ] [MAIN ] LEG: Loaded 50265 existing records. [2025-10-02T19:55:51.145462] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:51.145706] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-02T19:55:51.145766] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-02T19:55:51.146813] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-02T19:55:51.146874] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-02T19:55:51.473056] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-02T19:55:51.565948] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:51.609967] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-02T19:55:52.273043] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-10-02T19:55:52.390227] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T19:55:53.014956] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-02T19:55:53.073054] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-02T19:55:53.582806] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-10-02T19:55:53.873053] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-02T19:55:54.388599] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-02T19:55:54.673026] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-02T19:55:55.148083] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-02T19:55:55.150027] [INFO ] [REMOTE ] LDOS: Full fetch complete (67596 records). [2025-10-02T19:55:55.150136] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-02T19:55:55.481941] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-02T19:55:55.605478] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-02T19:55:55.605575] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-02T19:55:55.607230] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-02T19:55:55.607304] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-02T19:55:55.608924] [DEBUG] [LOCAL ] LDOS: Trimmed 67596 records to 45923 (keeping 200 days of data) [2025-10-02T19:55:55.915074] [DEBUG] [LOCAL ] LDOS: Primary data saved (45923 records). [2025-10-02T19:55:55.915387] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-02T19:55:55.915615] [INFO ] [MAIN ] Update Progress: 1247/2370 symbols completed. LDOS took 35.4s. Estimated remaining: 2h 38m 23s. Rate: 7.1 symbols/min [2025-10-02T19:55:56.110207] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:55:56.135701] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-02T19:55:56.196363] [DEBUG] [LOCAL ] LEN: Loaded 53177 existing records from primary storage. [2025-10-02T19:55:56.196797] [INFO ] [MAIN ] LEN: Loaded 53177 existing records. [2025-10-02T19:55:56.281901] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-02T19:55:56.398747] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:55:56.398959] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-02T19:55:56.399009] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-02T19:55:56.400273] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-02T19:55:56.400339] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-02T19:55:56.794083] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:55:57.073000] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-02T19:55:57.121475] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-02T19:55:57.579509] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-02T19:55:57.873017] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-02T19:55:58.673043] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-02T19:55:59.198675] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-10-02T19:55:59.283443] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-02T19:55:59.473039] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-02T19:56:00.229503] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T19:56:00.273006] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-02T19:56:01.073008] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-02T19:56:01.348353] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-02T19:56:01.873062] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-02T19:56:02.673030] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-10-02T19:56:03.071051] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-02T19:56:03.073201] [INFO ] [REMOTE ] LDI: Full fetch complete (60648 records). [2025-10-02T19:56:03.073509] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-02T19:56:03.516758] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-02T19:56:03.522193] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-02T19:56:03.536170] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-02T19:56:03.536364] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-02T19:56:03.539399] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (3.27 seconds). [2025-10-02T19:56:03.550275] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-02T19:56:03.549796] [DEBUG] [LOCAL ] LDI: Trimmed 60648 records to 44523 (keeping 200 days of data) [2025-10-02T19:56:03.697783] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-02T19:56:03.865822] [DEBUG] [LOCAL ] LDI: Primary data saved (44523 records). [2025-10-02T19:56:03.865959] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-02T19:56:03.866072] [INFO ] [MAIN ] Update Progress: 1248/2370 symbols completed. LDI took 45.5s. Estimated remaining: 2h 38m 14s. Rate: 7.1 symbols/min [2025-10-02T19:56:04.072738] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:04.092131] [DEBUG] [LOCAL ] LEO: Loaded 17282 existing records from primary storage. [2025-10-02T19:56:04.092531] [INFO ] [MAIN ] LEO: Loaded 17282 existing records. [2025-10-02T19:56:04.273773] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-02T19:56:04.300448] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:04.302257] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-02T19:56:04.302448] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-02T19:56:04.315678] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-02T19:56:04.325683] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-02T19:56:04.432501] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-10-02T19:56:04.770614] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:05.058733] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T19:56:05.072962] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-02T19:56:05.567752] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-02T19:56:05.872999] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-02T19:56:06.568976] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T19:56:06.673010] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-02T19:56:07.473052] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-10-02T19:56:07.807909] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-02T19:56:07.905546] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-02T19:56:08.070585] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-10-02T19:56:08.273006] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-02T19:56:09.073013] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-02T19:56:09.389712] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-02T19:56:09.873030] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-02T19:56:10.672980] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-02T19:56:10.787390] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-02T19:56:10.802975] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-02T19:56:11.473006] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-02T19:56:12.222485] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-02T19:56:12.272979] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-02T19:56:12.303936] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-02T19:56:13.073067] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-02T19:56:13.873017] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-02T19:56:14.061851] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-02T19:56:14.183498] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-02T19:56:14.673022] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-02T19:56:15.473011] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-02T19:56:15.569372] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-02T19:56:16.272971] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-02T19:56:16.630038] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T19:56:16.667903] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-02T19:56:16.827697] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-02T19:56:17.073009] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-02T19:56:17.872986] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-02T19:56:17.918002] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-02T19:56:18.672997] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-02T19:56:19.473044] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-02T19:56:19.809698] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-10-02T19:56:19.884973] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-02T19:56:19.887155] [INFO ] [REMOTE ] LEA: Full fetch complete (60923 records). [2025-10-02T19:56:19.887361] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-02T19:56:20.278315] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-02T19:56:20.348067] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-02T19:56:20.348174] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-02T19:56:20.349333] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-02T19:56:20.349405] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-02T19:56:20.350867] [DEBUG] [LOCAL ] LEA: Trimmed 60923 records to 42058 (keeping 200 days of data) [2025-10-02T19:56:20.637503] [DEBUG] [LOCAL ] LEA: Primary data saved (42058 records). [2025-10-02T19:56:20.637667] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-02T19:56:20.637793] [INFO ] [MAIN ] Update Progress: 1249/2370 symbols completed. LEA took 33.6s. Estimated remaining: 2h 38m 13s. Rate: 7.1 symbols/min [2025-10-02T19:56:20.839023] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:20.871314] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-02T19:56:20.932348] [DEBUG] [LOCAL ] LEVI: Loaded 51565 existing records from primary storage. [2025-10-02T19:56:20.932774] [INFO ] [MAIN ] LEVI: Loaded 51565 existing records. [2025-10-02T19:56:21.087918] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-02T19:56:21.141138] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:21.141500] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-02T19:56:21.141552] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-02T19:56:21.143060] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-02T19:56:21.143124] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-02T19:56:21.410958] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-02T19:56:21.594922] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:21.872953] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-02T19:56:22.673005] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-02T19:56:23.134440] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-02T19:56:23.287848] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-02T19:56:23.289981] [INFO ] [REMOTE ] LEG: Full fetch complete (73074 records). [2025-10-02T19:56:23.290144] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-02T19:56:23.477458] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-10-02T19:56:23.477380] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-02T19:56:23.757202] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-02T19:56:23.757288] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-02T19:56:23.758446] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-02T19:56:23.758517] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-02T19:56:23.760390] [DEBUG] [LOCAL ] LEG: Trimmed 73074 records to 50600 (keeping 200 days of data) [2025-10-02T19:56:24.084111] [DEBUG] [LOCAL ] LEG: Primary data saved (50600 records). [2025-10-02T19:56:24.084265] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-02T19:56:24.084354] [INFO ] [MAIN ] Update Progress: 1250/2370 symbols completed. LEG took 33.4s. Estimated remaining: 2h 37m 60s. Rate: 7.1 symbols/min [2025-10-02T19:56:24.278509] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-02T19:56:24.280941] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:24.303787] [DEBUG] [LOCAL ] LFT: Loaded 18303 existing records from primary storage. [2025-10-02T19:56:24.304076] [INFO ] [MAIN ] LFT: Loaded 18303 existing records. [2025-10-02T19:56:24.515413] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:24.515669] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-02T19:56:24.515734] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-02T19:56:24.516322] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-02T19:56:24.516383] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-02T19:56:24.918517] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:25.073050] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-10-02T19:56:25.282586] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-10-02T19:56:25.873045] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-02T19:56:26.138535] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-10-02T19:56:26.237790] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-10-02T19:56:26.672989] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-02T19:56:26.848622] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-02T19:56:27.475297] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-02T19:56:27.477166] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-02T19:56:28.078107] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-02T19:56:28.079249] [INFO ] [REMOTE ] LEO: Full fetch complete (26943 records). [2025-10-02T19:56:28.079321] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-02T19:56:28.284951] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-02T19:56:28.512685] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-02T19:56:28.512789] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-02T19:56:28.513455] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-02T19:56:28.513521] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-02T19:56:28.514306] [DEBUG] [LOCAL ] LEO: Trimmed 26943 records to 17395 (keeping 200 days of data) [2025-10-02T19:56:28.621511] [DEBUG] [LOCAL ] LEO: Primary data saved (17395 records). [2025-10-02T19:56:28.621763] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-02T19:56:28.621890] [INFO ] [MAIN ] Update Progress: 1251/2370 symbols completed. LEO took 24.8s. Estimated remaining: 2h 37m 48s. Rate: 7.1 symbols/min [2025-10-02T19:56:28.824084] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:28.835891] [DEBUG] [LOCAL ] LGI: Loaded 9839 existing records from primary storage. [2025-10-02T19:56:28.836128] [INFO ] [MAIN ] LGI: Loaded 9839 existing records. [2025-10-02T19:56:29.037734] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:29.037994] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-02T19:56:29.038051] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-02T19:56:29.038611] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-02T19:56:29.038708] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-02T19:56:29.078114] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-02T19:56:29.380433] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-02T19:56:29.472216] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:29.873057] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-10-02T19:56:30.386154] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-10-02T19:56:30.672982] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-02T19:56:31.108021] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-10-02T19:56:31.473005] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-02T19:56:32.273000] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-02T19:56:32.353139] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-02T19:56:32.915035] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T19:56:33.073002] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-02T19:56:33.234424] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-02T19:56:33.833926] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-02T19:56:33.872993] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-02T19:56:34.447841] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-02T19:56:34.673039] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-02T19:56:35.473013] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-02T19:56:36.273030] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-02T19:56:36.477041] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-02T19:56:36.931017] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-02T19:56:37.051869] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-02T19:56:37.073020] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-02T19:56:37.808379] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-02T19:56:37.873018] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-02T19:56:38.673059] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-02T19:56:38.733502] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-02T19:56:39.473001] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-02T19:56:40.249022] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-02T19:56:40.272999] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-02T19:56:40.553204] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-02T19:56:40.555981] [INFO ] [REMOTE ] LEN: Full fetch complete (77032 records). [2025-10-02T19:56:40.556158] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-02T19:56:41.022668] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-02T19:56:41.022764] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-02T19:56:41.023755] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-02T19:56:41.023820] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-02T19:56:41.025309] [DEBUG] [LOCAL ] LEN: Trimmed 77032 records to 53562 (keeping 200 days of data) [2025-10-02T19:56:41.083389] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-02T19:56:41.139280] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-02T19:56:41.389583] [DEBUG] [LOCAL ] LEN: Primary data saved (53562 records). [2025-10-02T19:56:41.389760] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-02T19:56:41.389855] [INFO ] [MAIN ] Update Progress: 1252/2370 symbols completed. LEN took 45.5s. Estimated remaining: 2h 37m 43s. Rate: 7.1 symbols/min [2025-10-02T19:56:41.574562] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:41.612541] [DEBUG] [LOCAL ] LH: Loaded 37827 existing records from primary storage. [2025-10-02T19:56:41.612908] [INFO ] [MAIN ] LH: Loaded 37827 existing records. [2025-10-02T19:56:41.812026] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:41.813492] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-02T19:56:41.813553] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-02T19:56:41.815117] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-02T19:56:41.815188] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-02T19:56:41.885424] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-02T19:56:42.222963] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:42.673003] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-02T19:56:43.148888] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-02T19:56:43.236630] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-10-02T19:56:43.247620] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-02T19:56:43.473049] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-02T19:56:44.273021] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-02T19:56:44.564224] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-02T19:56:45.073040] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-10-02T19:56:45.252451] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-02T19:56:45.873009] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-02T19:56:46.310606] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T19:56:46.673001] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-02T19:56:46.956087] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-02T19:56:47.473041] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-02T19:56:48.210941] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-02T19:56:48.272982] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-02T19:56:48.607720] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-02T19:56:49.073011] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-02T19:56:49.508767] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-02T19:56:49.624823] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-02T19:56:49.625773] [INFO ] [REMOTE ] LGI: Full fetch complete (14277 records). [2025-10-02T19:56:49.625851] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-02T19:56:49.878229] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-02T19:56:50.020245] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-02T19:56:50.020331] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-02T19:56:50.020670] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-02T19:56:50.020733] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-02T19:56:50.021264] [DEBUG] [LOCAL ] LGI: Trimmed 14277 records to 9893 (keeping 200 days of data) [2025-10-02T19:56:50.084660] [DEBUG] [LOCAL ] LGI: Primary data saved (9893 records). [2025-10-02T19:56:50.084808] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-02T19:56:50.084889] [INFO ] [MAIN ] Update Progress: 1253/2370 symbols completed. LGI took 21.5s. Estimated remaining: 2h 37m 35s. Rate: 7.1 symbols/min [2025-10-02T19:56:50.294186] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:50.350391] [DEBUG] [LOCAL ] LHX: Loaded 48686 existing records from primary storage. [2025-10-02T19:56:50.350765] [INFO ] [MAIN ] LHX: Loaded 48686 existing records. [2025-10-02T19:56:50.544006] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:50.544843] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-02T19:56:50.544922] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-02T19:56:50.546023] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-02T19:56:50.546117] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-02T19:56:50.678104] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-02T19:56:50.944767] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:50.955072] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-02T19:56:51.473009] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-02T19:56:52.196198] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-02T19:56:52.273013] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-10-02T19:56:53.073003] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-02T19:56:53.332061] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-02T19:56:53.872988] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-02T19:56:53.917766] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-10-02T19:56:54.221003] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-02T19:56:54.539848] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-02T19:56:54.540875] [INFO ] [REMOTE ] LFT: Full fetch complete (24157 records). [2025-10-02T19:56:54.540954] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-02T19:56:54.678138] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-02T19:56:54.947472] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-02T19:56:54.947557] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-02T19:56:54.948129] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-02T19:56:54.948214] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-02T19:56:54.948949] [DEBUG] [LOCAL ] LFT: Trimmed 24157 records to 18394 (keeping 200 days of data) [2025-10-02T19:56:55.061124] [DEBUG] [LOCAL ] LFT: Primary data saved (18394 records). [2025-10-02T19:56:55.061276] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-02T19:56:55.061366] [INFO ] [MAIN ] Update Progress: 1254/2370 symbols completed. LFT took 31.0s. Estimated remaining: 2h 37m 24s. Rate: 7.1 symbols/min [2025-10-02T19:56:55.248550] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:56:55.278957] [DEBUG] [LOCAL ] LII: Loaded 27988 existing records from primary storage. [2025-10-02T19:56:55.279232] [INFO ] [MAIN ] LII: Loaded 27988 existing records. [2025-10-02T19:56:55.469318] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:56:55.469538] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-02T19:56:55.469589] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-02T19:56:55.470586] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-02T19:56:55.470685] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-02T19:56:55.483300] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-02T19:56:55.859113] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:56:56.273171] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-10-02T19:56:56.467526] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T19:56:56.961079] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-02T19:56:57.073054] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-02T19:56:57.517385] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-10-02T19:56:57.872965] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-02T19:56:58.672989] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-02T19:56:58.859117] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-02T19:56:59.210213] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-02T19:56:59.473019] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-02T19:57:00.272978] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-02T19:57:00.303210] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-02T19:57:01.001728] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-02T19:57:01.073021] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-02T19:57:01.781570] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-02T19:57:01.873014] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-02T19:57:02.020793] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-02T19:57:02.672999] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-02T19:57:03.313386] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-02T19:57:03.473016] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-02T19:57:04.116490] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-02T19:57:04.273017] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-02T19:57:04.824862] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-02T19:57:05.073039] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-02T19:57:05.882728] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-02T19:57:05.913141] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-02T19:57:06.673054] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-02T19:57:06.923089] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-02T19:57:07.472983] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-02T19:57:07.800723] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-02T19:57:08.150400] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-02T19:57:08.273010] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-02T19:57:09.072985] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-02T19:57:09.284048] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-02T19:57:09.873633] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-02T19:57:09.876696] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-02T19:57:10.587810] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-02T19:57:10.672992] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-02T19:57:10.830765] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-02T19:57:11.472999] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-02T19:57:12.273000] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-02T19:57:12.556465] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-02T19:57:13.072996] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-02T19:57:13.240906] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-02T19:57:13.448036] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-02T19:57:13.449851] [INFO ] [REMOTE ] LH: Full fetch complete (54952 records). [2025-10-02T19:57:13.449947] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-02T19:57:13.863638] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-02T19:57:13.863756] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-02T19:57:13.864582] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-02T19:57:13.864670] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-02T19:57:13.866007] [DEBUG] [LOCAL ] LH: Trimmed 54952 records to 38094 (keeping 200 days of data) [2025-10-02T19:57:13.924546] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-02T19:57:14.126064] [DEBUG] [LOCAL ] LH: Primary data saved (38094 records). [2025-10-02T19:57:14.126240] [INFO ] [MAIN ] LH: Full history saved. [2025-10-02T19:57:14.126345] [INFO ] [MAIN ] Update Progress: 1255/2370 symbols completed. LH took 32.7s. Estimated remaining: 2h 37m 24s. Rate: 7.1 symbols/min [2025-10-02T19:57:14.321994] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:57:14.368475] [DEBUG] [LOCAL ] LION: Loaded 44271 existing records from primary storage. [2025-10-02T19:57:14.368844] [INFO ] [MAIN ] LION: Loaded 44271 existing records. [2025-10-02T19:57:14.585898] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:57:14.586284] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-02T19:57:14.586504] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-02T19:57:14.587480] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-02T19:57:14.587544] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-02T19:57:14.673123] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-02T19:57:15.001625] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:57:15.039415] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-02T19:57:15.472993] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-10-02T19:57:15.514306] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-02T19:57:15.517239] [INFO ] [REMOTE ] LEVI: Full fetch complete (74450 records). [2025-10-02T19:57:15.517426] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-02T19:57:15.969908] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-02T19:57:15.970231] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-02T19:57:15.971369] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-02T19:57:15.971612] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-02T19:57:15.973399] [DEBUG] [LOCAL ] LEVI: Trimmed 74450 records to 51949 (keeping 200 days of data) [2025-10-02T19:57:16.104083] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-02T19:57:16.299889] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-02T19:57:16.352089] [DEBUG] [LOCAL ] LEVI: Primary data saved (51949 records). [2025-10-02T19:57:16.352343] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-02T19:57:16.352451] [INFO ] [MAIN ] Update Progress: 1256/2370 symbols completed. LEVI took 55.7s. Estimated remaining: 2h 37m 10s. Rate: 7.1 symbols/min [2025-10-02T19:57:16.545755] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:57:16.552448] [DEBUG] [LOCAL ] LITB: Loaded 4340 existing records from primary storage. [2025-10-02T19:57:16.552679] [INFO ] [MAIN ] LITB: Loaded 4340 existing records. [2025-10-02T19:57:16.696463] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-10-02T19:57:16.810838] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:57:16.811127] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-02T19:57:16.811178] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-02T19:57:16.811470] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-02T19:57:16.811530] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-02T19:57:17.076967] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-02T19:57:17.202661] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:57:17.485090] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-02T19:57:17.873045] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-02T19:57:18.672989] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-02T19:57:18.815522] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-02T19:57:18.893299] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-02T19:57:19.473063] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-02T19:57:19.620029] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-02T19:57:20.273028] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-10-02T19:57:20.743984] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-10-02T19:57:20.903485] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-02T19:57:21.072999] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-02T19:57:21.873027] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-02T19:57:22.215364] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-02T19:57:22.673022] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-02T19:57:23.296883] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-02T19:57:23.299003] [INFO ] [REMOTE ] LHX: Full fetch complete (70815 records). [2025-10-02T19:57:23.299123] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-02T19:57:23.473686] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-02T19:57:23.657600] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-02T19:57:23.765825] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-02T19:57:23.765908] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-02T19:57:23.767009] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-02T19:57:23.767088] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-02T19:57:23.768905] [DEBUG] [LOCAL ] LHX: Trimmed 70815 records to 49032 (keeping 200 days of data) [2025-10-02T19:57:24.081183] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-02T19:57:24.101568] [DEBUG] [LOCAL ] LHX: Primary data saved (49032 records). [2025-10-02T19:57:24.101766] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-02T19:57:24.101859] [INFO ] [MAIN ] Update Progress: 1257/2370 symbols completed. LHX took 34.0s. Estimated remaining: 2h 37m 1s. Rate: 7.1 symbols/min [2025-10-02T19:57:24.278101] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-02T19:57:24.310220] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:57:24.365937] [DEBUG] [LOCAL ] LLY: Loaded 53285 existing records from primary storage. [2025-10-02T19:57:24.366261] [INFO ] [MAIN ] LLY: Loaded 53285 existing records. [2025-10-02T19:57:24.572496] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:57:24.572697] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-02T19:57:24.572794] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-02T19:57:24.574386] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-02T19:57:24.574452] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-02T19:57:24.880844] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-02T19:57:24.994257] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:57:25.072972] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-10-02T19:57:25.873038] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-02T19:57:26.673031] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-02T19:57:27.284273] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-02T19:57:27.322275] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-02T19:57:27.473018] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-02T19:57:27.633297] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-10-02T19:57:28.262048] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-02T19:57:28.272996] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-02T19:57:28.761618] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-02T19:57:29.073002] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-02T19:57:29.873006] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-02T19:57:30.673007] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-02T19:57:31.045015] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T19:57:31.112854] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-02T19:57:31.475957] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-02T19:57:31.479028] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-02T19:57:31.782242] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-02T19:57:32.273022] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-02T19:57:33.073008] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-02T19:57:33.501415] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-02T19:57:33.595590] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-02T19:57:33.872999] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-02T19:57:33.975144] [DEBUG] [REMOTE ] LION: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-02T19:57:33.975485] [WARN ] [REMOTE ] LION: No data returned for month 2025-05 [2025-10-02T19:57:33.975579] [FATAL] [REMOTE ] LION: API call failed - aborting fetch to avoid wasting further API calls [2025-10-02T19:57:33.975700] [FATAL] [MAIN ] LION: Failed to fetch primary data. [2025-10-02T19:57:33.975784] [WARN ] [MAIN ] LION: Deleting existing primary and derivative data due to fetch failure. [2025-10-02T19:57:33.975887] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-02T19:57:33.975979] [DEBUG] [LOCAL ] LION: No primary data file found to delete. [2025-10-02T19:57:33.976097] [INFO ] [LOCAL ] LION: Starting deletion of derivative data. [2025-10-02T19:57:33.976570] [DEBUG] [LOCAL ] LION: Deleted derivative data file. [2025-10-02T19:57:33.976686] [INFO ] [MAIN ] Update Progress: 1258/2370 symbols completed. LION took 19.9s. Estimated remaining: 2h 36m 54s. Rate: 7.1 symbols/min [2025-10-02T19:57:34.176295] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:57:34.230526] [DEBUG] [LOCAL ] LMND: Loaded 51874 existing records from primary storage. [2025-10-02T19:57:34.230992] [INFO ] [MAIN ] LMND: Loaded 51874 existing records. [2025-10-02T19:57:34.437086] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:57:34.437370] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-02T19:57:34.437434] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-02T19:57:34.438410] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-10-02T19:57:34.438476] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-02T19:57:34.678257] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-02T19:57:34.830917] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:57:35.344077] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-02T19:57:35.473066] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-02T19:57:36.273044] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-02T19:57:36.487329] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T19:57:36.489039] [INFO ] [REMOTE ] LII: Full fetch complete (41422 records). [2025-10-02T19:57:36.489173] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-02T19:57:36.802485] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-02T19:57:36.841205] [INFO ] [REMOTE ] LITB: Full fetch complete (5639 records). [2025-10-02T19:57:36.841368] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-02T19:57:37.076760] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-02T19:57:37.109446] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-02T19:57:37.115683] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-02T19:57:37.197135] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-02T19:57:37.224500] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-02T19:57:37.279772] [DEBUG] [LOCAL ] LII: Trimmed 41422 records to 28170 (keeping 200 days of data) [2025-10-02T19:57:37.429695] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-02T19:57:37.454670] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-02T19:57:37.455139] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-02T19:57:37.455443] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-02T19:57:37.456894] [DEBUG] [LOCAL ] LITB: Trimmed 5639 records to 4368 (keeping 200 days of data) [2025-10-02T19:57:37.489172] [DEBUG] [LOCAL ] LITB: Primary data saved (4368 records). [2025-10-02T19:57:37.489796] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-02T19:57:37.490217] [INFO ] [MAIN ] Update Progress: 1259/2370 symbols completed. LITB took 21.1s. Estimated remaining: 2h 36m 41s. Rate: 7.1 symbols/min [2025-10-02T19:57:37.679234] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:57:37.779931] [DEBUG] [LOCAL ] LMT: Loaded 49847 existing records from primary storage. [2025-10-02T19:57:37.781372] [INFO ] [MAIN ] LMT: Loaded 49847 existing records. [2025-10-02T19:57:37.873756] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-10-02T19:57:37.991932] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:57:37.992969] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-02T19:57:37.993304] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-02T19:57:37.996141] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-02T19:57:37.996837] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-02T19:57:38.089158] [DEBUG] [LOCAL ] LII: Primary data saved (28170 records). [2025-10-02T19:57:38.112553] [INFO ] [MAIN ] LII: Full history saved. [2025-10-02T19:57:38.123541] [INFO ] [MAIN ] Update Progress: 1260/2370 symbols completed. LII took 43.1s. Estimated remaining: 2h 36m 26s. Rate: 7.1 symbols/min [2025-10-02T19:57:38.506290] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:57:38.612106] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:57:38.657030] [DEBUG] [LOCAL ] LNC: Loaded 51610 existing records from primary storage. [2025-10-02T19:57:38.657417] [INFO ] [MAIN ] LNC: Loaded 51610 existing records. [2025-10-02T19:57:38.692915] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-10-02T19:57:38.862241] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:57:38.862474] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-02T19:57:38.862525] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-02T19:57:38.863562] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-02T19:57:38.863624] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-02T19:57:39.261150] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:57:39.390330] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-10-02T19:57:39.473021] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-02T19:57:39.914492] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-10-02T19:57:40.273040] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-10-02T19:57:40.881264] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-10-02T19:57:41.073026] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-02T19:57:41.432481] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-10-02T19:57:41.679827] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-10-02T19:57:41.873010] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-02T19:57:42.673001] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-02T19:57:42.922511] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-02T19:57:43.472975] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-02T19:57:44.052375] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-02T19:57:44.273014] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-02T19:57:44.851798] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-10-02T19:57:45.073031] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-02T19:57:45.366499] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-10-02T19:57:45.873060] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-02T19:57:46.672999] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-02T19:57:46.932029] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-10-02T19:57:47.078836] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-10-02T19:57:47.480716] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-02T19:57:47.486862] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-02T19:57:48.272979] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-02T19:57:48.561334] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-02T19:57:49.073033] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-02T19:57:49.872955] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-02T19:57:49.910838] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-02T19:57:50.018983] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-10-02T19:57:50.672986] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-02T19:57:50.865530] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-02T19:57:51.472979] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-02T19:57:51.664100] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-02T19:57:52.273002] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-02T19:57:52.980911] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-10-02T19:57:53.072988] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-02T19:57:53.500626] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-10-02T19:57:53.872969] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-02T19:57:53.987883] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-02T19:57:54.673000] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-02T19:57:55.473008] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-02T19:57:55.669479] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-02T19:57:55.764982] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-10-02T19:57:56.042751] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-02T19:57:56.272996] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-02T19:57:57.072988] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-02T19:57:57.331826] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-02T19:57:57.872969] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-02T19:57:57.933138] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-02T19:57:58.673070] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-02T19:57:59.044138] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-02T19:57:59.473081] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-02T19:58:00.124337] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-10-02T19:58:00.249358] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-02T19:58:00.272961] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-02T19:58:01.073060] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-02T19:58:01.564717] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-10-02T19:58:01.764937] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-02T19:58:01.873031] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-02T19:58:02.673006] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-02T19:58:03.473304] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-10-02T19:58:03.473382] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-02T19:58:03.522912] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T19:58:04.272992] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-02T19:58:04.743119] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-02T19:58:05.073009] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-02T19:58:05.754213] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (2.28 seconds). [2025-10-02T19:58:05.756330] [INFO ] [REMOTE ] LLY: Full fetch complete (77276 records). [2025-10-02T19:58:05.756441] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-02T19:58:05.878135] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-02T19:58:06.200816] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-02T19:58:06.201028] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-02T19:58:06.202070] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-02T19:58:06.202231] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-02T19:58:06.204113] [DEBUG] [LOCAL ] LLY: Trimmed 77276 records to 53674 (keeping 200 days of data) [2025-10-02T19:58:06.333956] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-10-02T19:58:06.606268] [DEBUG] [LOCAL ] LLY: Primary data saved (53674 records). [2025-10-02T19:58:06.606412] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-02T19:58:06.606498] [INFO ] [MAIN ] Update Progress: 1261/2370 symbols completed. LLY took 42.5s. Estimated remaining: 2h 36m 35s. Rate: 7.1 symbols/min [2025-10-02T19:58:06.676598] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-02T19:58:06.797866] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:06.830689] [DEBUG] [LOCAL ] LND: Loaded 4914 existing records from primary storage. [2025-10-02T19:58:06.833814] [INFO ] [MAIN ] LND: Loaded 4914 existing records. [2025-10-02T19:58:06.895549] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-02T19:58:07.042928] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:07.043174] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-02T19:58:07.043226] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-02T19:58:07.043553] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-02T19:58:07.043614] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-02T19:58:07.431129] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:07.473025] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-10-02T19:58:07.879670] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-02T19:58:08.273018] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-02T19:58:08.299834] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-10-02T19:58:08.878305] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-10-02T19:58:09.073049] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-02T19:58:09.568746] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-02T19:58:09.570881] [INFO ] [REMOTE ] LNC: Full fetch complete (74209 records). [2025-10-02T19:58:09.570993] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-02T19:58:09.881760] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-02T19:58:10.001574] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-02T19:58:10.001703] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-02T19:58:10.002815] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-02T19:58:10.002889] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-02T19:58:10.004489] [DEBUG] [LOCAL ] LNC: Trimmed 74209 records to 51991 (keeping 200 days of data) [2025-10-02T19:58:10.343092] [DEBUG] [LOCAL ] LNC: Primary data saved (51991 records). [2025-10-02T19:58:10.343290] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-02T19:58:10.343398] [INFO ] [MAIN ] Update Progress: 1262/2370 symbols completed. LNC took 32.2s. Estimated remaining: 2h 36m 22s. Rate: 7.1 symbols/min [2025-10-02T19:58:10.476551] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-02T19:58:10.538824] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:10.592367] [DEBUG] [LOCAL ] LNG: Loaded 51384 existing records from primary storage. [2025-10-02T19:58:10.592753] [INFO ] [MAIN ] LNG: Loaded 51384 existing records. [2025-10-02T19:58:10.678289] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-02T19:58:10.827903] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:10.828144] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-02T19:58:10.828193] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-02T19:58:10.829155] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-02T19:58:10.829215] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-02T19:58:10.993965] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-02T19:58:11.018150] [INFO ] [REMOTE ] LMT: Full fetch complete (72445 records). [2025-10-02T19:58:11.019430] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-02T19:58:11.498167] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-02T19:58:11.566046] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:11.595697] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-02T19:58:11.773100] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-02T19:58:11.773227] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-02T19:58:11.774380] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-02T19:58:11.774457] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-02T19:58:11.776140] [DEBUG] [LOCAL ] LMT: Trimmed 72445 records to 50172 (keeping 200 days of data) [2025-10-02T19:58:12.117692] [DEBUG] [LOCAL ] LMT: Primary data saved (50172 records). [2025-10-02T19:58:12.117830] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-02T19:58:12.118983] [INFO ] [MAIN ] Update Progress: 1263/2370 symbols completed. LMT took 34.6s. Estimated remaining: 2h 36m 8s. Rate: 7.1 symbols/min [2025-10-02T19:58:12.277517] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-10-02T19:58:12.305572] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:12.321395] [DEBUG] [LOCAL ] LNN: Loaded 11157 existing records from primary storage. [2025-10-02T19:58:12.321844] [INFO ] [MAIN ] LNN: Loaded 11157 existing records. [2025-10-02T19:58:12.534138] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:12.534365] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-02T19:58:12.534417] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-02T19:58:12.534960] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-02T19:58:12.535023] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-02T19:58:12.938909] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:13.072999] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-10-02T19:58:13.838275] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-02T19:58:13.858292] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-10-02T19:58:13.878134] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-02T19:58:13.896941] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-10-02T19:58:14.521219] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-02T19:58:14.672985] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-02T19:58:15.179171] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-02T19:58:15.472998] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-02T19:58:16.047770] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-02T19:58:16.272982] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-02T19:58:16.854931] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-02T19:58:17.073045] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-02T19:58:17.539631] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-02T19:58:17.873028] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-02T19:58:18.311703] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-02T19:58:18.673061] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-02T19:58:19.473051] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-02T19:58:20.075098] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-02T19:58:20.273011] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-02T19:58:20.368818] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-02T19:58:20.836085] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-02T19:58:21.073009] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-02T19:58:21.873039] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-02T19:58:22.672998] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-02T19:58:23.000359] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-10-02T19:58:23.211247] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-02T19:58:23.212133] [INFO ] [REMOTE ] LND: Full fetch complete (8333 records). [2025-10-02T19:58:23.212213] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-02T19:58:23.478099] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-02T19:58:23.613665] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-02T19:58:23.613755] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-02T19:58:23.614040] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-02T19:58:23.614088] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-02T19:58:23.614514] [DEBUG] [LOCAL ] LND: Trimmed 8333 records to 4941 (keeping 200 days of data) [2025-10-02T19:58:23.644594] [DEBUG] [LOCAL ] LND: Primary data saved (4941 records). [2025-10-02T19:58:23.644746] [INFO ] [MAIN ] LND: Full history saved. [2025-10-02T19:58:23.644835] [INFO ] [MAIN ] Update Progress: 1264/2370 symbols completed. LND took 17.0s. Estimated remaining: 2h 36m 2s. Rate: 7.1 symbols/min [2025-10-02T19:58:23.759244] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-02T19:58:23.771629] [INFO ] [REMOTE ] LMND: Full fetch complete (75309 records). [2025-10-02T19:58:23.782064] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-02T19:58:23.959826] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:24.291560] [DEBUG] [LOCAL ] LOAR: Loaded 41649 existing records from primary storage. [2025-10-02T19:58:24.291761] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-02T19:58:24.332892] [INFO ] [MAIN ] LOAR: Loaded 41649 existing records. [2025-10-02T19:58:24.382594] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-02T19:58:24.418399] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-02T19:58:24.436717] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-02T19:58:24.477157] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-02T19:58:24.554115] [DEBUG] [LOCAL ] LMND: Trimmed 75309 records to 52254 (keeping 200 days of data) [2025-10-02T19:58:24.620793] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:24.678033] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-02T19:58:24.678579] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-02T19:58:24.707578] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-02T19:58:24.708765] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-02T19:58:25.156636] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:25.161994] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-10-02T19:58:25.211920] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-02T19:58:25.321398] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-02T19:58:25.444101] [DEBUG] [LOCAL ] LMND: Primary data saved (52254 records). [2025-10-02T19:58:25.444267] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-02T19:58:25.444366] [INFO ] [MAIN ] Update Progress: 1265/2370 symbols completed. LMND took 51.5s. Estimated remaining: 2h 35m 48s. Rate: 7.1 symbols/min [2025-10-02T19:58:25.638553] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:25.667087] [DEBUG] [LOCAL ] LOB: Loaded 27380 existing records from primary storage. [2025-10-02T19:58:25.667395] [INFO ] [MAIN ] LOB: Loaded 27380 existing records. [2025-10-02T19:58:25.862962] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:25.863218] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-02T19:58:25.863277] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-02T19:58:25.864075] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-02T19:58:25.864140] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-02T19:58:25.878140] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-02T19:58:26.251033] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:26.608032] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-10-02T19:58:26.673045] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-02T19:58:26.719543] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-02T19:58:27.473003] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-02T19:58:28.262524] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-02T19:58:28.274178] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-02T19:58:28.441234] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-02T19:58:29.073010] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-10-02T19:58:29.479006] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-02T19:58:29.873045] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-02T19:58:29.987709] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-10-02T19:58:30.673056] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-02T19:58:31.433170] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-02T19:58:31.473067] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-02T19:58:31.959192] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-10-02T19:58:32.273013] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-02T19:58:32.386153] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-02T19:58:33.072974] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-02T19:58:33.466038] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-02T19:58:33.872995] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-02T19:58:34.312859] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-02T19:58:34.673054] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-02T19:58:34.965817] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-02T19:58:35.473033] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-02T19:58:36.065460] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-02T19:58:36.273017] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-02T19:58:36.798838] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-02T19:58:37.072956] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-02T19:58:37.836134] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-02T19:58:37.873104] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-02T19:58:38.611554] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-02T19:58:38.673010] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-02T19:58:38.870169] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-02T19:58:39.473057] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-02T19:58:39.817419] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-02T19:58:40.220573] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-02T19:58:40.273043] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-02T19:58:41.072965] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-02T19:58:41.379433] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-02T19:58:41.872981] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-02T19:58:41.939819] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-02T19:58:42.673001] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-02T19:58:42.900369] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-02T19:58:43.432185] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-02T19:58:43.434439] [INFO ] [REMOTE ] LNN: Full fetch complete (15705 records). [2025-10-02T19:58:43.434523] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-02T19:58:43.478111] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-02T19:58:43.854623] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-02T19:58:43.854738] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-02T19:58:43.855130] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-02T19:58:43.855179] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-02T19:58:43.855794] [DEBUG] [LOCAL ] LNN: Trimmed 15705 records to 11250 (keeping 200 days of data) [2025-10-02T19:58:43.937501] [DEBUG] [LOCAL ] LNN: Primary data saved (11250 records). [2025-10-02T19:58:43.937677] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-02T19:58:43.937785] [INFO ] [MAIN ] Update Progress: 1266/2370 symbols completed. LNN took 31.8s. Estimated remaining: 2h 35m 48s. Rate: 7.1 symbols/min [2025-10-02T19:58:44.122993] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:44.128988] [DEBUG] [LOCAL ] LOCL: Loaded 3632 existing records from primary storage. [2025-10-02T19:58:44.129181] [INFO ] [MAIN ] LOCL: Loaded 3632 existing records. [2025-10-02T19:58:44.288122] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-02T19:58:44.347305] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:44.347589] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-02T19:58:44.347681] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-02T19:58:44.348865] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-02T19:58:44.348928] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-02T19:58:44.751019] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:45.073055] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-02T19:58:45.220792] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-02T19:58:45.873030] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-10-02T19:58:46.347050] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-10-02T19:58:46.378028] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-02T19:58:46.559765] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-10-02T19:58:46.673013] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-02T19:58:47.472963] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-02T19:58:47.645336] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-02T19:58:48.273067] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-02T19:58:48.715350] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-02T19:58:48.983326] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-02T19:58:49.073017] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-02T19:58:49.872999] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-02T19:58:50.673055] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-02T19:58:50.718233] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-02T19:58:51.326150] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-02T19:58:51.374137] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-02T19:58:51.473064] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-02T19:58:52.273078] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-02T19:58:52.644579] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-02T19:58:53.073024] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-02T19:58:53.873001] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-02T19:58:54.052517] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-02T19:58:54.213350] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-02T19:58:54.672982] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-02T19:58:55.075619] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-02T19:58:55.473016] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-02T19:58:56.272999] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-02T19:58:56.336383] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-02T19:58:56.339117] [INFO ] [REMOTE ] LNG: Full fetch complete (74685 records). [2025-10-02T19:58:56.339275] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-02T19:58:56.482896] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-02T19:58:56.505474] [INFO ] [REMOTE ] LOB: Full fetch complete (37935 records). [2025-10-02T19:58:56.524462] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-02T19:58:56.685096] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-02T19:58:57.078157] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-02T19:58:57.166150] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-02T19:58:57.171399] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-02T19:58:57.173429] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-02T19:58:57.193159] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-02T19:58:57.277161] [DEBUG] [LOCAL ] LNG: Trimmed 74685 records to 51737 (keeping 200 days of data) [2025-10-02T19:58:57.292133] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-02T19:58:57.292242] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-02T19:58:57.292679] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-02T19:58:57.292766] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-02T19:58:57.294223] [DEBUG] [LOCAL ] LOB: Trimmed 37935 records to 27571 (keeping 200 days of data) [2025-10-02T19:58:57.803481] [DEBUG] [LOCAL ] LOB: Primary data saved (27571 records). [2025-10-02T19:58:57.819186] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-02T19:58:57.819565] [INFO ] [MAIN ] Update Progress: 1267/2370 symbols completed. LOB took 32.4s. Estimated remaining: 2h 35m 45s. Rate: 7.1 symbols/min [2025-10-02T19:58:57.873111] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-02T19:58:58.053278] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:58.083901] [DEBUG] [LOCAL ] LNG: Primary data saved (51737 records). [2025-10-02T19:58:58.084057] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-02T19:58:58.084148] [INFO ] [MAIN ] Update Progress: 1268/2370 symbols completed. LNG took 47.7s. Estimated remaining: 2h 35m 29s. Rate: 7.1 symbols/min [2025-10-02T19:58:58.215540] [DEBUG] [LOCAL ] LOMA: Loaded 32067 existing records from primary storage. [2025-10-02T19:58:58.221612] [INFO ] [MAIN ] LOMA: Loaded 32067 existing records. [2025-10-02T19:58:58.349259] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:58:58.365757] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-02T19:58:58.392622] [INFO ] [REMOTE ] LOAR: Full fetch complete (56177 records). [2025-10-02T19:58:58.405679] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-02T19:58:58.651529] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:58.657235] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-02T19:58:58.657383] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-02T19:58:58.668557] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-02T19:58:58.673940] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-02T19:58:58.855195] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-02T19:58:58.907992] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-02T19:58:59.025639] [DEBUG] [LOCAL ] LOW: Loaded 52943 existing records from primary storage. [2025-10-02T19:58:59.038378] [INFO ] [MAIN ] LOW: Loaded 52943 existing records. [2025-10-02T19:58:59.342257] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-02T19:58:59.358877] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-02T19:58:59.426776] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-02T19:58:59.483633] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-02T19:58:59.497469] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-02T19:58:59.499947] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-02T19:58:59.581578] [DEBUG] [LOCAL ] LOAR: Trimmed 56177 records to 41885 (keeping 200 days of data) [2025-10-02T19:58:59.710353] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:58:59.715207] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:58:59.715907] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-02T19:58:59.715993] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-02T19:58:59.768783] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-02T19:58:59.777784] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-02T19:59:00.083378] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-02T19:59:00.250513] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:59:00.273421] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-10-02T19:59:00.420171] [DEBUG] [LOCAL ] LOAR: Primary data saved (41885 records). [2025-10-02T19:59:00.420312] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-02T19:59:00.420400] [INFO ] [MAIN ] Update Progress: 1269/2370 symbols completed. LOAR took 36.8s. Estimated remaining: 2h 35m 15s. Rate: 7.1 symbols/min [2025-10-02T19:59:00.612496] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-24 to 2025-10-02. [2025-10-02T19:59:00.655699] [DEBUG] [LOCAL ] LPG: Loaded 39882 existing records from primary storage. [2025-10-02T19:59:00.656031] [INFO ] [MAIN ] LPG: Loaded 39882 existing records. [2025-10-02T19:59:00.857179] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-17, but need from 2024-12-13 for 200 day retention. Performing full refresh. [2025-10-02T19:59:00.857417] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-02T19:59:00.857468] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-02T19:59:00.858080] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-02T19:59:00.858143] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-02T19:59:01.079588] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-02T19:59:01.269341] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-13 to 2025-10-02 (requires 11 months of data pull). [2025-10-02T19:59:01.762722] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-02T19:59:01.873303] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-10-02T19:59:01.878368] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-10-02T19:59:02.672993] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-02T19:59:03.472984] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-10-02T19:59:03.855060] [INFO ] [REMOTE ] LOW: Incre